-- Logs begin at Thu 2022-08-04 03:10:12 UTC, end at Thu 2022-08-04 05:27:12 UTC. -- Aug 04 04:30:36.549764 dv-cinder-851279-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 04:30:36.558548 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 04:30:36.560507 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 04:30:36 2022] *** Aug 04 04:30:36.560507 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 04:30:36.560507 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 04:30:36.560507 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: nodename: dv-cinder-851279-5-iscsi Aug 04 04:30:36.560507 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: machine: x86_64 Aug 04 04:30:36.560507 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: clock source: unix Aug 04 04:30:36.560507 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: pcre jit disabled Aug 04 04:30:36.560507 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: detected number of CPU cores: 4 Aug 04 04:30:36.560507 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: current working directory: / Aug 04 04:30:36.560507 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: detected binary path: /usr/bin/uwsgi-core Aug 04 04:30:36.560507 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: your processes number limit is 47680 Aug 04 04:30:36.560507 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: your memory page size is 4096 bytes Aug 04 04:30:36.560507 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: detected max file descriptor number: 2048 Aug 04 04:30:36.561243 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: lock engine: pthread robust mutexes Aug 04 04:30:36.561243 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: thunder lock: enabled Aug 04 04:30:36.561243 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 04:30:36.561243 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 04:30:36.600628 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: Python main interpreter initialized at 0x5561ce92c9c0 Aug 04 04:30:36.600628 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: python threads support enabled Aug 04 04:30:36.600628 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: your server socket listen backlog is limited to 100 connections Aug 04 04:30:36.600628 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: your mercy for graceful operations on workers is 90 seconds Aug 04 04:30:36.601084 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 04:30:36.601084 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: *** Operational MODE: preforking *** Aug 04 04:30:36.601299 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: *** uWSGI is running in multiple interpreter mode *** Aug 04 04:30:36.601299 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: spawned uWSGI master process (pid: 109751) Aug 04 04:30:36.601500 dv-cinder-851279-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 04:30:36.602578 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: spawned uWSGI worker 1 (pid: 109752, cores: 1) Aug 04 04:30:36.602578 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: spawned uWSGI worker 2 (pid: 109753, cores: 1) Aug 04 04:30:36.602578 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 04:30:37.263618 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 04:30:37.264226 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 04:30:38.351828 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:30:38.351828 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: from cryptography.utils import int_from_bytes Aug 04 04:30:38.352542 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:30:38.352542 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: from cryptography.utils import int_from_bytes Aug 04 04:30:38.353719 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:30:38.353719 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: from cryptography.utils import int_from_bytes Aug 04 04:30:38.354156 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:30:38.354156 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: from cryptography.utils import int_from_bytes Aug 04 04:30:40.883131 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 04:30:40.883798 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 04:30:40.883902 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 04:30:40.884230 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 04:30:40.884484 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 04:30:40.884867 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.885189 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.885513 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.885852 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.886179 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.886486 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.886805 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.887121 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.887444 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.887703 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.888017 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.888339 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-5-iscsi {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.888660 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.888965 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.889272 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.889604 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.889912 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.890230 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.890535 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.891028 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.891457 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.891763 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.892072 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.892403 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.892531 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 04:30:40.892886 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 04:30:40.892965 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.893043 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.893182 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 04:30:40.893301 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.893577 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 04:30:40.893673 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.893828 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 04:30:40.893942 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.894245 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.894406 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.894706 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-5-iscsi {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.895024 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.895118 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.895340 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.895495 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.895632 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.895717 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.896030 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.896161 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.896350 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.896447 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.896646 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.896758 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.896963 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.897082 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.897294 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.897403 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.897586 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.897703 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.897913 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.898016 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.898244 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-5-iscsi {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.898401 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.898566 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.898671 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.898874 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.898965 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.899175 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.899326 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.899482 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.899571 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.899793 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.899930 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.900110 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.900237 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.900412 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.900553 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.900717 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.900918 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.901027 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.901229 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.901332 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.901538 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.901648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.901871 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.901967 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.902208 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.902305 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.902455 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.902550 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.902703 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.902809 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.903020 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.903159 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.903335 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.903469 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.903641 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.903781 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.903947 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.904079 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.904250 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.904395 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-5-iscsi {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.904544 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.904703 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.904842 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.905017 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.905154 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.905332 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.905469 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.905745 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.905846 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.906065 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.906190 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.906369 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.906455 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.906686 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.906770 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.906990 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.907089 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.907307 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.907400 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.907633 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.907718 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.907935 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.908035 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.908241 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.908345 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.908569 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.908653 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.908874 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.908961 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.909178 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.909273 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.909484 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.909589 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.910340 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.910446 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.910663 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.911202 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.911316 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.911517 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.911644 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.911774 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.911868 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.912088 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.912184 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.912417 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.912512 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.912699 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.912776 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.913004 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.913082 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.913296 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.913380 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.913567 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.913648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.913891 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.913986 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.914215 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.914315 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.914519 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.914613 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.914818 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.914916 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.915124 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.915219 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.915680 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.915781 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.915983 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.916102 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.916288 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.916382 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.916593 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.916678 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.916896 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.916995 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.917200 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.917300 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.917505 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.917631 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.917833 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.917929 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.918148 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.918236 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.918464 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.918558 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.918768 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.918866 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.919071 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.919176 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.919374 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.919469 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.919682 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.919780 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.919998 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.920084 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.920302 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.920396 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.920605 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.920705 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.920922 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.921020 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.921231 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.921316 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.921534 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.921639 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.921864 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.921950 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.922168 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.922260 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.922473 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.922570 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.922789 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.922874 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.923040 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.923134 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.923343 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.923429 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.923648 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.923734 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.923968 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.924068 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.924270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.924355 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.924571 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.924658 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.924874 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.925037 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.925174 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.925259 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.926109 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.926209 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.926602 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.926912 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.927007 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.927211 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.927297 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.927530 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.927615 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.927848 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.927941 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.928157 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.928241 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.928464 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.928556 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.928770 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.928865 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.929077 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.929161 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.929399 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.929500 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.929748 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.929837 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.930061 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.930152 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.930370 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.930470 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.930679 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.930766 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.930989 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.931083 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.931313 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.931411 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.931620 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.931706 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.931929 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.932014 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.932252 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.932348 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.932558 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.932643 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.932866 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.932953 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.933174 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.933267 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.933479 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.933613 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.933816 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.933913 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.934138 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.934237 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.934441 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.934528 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.934749 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.934835 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.935064 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.935150 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.935368 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.935453 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.935677 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.935764 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.935982 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.936068 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.936286 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.936372 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.936593 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.936677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.936899 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.936986 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.937204 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.937289 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.937510 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.937615 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.937841 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.937929 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.938161 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.938247 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.938484 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.938582 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.938791 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.938885 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.939098 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.939206 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.939407 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.939494 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.939727 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:30:40.939814 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.940035 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.940121 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.940364 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.940458 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.940662 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.940758 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.940972 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.941077 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.941624 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.941905 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.942011 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.942238 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.942325 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.942562 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.942646 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.942879 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.942976 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.943194 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.943280 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.943505 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.943593 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.943821 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.943916 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.944132 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.944226 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.944439 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.944535 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.944748 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.944835 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.945052 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.945144 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.945356 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.945452 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.945685 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.945775 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.945995 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.946093 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.946297 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.946398 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.946613 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.946713 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.946930 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.947025 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.947231 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.947326 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.947559 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.947646 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.947862 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.947948 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.948171 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.948260 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.948478 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.948571 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.948784 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.948875 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.949085 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.949172 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.949394 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.949487 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.949729 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.949819 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.950041 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.950135 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.950362 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.950449 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.950672 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.950757 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.950976 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.951063 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.951294 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.951376 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.951599 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.951693 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.951904 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.951990 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.952218 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.952303 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.952529 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.952621 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.952837 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.952922 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.953145 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.953232 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.953455 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.953584 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.953803 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.953890 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.954116 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.954214 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.954425 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.954521 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.954756 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.954843 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.955082 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.955168 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.955386 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.955473 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.955696 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.955788 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.956004 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.956091 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.956313 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.956400 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.956611 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.956692 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.956972 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.957276 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.957459 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.957599 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.957811 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.957910 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.958143 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.958232 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.958480 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.958568 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.958781 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.958879 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.959083 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.959170 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.959384 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.959472 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.959684 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.959770 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.960008 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.960106 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.960315 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.960401 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.960616 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.960710 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.960916 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.961011 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.961216 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.961304 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.961527 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.961687 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.961869 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.961963 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.962180 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.962265 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.962489 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.962574 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.962812 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.962906 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.963124 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.963210 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.963432 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.963516 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.963747 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.963831 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.964058 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.964152 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.964367 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.964517 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.964676 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.964780 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.964987 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.965083 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.965300 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.965387 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.965632 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.965741 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.965949 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.966042 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.966257 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.966352 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.966579 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.966682 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.966888 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.966973 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.967199 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.967302 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.967498 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.967586 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.967810 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.967896 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.968133 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.968227 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.968447 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.968542 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.968761 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.968857 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.969061 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.969161 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.969367 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.969453 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.969703 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.969795 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.970009 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.970112 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.970315 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.970408 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.970619 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.970705 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.970924 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.971012 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.971228 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.971324 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.971532 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.971617 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.971847 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.971935 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.972149 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.972241 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.972994 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.973305 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.973451 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.973641 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.973732 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.973944 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.974030 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.974255 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.974355 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.974589 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.974729 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.974907 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.974997 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.975212 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.975300 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.975523 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.975610 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.975840 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.975926 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.976147 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.976234 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.976453 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.976539 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.976762 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.976847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.977065 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.977152 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.977366 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.977460 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.977695 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.977786 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.978010 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.978100 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.978317 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.978413 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.978624 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.978719 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.978926 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.979015 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.979236 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.979323 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.979539 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.979634 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.979839 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.979927 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.980138 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.980227 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.980449 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.980545 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.980765 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.980852 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.981068 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.981161 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.981384 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.981480 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.981725 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.981815 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.982027 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.982116 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.982328 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.982430 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.982645 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.982731 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.982950 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.983048 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.983250 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.983347 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.983551 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.983637 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.983849 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.983935 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.984167 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.984301 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.984479 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.984565 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.984780 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.984872 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.985093 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.985181 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.985410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.985495 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.985803 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.986559 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.986559 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.986770 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.986842 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.986916 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.986983 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.986983 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.987235 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.987543 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.987706 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.987849 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.988090 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.988245 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.988556 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.988865 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.988949 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.989186 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.989322 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.989493 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.989614 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.989828 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.989914 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.990135 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.990219 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.990442 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.990536 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.990750 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.990836 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.991064 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.991161 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.991387 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.991626 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.991712 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.991953 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.992037 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.992265 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.992351 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.992578 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.992665 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.992894 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.992977 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.993202 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.993294 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.993508 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.993611 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.993845 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.993941 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.994171 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.994258 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.994482 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.994579 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.994791 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.994877 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.995095 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.995188 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.995399 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.995490 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.995702 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.995785 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.996003 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.996099 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.996305 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.996398 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.996607 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.996692 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.996910 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.997002 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.997208 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.997299 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.997509 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.997729 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.997827 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.997908 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.998124 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.998210 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.998436 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.998529 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.998739 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.998825 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.999046 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.999137 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.999346 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.999431 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.999663 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.999761 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:40.999969 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.000067 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.000273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.000366 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.000573 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.000669 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.000871 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.000957 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.001190 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.001286 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.001496 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.001610 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.001833 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.001917 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.002147 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.002242 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.002474 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.002570 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.002776 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.002860 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.003076 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.003174 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.003385 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.003468 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.003730 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.004031 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.004175 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.004330 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.004509 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.004636 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.004834 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.004939 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.005236 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.005398 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.005569 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.005757 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.005868 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.006079 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.006177 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.006402 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.006496 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.006726 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.006812 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.007042 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.007133 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.007341 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.007435 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.007650 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.007865 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.007968 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.008049 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.008238 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.008333 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.008534 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.008627 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.008838 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.008932 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.009141 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.009239 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.009439 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.009594 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.009769 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.009865 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.010067 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.010153 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.010381 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.010466 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.010680 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.010773 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.010978 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.011076 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.011275 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.011360 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.011581 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.011674 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.011881 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.012002 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.012194 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.012277 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.012500 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.012586 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.012814 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.012899 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.013119 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.013203 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.013442 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.013528 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.013778 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.013872 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.014079 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.014165 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.014378 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.014465 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.014680 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.014764 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.014994 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.015078 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.015306 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.015393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.015605 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.015690 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.015912 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.016010 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.016211 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.016297 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.016511 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.016602 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.016811 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.016905 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.017115 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.017201 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.017414 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.017499 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.017740 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.017892 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.018044 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.018160 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.018345 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.018442 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.018639 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.018735 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.018949 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.019036 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.019782 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.019908 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.020087 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.020389 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.020603 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.020696 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.020900 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.021016 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.021217 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.021303 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.021526 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.021673 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.021864 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.021978 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.022175 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.022291 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.022494 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.022608 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.022807 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.022905 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.023114 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.023201 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.023418 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.023504 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.023730 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.023823 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.024041 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.024134 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.024346 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.024431 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.024658 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.024751 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.024964 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.025049 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.025261 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.025345 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.025601 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.025702 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.025908 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.025999 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.026214 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.026298 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.026523 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.026616 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.026835 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.026930 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.027137 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.027230 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.027436 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.027529 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.027741 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.027827 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.028046 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.028146 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.028352 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.028448 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.028652 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.028743 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.028953 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.029038 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.029256 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.029341 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.029581 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.029667 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.029895 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.029977 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.030206 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.030294 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.030510 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.030595 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.030810 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.030894 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.031113 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.031197 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.031415 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.031499 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.031715 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.031879 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.032023 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.032106 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.032325 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.032410 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.032624 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.032717 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.032926 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.033009 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.033224 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.033307 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.033526 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.033642 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.033848 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.033932 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.034171 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.034275 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.034478 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.034571 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.034785 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.035611 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.035916 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.036171 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.036271 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.036526 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.036610 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.036836 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.036920 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.037149 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.037245 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.037454 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.037584 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.037829 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.037912 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.038153 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.038250 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.038471 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.038567 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.038781 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.038867 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.039082 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.039175 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.039382 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.039468 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.039689 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.039780 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.039999 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.040090 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.040298 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.040669 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.040856 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.040950 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.041159 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.041244 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.041477 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.041579 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.041816 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.041912 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.042132 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.042219 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.042455 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.042539 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.042777 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.042862 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.043102 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.043188 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.043407 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.043526 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.043716 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.043838 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.044027 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.044150 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.044338 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.044472 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.044648 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.044785 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.044958 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.045100 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.045268 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.045404 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.045601 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.045744 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.045916 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.046055 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.046228 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.046378 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.046539 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.046700 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.046846 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.047011 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.047156 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.047324 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.047466 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.047628 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.047772 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.047948 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.048096 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.048268 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.048410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.048583 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.048724 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.048903 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.049036 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.049310 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.049408 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.049658 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.049758 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.049969 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.050055 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.050290 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.050389 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.050901 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.051244 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.051378 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.051502 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.051597 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.051811 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.051897 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.052115 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.052200 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.052420 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.052515 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.052745 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.052845 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.053047 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.053162 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.053356 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.053472 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.053692 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.053874 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.053996 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.054229 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.054332 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.054551 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.054665 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.054883 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.054998 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.055183 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.055303 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.055503 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.055624 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.055817 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.055937 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.056135 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.056256 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.056454 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.056582 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.056759 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.056862 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.057079 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.057178 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.057386 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.057483 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.057716 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.057813 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.058019 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.058120 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.058319 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.058562 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.058684 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.058917 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.059039 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.059244 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.059359 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.059572 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.059687 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.059899 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.060017 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.060212 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.060341 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.060541 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.060660 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.060871 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.060989 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.061186 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.061309 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.061501 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.061652 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.061848 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.061972 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.062149 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.062290 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.062450 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.062619 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.062757 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.062948 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.063059 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.063265 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.063352 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.063584 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.063669 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.063893 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.064030 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.064219 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.064305 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.064522 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.064615 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.064822 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.064917 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.065143 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.065229 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.065444 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.065574 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.065788 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.065889 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.066202 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.066503 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.066745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.066835 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.067094 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.067193 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.067428 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.067513 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.067730 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.067815 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.068042 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.068127 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.068354 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.068438 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.068664 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.068756 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.068976 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.069097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.069288 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.069385 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.069622 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.069711 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.069938 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.070034 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.070251 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.070338 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.070564 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.070649 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.070870 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.070955 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.071176 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.071260 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.071489 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.071583 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.071798 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.071881 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.072112 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.072203 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.072430 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.072628 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.072755 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.072953 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.073082 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.073266 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.073391 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.073597 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.073743 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.073912 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.074060 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.074224 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.074371 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.074536 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.074681 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.074846 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.074988 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.075154 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.075335 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.075461 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.075645 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.075769 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.075971 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.076094 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.076304 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.076413 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.076637 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.076723 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.076950 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.077056 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.077287 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.077386 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.077638 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.077726 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.077959 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.078056 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.078281 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.078367 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.078609 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.078698 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.078915 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.079027 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.079224 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.079312 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.079534 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.079622 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.079840 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.079931 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.080148 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.080240 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.080452 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.080537 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.080764 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.080853 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.081070 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.081162 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.081375 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.081472 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.082219 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.082377 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.082549 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.082978 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.083085 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.083179 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.083378 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.083476 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.083714 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.083801 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.084037 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.084136 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.084351 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.084438 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.084664 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.084757 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.084974 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.085070 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.085327 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.085495 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.085662 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.085833 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.085999 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.086159 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.086315 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.086479 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.086642 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.086797 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.086961 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.087109 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.087279 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.087424 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.087598 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.087745 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.087917 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.088047 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.088235 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.088512 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.088607 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.088828 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.088987 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.089134 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.089274 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.089438 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.089524 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.089792 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.089898 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.090101 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.090187 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.090402 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.090625 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.090718 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.090961 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.091047 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.091281 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.091533 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.091618 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.091881 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.091967 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.092198 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.092283 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.092513 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.092608 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.092831 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.092917 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.093145 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.093230 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.093451 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.093535 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.093789 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.093888 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.094096 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.094180 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.094400 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.094493 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.094712 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.094798 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.095020 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.095105 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.095322 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.095428 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.095622 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.095708 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.095932 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.096017 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.096240 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.096334 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.096543 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.096629 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.096852 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.096938 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.097153 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.097241 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.097584 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.097950 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.098047 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.098199 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.098353 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.098502 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.098678 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.098811 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.098999 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.099117 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.099317 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.099404 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.099643 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.099729 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.099964 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.100061 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.100279 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.100373 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.100584 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.100669 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.100897 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.100993 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.101199 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.101285 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.101506 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.101607 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.101841 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.101937 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.102148 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.102234 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.102451 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.102537 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.102769 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.102867 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.103069 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.103156 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.103414 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.103599 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.103728 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.103917 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.104033 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.104251 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.104337 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.104578 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.104671 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.104905 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.104998 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.105224 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.105323 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.105579 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.105693 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.105891 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.106108 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.106194 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.106438 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.106523 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.106755 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.106841 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.107084 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.107175 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.107391 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.107492 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.107701 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.107792 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.108005 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.108092 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.108307 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.108401 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.108624 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.108708 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.108931 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.109015 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.109240 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.109469 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.109574 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.109857 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.109944 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.110167 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.110290 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.110473 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.110586 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.110785 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.110901 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.111095 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.111231 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.111403 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.111533 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.111703 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.111786 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.112007 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.112104 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.112313 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.112398 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.112616 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.112709 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.112923 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.113622 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.114008 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.114280 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.114366 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.114600 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.114698 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.114921 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.115008 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.115238 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.115323 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.115552 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.115677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.115875 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.115978 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.116181 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.116297 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.116491 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.116590 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.116799 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.116884 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.117106 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.117191 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.117415 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.117509 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.117758 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.117846 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.118063 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.118149 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.118367 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.118479 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.118675 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.118791 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.118983 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.119110 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.119299 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.119428 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.119606 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.119738 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.119924 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.120058 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.120229 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.120381 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.120542 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.120692 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.120847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.121012 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.121158 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.121326 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.121463 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.121678 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.121810 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.122016 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.122104 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.122343 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.122460 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.122666 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.122779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.122972 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.123091 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.123277 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.123416 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.123579 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.123733 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.123886 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.124045 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.124201 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.124393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.124508 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.124711 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.124798 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.125099 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.125243 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.125405 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.125599 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.125754 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.125924 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.126010 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.126258 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.126350 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.126590 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.126690 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.126894 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.126980 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.127192 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.127278 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.127495 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.127582 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.127798 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.127894 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.128099 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.128186 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.128400 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.128494 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.128798 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.128902 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.129273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.129369 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.129613 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.129704 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.129925 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.130011 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.130230 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.130316 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.130535 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.130628 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.130838 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.130961 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.131170 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.131271 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.131480 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.131566 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.131792 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.131886 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.132106 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.132205 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.132419 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.132504 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.132736 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.132870 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.133042 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.133180 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.133363 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.133451 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.133707 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.133810 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.134024 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.134111 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.134333 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.134419 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.134643 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.134727 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.134956 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.135050 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.135264 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.135349 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.135572 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.135656 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.135880 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.135966 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.136188 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.136274 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.136496 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.136598 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.136804 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.136887 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.137128 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.137212 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.137433 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.137533 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.137783 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.137870 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.138097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.138184 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.138415 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.138510 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.138729 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.138822 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.139552 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.139659 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.139728 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.139806 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.139881 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.139967 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.140045 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.140122 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.140311 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.140396 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.140652 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.140903 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.140989 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.141295 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.141453 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.141626 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.141936 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.142055 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.142279 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.142602 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.142696 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.142924 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.143193 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.143279 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.143527 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.143797 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.143884 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.144135 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.144932 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.145154 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.145539 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.145740 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.145961 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.146195 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.146280 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.146580 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.146774 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.146891 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.147200 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.147381 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.147510 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.147821 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.147999 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.148130 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.148439 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.148647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.148753 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.149064 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.149233 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.149378 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.149716 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.149914 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.150027 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.150335 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.150524 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.150674 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.151010 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.151101 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.151331 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.151658 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.151821 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.151974 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.152254 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.152340 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.152595 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.152692 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 04:30:41.152920 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.153244 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.153582 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.153898 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.154233 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.154547 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.154863 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.155175 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.155489 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.155801 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.156113 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.156442 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.156771 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.157079 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.157406 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.157753 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.158085 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.158665 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.159102 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.159448 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.159770 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.161215 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.161588 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.161890 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.162210 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.162534 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.162853 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.163172 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.163500 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.164523 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.164523 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.164523 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.164827 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.165097 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.165707 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.166060 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.166375 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.166725 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.167057 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.167377 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.167692 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.168002 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:30:41.168250 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 04:30:41.315876 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO dbcounter [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] Registered counter for database nova_api Aug 04 04:30:41.326846 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO dbcounter [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] Registered counter for database nova_api Aug 04 04:30:41.343952 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_db.sqlalchemy.engines [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:30:41.348408 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG oslo_db.sqlalchemy.engines [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:30:41.351478 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writer thread running {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:30:41.355302 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG dbcounter [-] [109752] Writer thread running {{(pid=109752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:30:41.407346 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.context [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc17ecad-4eac-4f3a-b656-dcc6b9ec830f(cell1) {{(pid=109753) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 04:30:41.411361 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:41.412909 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:41.413499 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.context [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc17ecad-4eac-4f3a-b656-dcc6b9ec830f(cell1) {{(pid=109752) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 04:30:41.413718 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:41.415950 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:41.417727 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG oslo_concurrency.lockutils [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:41.418076 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO dbcounter [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] Registered counter for database nova_cell0 Aug 04 04:30:41.419289 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG oslo_concurrency.lockutils [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:41.420084 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG oslo_concurrency.lockutils [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:30:41.422195 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG oslo_concurrency.lockutils [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:30:41.423366 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO dbcounter [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] Registered counter for database nova_cell1 Aug 04 04:30:41.424360 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO dbcounter [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] Registered counter for database nova_cell0 Aug 04 04:30:41.430532 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO dbcounter [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] Registered counter for database nova_cell1 Aug 04 04:30:41.431449 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_db.sqlalchemy.engines [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:30:41.434155 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_db.sqlalchemy.engines [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:30:41.438241 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writer thread running {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:30:41.442579 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG oslo_db.sqlalchemy.engines [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:30:41.443368 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG oslo_db.sqlalchemy.engines [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:30:41.451298 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG dbcounter [-] [109752] Writer thread running {{(pid=109752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:30:41.451664 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG dbcounter [-] [109752] Writer thread running {{(pid=109752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:30:41.578226 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writer thread running {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:30:41.588222 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO dbcounter [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] Registered counter for database nova_cell0 Aug 04 04:30:41.596950 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_db.sqlalchemy.engines [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:30:41.602125 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO dbcounter [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] Registered counter for database nova_cell0 Aug 04 04:30:41.602616 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writer thread running {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:30:41.610594 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG oslo_db.sqlalchemy.engines [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:30:41.615731 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG dbcounter [-] [109752] Writer thread running {{(pid=109752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:30:41.947377 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: WARNING keystonemiddleware.auth_token [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:30:41.949407 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: WARNING keystonemiddleware.auth_token [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:30:41.954712 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: WARNING keystonemiddleware.auth_token [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:30:41.957334 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: WARNING keystonemiddleware.auth_token [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:30:42.301235 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: WARNING keystonemiddleware.auth_token [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:30:42.304461 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: WARNING keystonemiddleware.auth_token [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:30:42.307377 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: WARNING keystonemiddleware.auth_token [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:30:42.310789 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: WARNING keystonemiddleware.auth_token [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:30:42.312658 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5561ce92c9c0 pid: 109752 (default app) Aug 04 04:30:42.314772 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:30:42.315973 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-0a13e951-71d5-4d53-9a26-06fe6bde9ee0 None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 Aug 04 04:30:42.316598 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5561ce92c9c0 pid: 109753 (default app) Aug 04 04:30:42.316985 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Thu Aug 4 04:30:42 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:58.578826 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:58.580813 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002654 Aug 04 04:31:58.581368 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:31:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:31:58.597383 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG dbcounter [-] [109752] Writing DB stats nova_api:SELECT=3 {{(pid=109752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:58.599219 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG dbcounter [-] [109752] Writing DB stats nova_cell1:SELECT=3 {{(pid=109752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:58.600289 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG dbcounter [-] [109752] Writing DB stats nova_cell0:SELECT=3 {{(pid=109752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:58.601518 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG dbcounter [-] [109752] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:59.465803 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-3fc8ad22-edc4-427a-a02f-9909633eaf41 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:31:59.497777 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-3fc8ad22-edc4-427a-a02f-9909633eaf41 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.909961 Aug 04 04:31:59.498535 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 2/3] 10.222.0.47 () {60 vars in 1292 bytes} [Thu Aug 4 04:31:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:01.759567 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:01.760379 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-06e8accf-aa81-44a6-a384-13cfa16dab25 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Aug 04 04:32:01.760963 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 2/4] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:32:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:02.241885 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-f21b74bb-573e-40c6-9d5d-08dd2ad7725a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "ram": 256}} {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:02.261822 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:32:02.261822 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: warnings.warn(msg) Aug 04 04:32:02.290929 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-f21b74bb-573e-40c6-9d5d-08dd2ad7725a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.523636 Aug 04 04:32:02.291770 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 3/5] 10.222.0.47 () {64 vars in 1283 bytes} [Thu Aug 4 04:32:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:32:02.516541 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-8fd990bc-388a-4e64-a7fa-ab85036bc069 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:02.521480 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:32:02.521480 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: warnings.warn(msg) Aug 04 04:32:02.524259 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writing DB stats nova_api:SELECT=3 {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:02.525113 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writing DB stats nova_cell0:SELECT=3 {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:02.526167 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writing DB stats nova_cell1:SELECT=3 {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:02.527216 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:02.600106 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-8fd990bc-388a-4e64-a7fa-ab85036bc069 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.299788 Aug 04 04:32:02.605683 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 3/6] 10.222.0.47 () {64 vars in 1336 bytes} [Thu Aug 4 04:32:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:32:04.873619 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-f21b74bb-573e-40c6-9d5d-08dd2ad7725a admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:04.874671 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-f21b74bb-573e-40c6-9d5d-08dd2ad7725a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 04 04:32:04.875236 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 4/7] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:32:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:05.544826 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-712617d5-c5d9-4163-911b-e854f625ebb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:05.564320 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:32:05.564320 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: warnings.warn(msg) Aug 04 04:32:05.583850 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-712617d5-c5d9-4163-911b-e854f625ebb8 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.702365 Aug 04 04:32:05.584760 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 4/8] 10.222.0.47 () {64 vars in 1283 bytes} [Thu Aug 4 04:32:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:32:05.596903 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-1ee0c24f-441e-4ebb-9e52-3cde37951e83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:05.600066 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:32:05.600066 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: warnings.warn(msg) Aug 04 04:32:05.636683 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-1ee0c24f-441e-4ebb-9e52-3cde37951e83 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043912 Aug 04 04:32:05.637477 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 5/9] 10.222.0.47 () {64 vars in 1336 bytes} [Thu Aug 4 04:32:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:07.900529 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-712617d5-c5d9-4163-911b-e854f625ebb8 admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:07.901538 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-712617d5-c5d9-4163-911b-e854f625ebb8 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 04 04:32:07.902073 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:32:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:08.381351 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-29f4c4cf-1293-4bfc-8fc3-a0083f9bed17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2", "swap": 0, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:08.403648 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-29f4c4cf-1293-4bfc-8fc3-a0083f9bed17 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495348 Aug 04 04:32:08.405714 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 6/11] 10.222.0.47 () {64 vars in 1283 bytes} [Thu Aug 4 04:32:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:32:08.417189 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-67d31c6f-be6e-4387-97a5-493617e161bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:08.445846 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-67d31c6f-be6e-4387-97a5-493617e161bf admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032274 Aug 04 04:32:08.446705 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 6/12] 10.222.0.47 () {64 vars in 1336 bytes} [Thu Aug 4 04:32:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:10.721987 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-29f4c4cf-1293-4bfc-8fc3-a0083f9bed17 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:10.723647 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-29f4c4cf-1293-4bfc-8fc3-a0083f9bed17 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 Aug 04 04:32:10.724218 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 7/13] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:32:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:11.199628 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-c80a3de8-6ef1-4eb4-a17f-185b8af8bfb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:11.226955 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-c80a3de8-6ef1-4eb4-a17f-185b8af8bfb4 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496254 Aug 04 04:32:11.228862 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 7/14] 10.222.0.47 () {64 vars in 1283 bytes} [Thu Aug 4 04:32:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:32:11.249245 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-833b4905-3f02-4cf8-8709-0ba92cbf4f8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:11.280334 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-833b4905-3f02-4cf8-8709-0ba92cbf4f8d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042333 Aug 04 04:32:11.281915 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 8/15] 10.222.0.47 () {64 vars in 1336 bytes} [Thu Aug 4 04:32:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:13.622393 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-c80a3de8-6ef1-4eb4-a17f-185b8af8bfb4 admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:13.624084 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-c80a3de8-6ef1-4eb4-a17f-185b8af8bfb4 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002198 Aug 04 04:32:13.635928 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 8/16] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:32:13 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:14.161377 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-579ed8dd-4575-46a5-a34c-3be9f2c7d5cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:14.188203 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-579ed8dd-4575-46a5-a34c-3be9f2c7d5cc admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.556103 Aug 04 04:32:14.189538 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 9/17] 10.222.0.47 () {64 vars in 1283 bytes} [Thu Aug 4 04:32:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:32:14.202605 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-a6db4723-20b4-4962-8c2f-944009b102ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:14.240744 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-a6db4723-20b4-4962-8c2f-944009b102ca admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042767 Aug 04 04:32:14.242349 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 9/18] 10.222.0.47 () {64 vars in 1336 bytes} [Thu Aug 4 04:32:14 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:16.585860 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-579ed8dd-4575-46a5-a34c-3be9f2c7d5cc admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:16.586887 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-579ed8dd-4575-46a5-a34c-3be9f2c7d5cc admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 04 04:32:16.587490 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 10/19] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:32:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:32:17.085422 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-3c163155-85cf-4881-ac64-ec1543e65aac admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:17.112831 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-3c163155-85cf-4881-ac64-ec1543e65aac admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.515279 Aug 04 04:32:17.114686 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 10/20] 10.222.0.47 () {60 vars in 1292 bytes} [Thu Aug 4 04:32:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:19.434381 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-579ed8dd-4575-46a5-a34c-3be9f2c7d5cc admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:19.435401 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-579ed8dd-4575-46a5-a34c-3be9f2c7d5cc admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 04 04:32:19.435807 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 11/21] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:32:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:19.917026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-999e983c-250a-43c5-b482-9e7d9b47957c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "disk": 1}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:19.937326 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-999e983c-250a-43c5-b482-9e7d9b47957c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.495095 Aug 04 04:32:19.937898 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 11/22] 10.222.0.47 () {64 vars in 1283 bytes} [Thu Aug 4 04:32:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:32:19.952341 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-901de008-29fd-49c7-b584-89dd69e21962 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:19.982042 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-901de008-29fd-49c7-b584-89dd69e21962 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034469 Aug 04 04:32:19.982780 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 12/23] 10.222.0.47 () {64 vars in 1333 bytes} [Thu Aug 4 04:32:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:22.176959 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-999e983c-250a-43c5-b482-9e7d9b47957c admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:22.178150 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-999e983c-250a-43c5-b482-9e7d9b47957c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001709 Aug 04 04:32:22.178635 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 12/24] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:32:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:22.713762 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-fac9b510-f21e-491f-90c7-6ca0c2292fed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:22.731867 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-fac9b510-f21e-491f-90c7-6ca0c2292fed admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.547189 Aug 04 04:32:22.732419 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 13/25] 10.222.0.47 () {64 vars in 1283 bytes} [Thu Aug 4 04:32:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:32:22.745403 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-57d498fa-11aa-4db6-984a-66df3ee0fe3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:22.769905 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-57d498fa-11aa-4db6-984a-66df3ee0fe3d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028126 Aug 04 04:32:22.770199 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 13/26] 10.222.0.47 () {64 vars in 1333 bytes} [Thu Aug 4 04:32:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:24.988690 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-fac9b510-f21e-491f-90c7-6ca0c2292fed admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:24.989814 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-fac9b510-f21e-491f-90c7-6ca0c2292fed admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002071 Aug 04 04:32:24.990221 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 14/27] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:32:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:25.363077 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-4d24dc55-9c2e-42b3-8c03-5fcb4c3f96ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "id": "3"}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:25.382654 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-4d24dc55-9c2e-42b3-8c03-5fcb4c3f96ca admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.386462 Aug 04 04:32:25.383210 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 14/28] 10.222.0.47 () {64 vars in 1283 bytes} [Thu Aug 4 04:32:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:32:25.395649 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-08118ed4-a82d-4dee-bb85-3db9abb396d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:25.419949 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-08118ed4-a82d-4dee-bb85-3db9abb396d7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028294 Aug 04 04:32:25.420624 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 15/29] 10.222.0.47 () {64 vars in 1333 bytes} [Thu Aug 4 04:32:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:32:27.714613 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-4d24dc55-9c2e-42b3-8c03-5fcb4c3f96ca admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:27.715554 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-4d24dc55-9c2e-42b3-8c03-5fcb4c3f96ca admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 04 04:32:27.715956 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 15/30] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:32:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:28.158539 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-30272801-a93d-4049-911e-7b918ea501e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4"}} {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:28.179155 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-30272801-a93d-4049-911e-7b918ea501e6 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.457125 Aug 04 04:32:28.179711 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 16/31] 10.222.0.47 () {64 vars in 1283 bytes} [Thu Aug 4 04:32:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:32:28.192202 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-cf9d0426-afbc-46f3-a3c3-fed37c981a37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:28.219959 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-cf9d0426-afbc-46f3-a3c3-fed37c981a37 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031763 Aug 04 04:32:28.220745 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 16/32] 10.222.0.47 () {64 vars in 1333 bytes} [Thu Aug 4 04:32:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:32:30.522432 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-30272801-a93d-4049-911e-7b918ea501e6 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:30.523559 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-30272801-a93d-4049-911e-7b918ea501e6 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Aug 04 04:32:30.523958 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 17/33] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:32:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:30.968313 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-0d61654a-4401-4679-89d5-d40acba20517 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "swap": 0, "id": "5"}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:30.992669 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-0d61654a-4401-4679-89d5-d40acba20517 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.462593 Aug 04 04:32:30.993582 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 17/34] 10.222.0.47 () {64 vars in 1283 bytes} [Thu Aug 4 04:32:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:32:31.006538 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-49e042e7-ebf7-4add-962e-e7ed2932f651 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:31.012353 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG dbcounter [-] [109752] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:31.040085 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-49e042e7-ebf7-4add-962e-e7ed2932f651 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038085 Aug 04 04:32:31.040797 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 18/35] 10.222.0.47 () {64 vars in 1333 bytes} [Thu Aug 4 04:32:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:32:50.961046 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-0d61654a-4401-4679-89d5-d40acba20517 admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:50.962081 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-0d61654a-4401-4679-89d5-d40acba20517 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 04 04:32:50.962479 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 18/36] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:32:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:50.973177 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG dbcounter [-] [109752] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=109752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:51.358474 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-5e14ed64-902c-4382-bdb6-6618e35d46f5 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:51.379154 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-5e14ed64-902c-4382-bdb6-6618e35d46f5 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409638 Aug 04 04:32:51.379868 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 19/37] 10.222.0.47 () {60 vars in 1292 bytes} [Thu Aug 4 04:32:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:52.444017 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-0d61654a-4401-4679-89d5-d40acba20517 admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:52.445032 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-0d61654a-4401-4679-89d5-d40acba20517 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 04 04:32:52.445434 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 19/38] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Aug 4 04:32:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:52.975999 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-3d0d68f8-ff6a-4395-a46e-1a52db42f871 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:52.981732 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.wsgi [None req-3d0d68f8-ff6a-4395-a46e-1a52db42f871 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-3d0d68f8-ff6a-4395-a46e-1a52db42f871 admin admin] Request method failure captured: Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Accept: application/json Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Accept-Encoding: gzip, deflate Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Connection: keep-alive Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Content-Length: 0 Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Host: 10.222.0.47 Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Openstack-Api-Version: compute 2.90 Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Openstack-System-Scope: None Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: User-Agent: python-novaclient Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Auth-Token: gAAAAABi60v0yijAyWG-3y0smlZacsFxlQOfVd0szz9VKf7akc15U8hfQVYIo2Os2ch-9f3tE70vlBV3Uri0yIQxjvVleBj5s8q4NRYRY_uroUBVNQnz9cCcKcQDcGD5iwZSOHJLAQckMdF0wSCTEoS0KVXwHWxqrEXBlVP4WGX5X9OS_QVfbRQ Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Domain-Id: None Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Domain-Name: None Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Identity-Status: Confirmed Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Is-Admin-Project: True Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Project-Domain-Id: default Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Project-Domain-Name: Default Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Project-Id: 312c7b7a94774ca2ba3533f4d13a2124 Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Project-Name: admin Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Role: member,admin,reader Aug 04 04:32:52.984979 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Roles: member,admin,reader Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_312c7b7a94774ca2ba3533f4d13a2124", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Tenant: admin Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Tenant-Id: 312c7b7a94774ca2ba3533f4d13a2124 Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Tenant-Name: admin Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User: admin Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User-Domain-Id: default Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User-Domain-Name: Default Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User-Id: fa79725fac2c4a528df2b060ede4922c Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User-Name: admin Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: method: > Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: exception: Flavor 42 could not be found. Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: action_args: {'id': '42'} Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:52.987824 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:52.989016 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:52.990293 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-3d0d68f8-ff6a-4395-a46e-1a52db42f871 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:52.992011 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-3d0d68f8-ff6a-4395-a46e-1a52db42f871 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.398363 Aug 04 04:32:52.992011 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 20/39] 10.222.0.47 () {60 vars in 1190 bytes} [Thu Aug 4 04:32:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:52.997188 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-8845005b-08b1-47ba-b97b-3de9ba63848f admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:53.001209 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:53.020716 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-8845005b-08b1-47ba-b97b-3de9ba63848f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027052 Aug 04 04:32:53.021249 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 20/40] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Aug 4 04:32:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:32:53.031137 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-8f87ad73-5cd3-4fe3-a3a7-8f3f24133d70 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:53.056704 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-8f87ad73-5cd3-4fe3-a3a7-8f3f24133d70 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029009 Aug 04 04:32:53.057193 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 21/41] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Aug 4 04:32:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:53.068289 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-eda77fec-df6b-40b8-a148-6a35b7d903ec admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:53.074394 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.wsgi [None req-eda77fec-df6b-40b8-a148-6a35b7d903ec admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-eda77fec-df6b-40b8-a148-6a35b7d903ec admin admin] Request method failure captured: Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Accept: application/json Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Accept-Encoding: gzip, deflate Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Connection: keep-alive Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Content-Length: 0 Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Host: 10.222.0.47 Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Openstack-Api-Version: compute 2.90 Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Openstack-System-Scope: None Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: User-Agent: python-novaclient Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Auth-Token: gAAAAABi60v0yijAyWG-3y0smlZacsFxlQOfVd0szz9VKf7akc15U8hfQVYIo2Os2ch-9f3tE70vlBV3Uri0yIQxjvVleBj5s8q4NRYRY_uroUBVNQnz9cCcKcQDcGD5iwZSOHJLAQckMdF0wSCTEoS0KVXwHWxqrEXBlVP4WGX5X9OS_QVfbRQ Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Domain-Id: None Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Domain-Name: None Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Identity-Status: Confirmed Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Is-Admin-Project: True Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Project-Domain-Id: default Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Project-Domain-Name: Default Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Project-Id: 312c7b7a94774ca2ba3533f4d13a2124 Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Project-Name: admin Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Role: member,admin,reader Aug 04 04:32:53.077677 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Roles: member,admin,reader Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_312c7b7a94774ca2ba3533f4d13a2124", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Tenant: admin Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Tenant-Id: 312c7b7a94774ca2ba3533f4d13a2124 Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Tenant-Name: admin Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User: admin Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User-Domain-Id: default Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User-Domain-Name: Default Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User-Id: fa79725fac2c4a528df2b060ede4922c Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User-Name: admin Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: method: > Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: exception: Flavor 42 could not be found. Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: action_args: {'id': '42'} Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:53.079270 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:53.080213 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:53.082026 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-eda77fec-df6b-40b8-a148-6a35b7d903ec admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:53.083661 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-eda77fec-df6b-40b8-a148-6a35b7d903ec admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015911 Aug 04 04:32:53.084596 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 21/42] 10.222.0.47 () {60 vars in 1190 bytes} [Thu Aug 4 04:32:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:54.083542 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-8f87ad73-5cd3-4fe3-a3a7-8f3f24133d70 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:54.084593 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-8f87ad73-5cd3-4fe3-a3a7-8f3f24133d70 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 04 04:32:54.084989 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 22/43] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Aug 4 04:32:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:54.691111 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-a866cf2e-b958-4058-8308-4cfcac5ce487 admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:54.696572 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.wsgi [None req-a866cf2e-b958-4058-8308-4cfcac5ce487 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-a866cf2e-b958-4058-8308-4cfcac5ce487 admin admin] Request method failure captured: Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Accept: application/json Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Accept-Encoding: gzip, deflate Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Connection: keep-alive Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Content-Length: 0 Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Host: 10.222.0.47 Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Openstack-Api-Version: compute 2.90 Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Openstack-System-Scope: None Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: User-Agent: python-novaclient Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Auth-Token: gAAAAABi60v1BLtYHECeJWESIxQwJ-aJhIbL8iktw62gBMechV3Vn_2J6My-nOYl62EoKrgMSGs0TsiRROdgd3OSvi19iXvnmUthLG9LB_lOfOz4eCnybkp78SqQo2ywh3iJmg-08NMXePI_6pSFKRrGuPf1TOuY_HOvywqnNFK5hDh5FO0GmMQ Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Domain-Id: None Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Domain-Name: None Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Identity-Status: Confirmed Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Is-Admin-Project: True Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Project-Domain-Id: default Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Project-Domain-Name: Default Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Project-Id: 312c7b7a94774ca2ba3533f4d13a2124 Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Project-Name: admin Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Role: member,admin,reader Aug 04 04:32:54.698097 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Roles: member,admin,reader Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_312c7b7a94774ca2ba3533f4d13a2124", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Tenant: admin Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Tenant-Id: 312c7b7a94774ca2ba3533f4d13a2124 Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Tenant-Name: admin Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User: admin Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User-Domain-Id: default Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User-Domain-Name: Default Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User-Id: fa79725fac2c4a528df2b060ede4922c Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User-Name: admin Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: method: > Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: exception: Flavor 84 could not be found. Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: action_args: {'id': '84'} Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:54.699647 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:54.700627 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:54.701855 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-a866cf2e-b958-4058-8308-4cfcac5ce487 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:54.703113 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-a866cf2e-b958-4058-8308-4cfcac5ce487 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.469642 Aug 04 04:32:54.703113 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 22/44] 10.222.0.47 () {60 vars in 1190 bytes} [Thu Aug 4 04:32:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 471 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:54.709512 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-20c9c939-5599-4cd1-8765-e1664d995067 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:54.724792 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-20c9c939-5599-4cd1-8765-e1664d995067 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019121 Aug 04 04:32:54.725370 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 23/45] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Aug 4 04:32:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:54.735047 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-61562ca8-16f1-4187-8f7a-64def2853e48 admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:54.754237 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-61562ca8-16f1-4187-8f7a-64def2853e48 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022214 Aug 04 04:32:54.754722 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 23/46] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Aug 4 04:32:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:54.764131 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-c37e65ad-66e7-4083-bc78-754ba9893fda admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:54.769645 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.wsgi [None req-c37e65ad-66e7-4083-bc78-754ba9893fda admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-c37e65ad-66e7-4083-bc78-754ba9893fda admin admin] Request method failure captured: Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Accept: application/json Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Accept-Encoding: gzip, deflate Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Connection: keep-alive Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Content-Length: 0 Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Host: 10.222.0.47 Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Openstack-Api-Version: compute 2.90 Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Openstack-System-Scope: None Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: User-Agent: python-novaclient Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Auth-Token: gAAAAABi60v1BLtYHECeJWESIxQwJ-aJhIbL8iktw62gBMechV3Vn_2J6My-nOYl62EoKrgMSGs0TsiRROdgd3OSvi19iXvnmUthLG9LB_lOfOz4eCnybkp78SqQo2ywh3iJmg-08NMXePI_6pSFKRrGuPf1TOuY_HOvywqnNFK5hDh5FO0GmMQ Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Domain-Id: None Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Domain-Name: None Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Identity-Status: Confirmed Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Is-Admin-Project: True Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Project-Domain-Id: default Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Project-Domain-Name: Default Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Project-Id: 312c7b7a94774ca2ba3533f4d13a2124 Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Project-Name: admin Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Role: member,admin,reader Aug 04 04:32:54.771183 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Roles: member,admin,reader Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_312c7b7a94774ca2ba3533f4d13a2124", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Tenant: admin Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Tenant-Id: 312c7b7a94774ca2ba3533f4d13a2124 Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Tenant-Name: admin Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User: admin Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User-Domain-Id: default Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User-Domain-Name: Default Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User-Id: fa79725fac2c4a528df2b060ede4922c Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User-Name: admin Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: method: > Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: exception: Flavor 84 could not be found. Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: action_args: {'id': '84'} Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:54.772672 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:54.774673 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:54.775745 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-c37e65ad-66e7-4083-bc78-754ba9893fda admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:54.776804 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-c37e65ad-66e7-4083-bc78-754ba9893fda admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012047 Aug 04 04:32:54.776804 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 24/47] 10.222.0.47 () {60 vars in 1190 bytes} [Thu Aug 4 04:32:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 04:32:55.747391 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-61562ca8-16f1-4187-8f7a-64def2853e48 admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:55.748386 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-61562ca8-16f1-4187-8f7a-64def2853e48 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 04 04:32:55.748783 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 24/48] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Aug 4 04:32:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:56.282336 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-5f37a70d-ae49-4673-8f97-6664091d075b admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:56.288321 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.wsgi [None req-5f37a70d-ae49-4673-8f97-6664091d075b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-5f37a70d-ae49-4673-8f97-6664091d075b admin admin] Request method failure captured: Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Accept: application/json Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Accept-Encoding: gzip, deflate Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Connection: keep-alive Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Content-Length: 0 Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Host: 10.222.0.47 Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Openstack-Api-Version: compute 2.90 Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Openstack-System-Scope: None Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: User-Agent: python-novaclient Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Auth-Token: gAAAAABi60v3hKP0_Gs2wdogBl6CLEVDj0UgTueNGc_0MNwG9WXE6-NyVqCDJ-v5W_VM_i8yoBQctjjS2QaMLpXFeicgw2DoFlfub8bSMSDAi9YZkVMw45xltbVDGypZOY4cJKJXSK4yq7YQl6ptt51xRcR2zzllOj_X4U9_ZhQseBbBmlHFRPE Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Domain-Id: None Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Domain-Name: None Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Identity-Status: Confirmed Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Is-Admin-Project: True Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Project-Domain-Id: default Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Project-Domain-Name: Default Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Project-Id: 312c7b7a94774ca2ba3533f4d13a2124 Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Project-Name: admin Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Role: member,admin,reader Aug 04 04:32:56.289847 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Roles: member,admin,reader Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_312c7b7a94774ca2ba3533f4d13a2124", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Tenant: admin Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Tenant-Id: 312c7b7a94774ca2ba3533f4d13a2124 Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-Tenant-Name: admin Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User: admin Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User-Domain-Id: default Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User-Domain-Name: Default Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User-Id: fa79725fac2c4a528df2b060ede4922c Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: X-User-Name: admin Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: method: > Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: exception: Flavor 451 could not be found. Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: action_args: {'id': '451'} Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:56.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:56.292393 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: ERROR nova.api.openstack.wsgi Aug 04 04:32:56.293779 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-5f37a70d-ae49-4673-8f97-6664091d075b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:56.295318 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-5f37a70d-ae49-4673-8f97-6664091d075b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.398020 Aug 04 04:32:56.295318 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 25/49] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Aug 4 04:32:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:56.302218 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-dcdf9cee-54f3-45e9-8287-23f579697d99 admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:56.317849 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-dcdf9cee-54f3-45e9-8287-23f579697d99 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019107 Aug 04 04:32:56.318667 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 25/50] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Aug 4 04:32:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:56.328488 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:56.344208 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019262 Aug 04 04:32:56.344762 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 26/51] 10.222.0.47 () {60 vars in 1210 bytes} [Thu Aug 4 04:32:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:32:56.354594 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-0d38cefd-7fc3-45ce-b9e3-2482afbdcb72 admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:56.359879 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.wsgi [None req-0d38cefd-7fc3-45ce-b9e3-2482afbdcb72 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-0d38cefd-7fc3-45ce-b9e3-2482afbdcb72 admin admin] Request method failure captured: Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Accept: application/json Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Accept-Encoding: gzip, deflate Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Connection: keep-alive Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Content-Length: 0 Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Host: 10.222.0.47 Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Openstack-Api-Version: compute 2.90 Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Openstack-System-Scope: None Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: User-Agent: python-novaclient Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Auth-Token: gAAAAABi60v3hKP0_Gs2wdogBl6CLEVDj0UgTueNGc_0MNwG9WXE6-NyVqCDJ-v5W_VM_i8yoBQctjjS2QaMLpXFeicgw2DoFlfub8bSMSDAi9YZkVMw45xltbVDGypZOY4cJKJXSK4yq7YQl6ptt51xRcR2zzllOj_X4U9_ZhQseBbBmlHFRPE Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Domain-Id: None Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Domain-Name: None Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Identity-Status: Confirmed Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Is-Admin-Project: True Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Project-Domain-Id: default Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Project-Domain-Name: Default Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Project-Id: 312c7b7a94774ca2ba3533f4d13a2124 Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Project-Name: admin Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Role: member,admin,reader Aug 04 04:32:56.361338 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Roles: member,admin,reader Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_312c7b7a94774ca2ba3533f4d13a2124", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/312c7b7a94774ca2ba3533f4d13a2124"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Tenant: admin Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Tenant-Id: 312c7b7a94774ca2ba3533f4d13a2124 Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-Tenant-Name: admin Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User: admin Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User-Domain-Id: default Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User-Domain-Name: Default Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User-Id: fa79725fac2c4a528df2b060ede4922c Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: X-User-Name: admin Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: method: > Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: exception: Flavor 451 could not be found. Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: action_args: {'id': '451'} Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:32:56.364086 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:56.365273 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: ERROR nova.api.openstack.wsgi Aug 04 04:32:56.366648 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-0d38cefd-7fc3-45ce-b9e3-2482afbdcb72 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:32:56.367928 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-0d38cefd-7fc3-45ce-b9e3-2482afbdcb72 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011639 Aug 04 04:32:56.367928 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 26/52] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Aug 4 04:32:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 04:32:57.335155 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:57.336156 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 04 04:32:57.336550 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 27/53] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Aug 4 04:32:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:57.861369 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-9723c460-c087-48cc-b71a-bc8f5cf19b37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:57.881968 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-9723c460-c087-48cc-b71a-bc8f5cf19b37 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.404472 Aug 04 04:32:57.882535 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 27/54] 10.222.0.47 () {64 vars in 1235 bytes} [Thu Aug 4 04:32:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 04:32:58.876661 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:32:58.877763 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 04 04:32:58.878295 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 28/55] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Aug 4 04:32:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:32:59.413341 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-a43d8272-f7bd-4f77-9d31-344c8eeddd77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:32:59.432739 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-a43d8272-f7bd-4f77-9d31-344c8eeddd77 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.412827 Aug 04 04:32:59.433283 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 28/56] 10.222.0.47 () {64 vars in 1235 bytes} [Thu Aug 4 04:32:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:33:00.408991 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:00.410136 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Aug 04 04:33:00.410539 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 29/57] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Aug 4 04:33:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:00.934828 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-f7fe1ad0-6051-42d1-8a7a-20206e5241ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:00.954211 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-f7fe1ad0-6051-42d1-8a7a-20206e5241ba admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.405691 Aug 04 04:33:00.954741 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 29/58] 10.222.0.47 () {64 vars in 1235 bytes} [Thu Aug 4 04:33:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:33:01.955328 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:01.956851 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 04 04:33:01.957251 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 30/59] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Aug 4 04:33:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:33:02.489901 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-c43604d4-f3cb-45b7-97ff-ae2b386340c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:33:02.508587 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-c43604d4-f3cb-45b7-97ff-ae2b386340c3 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.405420 Aug 04 04:33:02.509140 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 30/60] 10.222.0.47 () {64 vars in 1235 bytes} [Thu Aug 4 04:33:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:33:03.492088 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:03.493096 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 04 04:33:03.493496 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 31/61] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Aug 4 04:33:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:04.023931 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-da21f43e-75e1-46cd-9918-a988d4612d70 admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:04.044895 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-da21f43e-75e1-46cd-9918-a988d4612d70 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409813 Aug 04 04:33:04.045650 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 31/62] 10.222.0.47 () {60 vars in 1202 bytes} [Thu Aug 4 04:33:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:56.062693 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:56.063710 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-1037a37c-2b92-4e8b-a985-8a120b755a40 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 04 04:33:56.064113 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 32/63] 10.222.0.47 () {54 vars in 931 bytes} [Thu Aug 4 04:33:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:33:56.075104 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:56.458970 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-42ccafe8-e5f3-4b49-a1e6-9fda88073efa admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:56.479300 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-42ccafe8-e5f3-4b49-a1e6-9fda88073efa admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408576 Aug 04 04:33:56.479781 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 32/64] 10.222.0.47 () {60 vars in 1292 bytes} [Thu Aug 4 04:33:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:33:56.500941 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG dbcounter [-] [109752] Writing DB stats nova_api:SELECT=14 {{(pid=109752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:56.505985 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-b13b4a20-50dc-45c5-9871-ae93d7fe9935 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:56.513814 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-b13b4a20-50dc-45c5-9871-ae93d7fe9935 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014220 Aug 04 04:33:56.514588 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 33/65] 10.222.0.47 () {60 vars in 1283 bytes} [Thu Aug 4 04:33:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:56.526577 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-8fb25943-fa8f-47d5-89d3-0d42a33ba78f admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:56.534424 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-8fb25943-fa8f-47d5-89d3-0d42a33ba78f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011582 Aug 04 04:33:56.534951 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 33/66] 10.222.0.47 () {60 vars in 1286 bytes} [Thu Aug 4 04:33:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:33:56.547472 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-14a6f1a4-e98f-40c0-a647-aa1649f22c70 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:56.555715 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-14a6f1a4-e98f-40c0-a647-aa1649f22c70 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012916 Aug 04 04:33:56.556236 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 34/67] 10.222.0.47 () {60 vars in 1286 bytes} [Thu Aug 4 04:33:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:33:56.568280 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-bb5b9b58-a5af-4832-83b8-ad4974708f0a admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:33:56.576118 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-bb5b9b58-a5af-4832-83b8-ad4974708f0a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012043 Aug 04 04:33:56.576675 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 34/68] 10.222.0.47 () {60 vars in 1283 bytes} [Thu Aug 4 04:33:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:36:50.893172 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-14a6f1a4-e98f-40c0-a647-aa1649f22c70 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:50.894210 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-14a6f1a4-e98f-40c0-a647-aa1649f22c70 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 04 04:36:50.894609 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 35/69] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Aug 4 04:36:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:51.039038 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writing DB stats nova_api:SELECT=6 {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:51.213903 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-00847d70-96b7-4369-8dc7-d548535e42ff admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:51.216841 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:51.216841 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: warnings.warn(msg) Aug 04 04:36:51.218152 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-00847d70-96b7-4369-8dc7-d548535e42ff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:51.218587 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-00847d70-96b7-4369-8dc7-d548535e42ff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:51.219367 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-00847d70-96b7-4369-8dc7-d548535e42ff admin admin] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:51.219790 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-00847d70-96b7-4369-8dc7-d548535e42ff admin admin] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:51.256808 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-00847d70-96b7-4369-8dc7-d548535e42ff admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.219240 Aug 04 04:36:51.257381 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 35/70] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Aug 4 04:36:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:36:52.130844 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-14a6f1a4-e98f-40c0-a647-aa1649f22c70 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:52.131913 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-14a6f1a4-e98f-40c0-a647-aa1649f22c70 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 04 04:36:52.132297 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 36/71] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Aug 4 04:36:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:36:52.327564 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-b2a7c3a9-e857-451f-9202-a6573c7e5aab admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:36:52.330069 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:52.330069 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: warnings.warn(msg) Aug 04 04:36:52.331343 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-b2a7c3a9-e857-451f-9202-a6573c7e5aab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:52.331785 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-b2a7c3a9-e857-451f-9202-a6573c7e5aab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:52.332600 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-b2a7c3a9-e857-451f-9202-a6573c7e5aab admin admin] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:36:52.333024 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-b2a7c3a9-e857-451f-9202-a6573c7e5aab admin admin] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:36:52.352989 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-b2a7c3a9-e857-451f-9202-a6573c7e5aab admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081265 Aug 04 04:36:52.353587 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 36/72] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Aug 4 04:36:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:37:03.624893 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-14a6f1a4-e98f-40c0-a647-aa1649f22c70 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:03.625941 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-14a6f1a4-e98f-40c0-a647-aa1649f22c70 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 04 04:37:03.626342 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 37/73] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Aug 4 04:37:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:03.770258 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writing DB stats nova_cell0:SELECT=4 {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:03.770915 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writing DB stats nova_cell1:SELECT=4 {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:03.771522 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG dbcounter [-] [109753] Writing DB stats nova_api:SELECT=8 {{(pid=109753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:37:03.825503 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-560002ce-b41b-461f-8ae3-26ff26afb0aa admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:03.827889 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:37:03.827889 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: warnings.warn(msg) Aug 04 04:37:03.829075 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-560002ce-b41b-461f-8ae3-26ff26afb0aa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:03.829577 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-560002ce-b41b-461f-8ae3-26ff26afb0aa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:03.832860 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-560002ce-b41b-461f-8ae3-26ff26afb0aa admin admin] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:03.833335 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-560002ce-b41b-461f-8ae3-26ff26afb0aa admin admin] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:03.859958 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-560002ce-b41b-461f-8ae3-26ff26afb0aa admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.094231 Aug 04 04:37:03.860522 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 37/74] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Aug 4 04:37:03 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 04:37:04.694093 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: DEBUG nova.api.openstack.wsgi [None req-14a6f1a4-e98f-40c0-a647-aa1649f22c70 admin admin] Calling method '>' {{(pid=109752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:04.695114 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: INFO nova.api.openstack.requestlog [None req-14a6f1a4-e98f-40c0-a647-aa1649f22c70 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 04 04:37:04.695513 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: [pid: 109752|app: 0|req: 38/75] 10.222.0.47 () {56 vars in 1074 bytes} [Thu Aug 4 04:37:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:37:04.888836 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG nova.api.openstack.wsgi [None req-31f92be1-3f16-4268-9cb1-7564b74434c8 admin admin] Calling method '>' {{(pid=109753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:37:04.891241 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:37:04.891241 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: warnings.warn(msg) Aug 04 04:37:04.892456 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-31f92be1-3f16-4268-9cb1-7564b74434c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:04.892902 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-31f92be1-3f16-4268-9cb1-7564b74434c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:04.893750 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-31f92be1-3f16-4268-9cb1-7564b74434c8 admin admin] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:37:04.894200 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: DEBUG oslo_concurrency.lockutils [None req-31f92be1-3f16-4268-9cb1-7564b74434c8 admin admin] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:37:04.915911 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: INFO nova.api.openstack.requestlog [None req-31f92be1-3f16-4268-9cb1-7564b74434c8 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080264 Aug 04 04:37:04.916477 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: [pid: 109753|app: 0|req: 38/76] 10.222.0.47 () {60 vars in 1193 bytes} [Thu Aug 4 04:37:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 04:38:01.671077 dv-cinder-851279-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 04:38:01.671904 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: Thu Aug 4 04:38:01 2022 - graceful shutdown triggered... Aug 04 04:38:01.672377 dv-cinder-851279-5-iscsi devstack@n-api.service[109752]: Gracefully killing worker 1 (pid: 109752)... Aug 04 04:38:01.673030 dv-cinder-851279-5-iscsi devstack@n-api.service[109753]: Gracefully killing worker 2 (pid: 109753)... Aug 04 04:38:02.672278 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: worker 1 buried after 1 seconds Aug 04 04:38:02.672690 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: worker 2 buried after 1 seconds Aug 04 04:38:02.672690 dv-cinder-851279-5-iscsi devstack@n-api.service[109751]: goodbye to uWSGI. Aug 04 04:38:02.673888 dv-cinder-851279-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 04:38:02.674483 dv-cinder-851279-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 04:38:02.677430 dv-cinder-851279-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 04:38:02.688214 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 04:38:02.691363 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 04:38:02 2022] *** Aug 04 04:38:02.691363 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 04:38:02.691363 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 04:38:02.691363 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: nodename: dv-cinder-851279-5-iscsi Aug 04 04:38:02.691363 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: machine: x86_64 Aug 04 04:38:02.691363 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: clock source: unix Aug 04 04:38:02.691363 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: pcre jit disabled Aug 04 04:38:02.691363 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: detected number of CPU cores: 4 Aug 04 04:38:02.691363 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: current working directory: / Aug 04 04:38:02.691363 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: detected binary path: /usr/bin/uwsgi-core Aug 04 04:38:02.692128 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: your processes number limit is 47680 Aug 04 04:38:02.692128 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: your memory page size is 4096 bytes Aug 04 04:38:02.692128 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: detected max file descriptor number: 2048 Aug 04 04:38:02.692128 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: lock engine: pthread robust mutexes Aug 04 04:38:02.692128 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: thunder lock: enabled Aug 04 04:38:02.692128 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 04:38:02.692128 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 04:38:02.733291 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: Python main interpreter initialized at 0x55c1f0d029c0 Aug 04 04:38:02.733291 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: python threads support enabled Aug 04 04:38:02.733291 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: your server socket listen backlog is limited to 100 connections Aug 04 04:38:02.733291 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: your mercy for graceful operations on workers is 90 seconds Aug 04 04:38:02.733930 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 04:38:02.734025 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: *** Operational MODE: preforking *** Aug 04 04:38:02.734311 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: *** uWSGI is running in multiple interpreter mode *** Aug 04 04:38:02.734311 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: spawned uWSGI master process (pid: 134867) Aug 04 04:38:02.734515 dv-cinder-851279-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 04:38:02.734765 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: spawned uWSGI worker 1 (pid: 134883, cores: 1) Aug 04 04:38:02.735547 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: spawned uWSGI worker 2 (pid: 134884, cores: 1) Aug 04 04:38:02.735547 dv-cinder-851279-5-iscsi devstack@n-api.service[134867]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 04:38:03.404704 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 04:38:03.410771 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 04:38:04.576304 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:38:04.576304 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: from cryptography.utils import int_from_bytes Aug 04 04:38:04.577086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:38:04.577086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: from cryptography.utils import int_from_bytes Aug 04 04:38:04.581388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:38:04.581388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: from cryptography.utils import int_from_bytes Aug 04 04:38:04.581872 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:38:04.581872 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: from cryptography.utils import int_from_bytes Aug 04 04:38:06.931568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 04:38:06.932294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 04:38:06.932390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 04:38:06.932722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 04:38:06.932990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 04:38:06.933381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.933738 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.934062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.934385 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.934720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.935036 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.935361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.935684 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.936013 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.936280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.936602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.936930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-5-iscsi {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.937254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.937640 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.937892 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.938214 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.938521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.939444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.940298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.940385 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.942018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.942018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.942018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.942018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.942018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.942397 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.942657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.942997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.943301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.943597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.944008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-5-iscsi {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.944336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.944672 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.944972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.945393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.945770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.946117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.946347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 04:38:06.947098 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 04:38:06.947318 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.947318 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.947688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 04:38:06.947873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.948056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 04:38:06.948235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.948396 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 04:38:06.948559 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.948711 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.948896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.949057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.949201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.949367 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.949513 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.949707 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.949860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.950027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.950211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.950376 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.950532 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.950682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.950835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.950985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.951146 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.951290 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.951443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.951592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.951786 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.951943 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.952122 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.952282 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-5-iscsi {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.952432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.952592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.952746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.952973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.953133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.953317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.953473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.953643 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.953798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.953954 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.954131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.955610 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.955775 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.955929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.956074 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.956074 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.956372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.956544 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.956696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.956845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.957009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.957162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.957317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.957461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.957461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.957792 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.957954 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.958104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.958248 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.958401 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.958546 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.958699 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.958856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.959012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.959167 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.959322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.959466 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.959616 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.959773 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.959923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-5-iscsi {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.960075 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.960224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.960379 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.960534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.960688 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.960849 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.961004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.961154 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.961308 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.961463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.961668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.961876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.962032 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.962176 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.962333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.962483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.962634 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.962785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.962949 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.963100 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.963256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.963406 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.963556 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.963708 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.963862 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.964016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.964246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.964604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.965071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.965232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.965384 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.965898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.966064 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.966736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.966910 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.967064 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.967208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.967361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.967505 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.967656 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.967818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.968540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.968710 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.968872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.969030 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.969182 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.969341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.969494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.969756 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.969910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.970092 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.970345 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.971001 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.971168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.971330 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.971486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.971643 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.971789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.971990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.972152 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.972317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.972472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.972616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.972765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.972917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.973074 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.973219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.973372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.973372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.973744 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.973905 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.974062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.974215 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.974369 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.974834 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.975310 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.975475 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.975631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.975880 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.976155 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.976155 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.976465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.976725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.976877 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.977027 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.977181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.977336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.977481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.977665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.977819 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.977964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.978113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.978266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.978436 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.978588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.978733 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.978875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.979027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.979171 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.979312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.979455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.979604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.979748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.979907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.980058 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.980208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.980369 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.980522 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.980665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.980823 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.980968 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.981118 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.981263 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.981405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.981615 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.981781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.981933 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.982129 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.982273 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.982438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.982597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.982748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.982993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.983165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.983312 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.983456 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.983609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.983765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.983765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.984054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.984054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.984341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.984341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.984652 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.984824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.985129 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.985589 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.987023 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.987287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.987441 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.987594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.987738 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.987890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.988044 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.988201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.988344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.988487 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.988631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.988781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.989477 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.989601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.989699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.989699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.989845 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.989928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.990015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.990089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.990167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.990252 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.990342 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.990432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.990515 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.990607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.990692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.990789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.990876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.990959 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.991059 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.991145 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.991145 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.991309 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.991400 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.991485 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.991576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.991669 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.991769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.991855 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.991855 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.992025 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.992112 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.992197 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.992293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.992389 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.992482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.992567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.992665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.992760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.992760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.992929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.993014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.993097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.993180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.993263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.993359 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.993453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.993562 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.993562 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.993721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.993877 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.993966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.994048 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.994127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.994200 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.994269 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.994345 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.994426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.994508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.994587 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.994659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.994729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.994798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.994882 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.994963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.995044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:38:06.995118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.995189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.995267 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.995352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.995436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.995509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.995586 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.995665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.995745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.995830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.995911 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.995983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.996053 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.996130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.996216 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.996289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.996359 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.996429 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.996506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.996585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.996671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.996744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.996814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.996891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.996970 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.997051 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.997131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.997203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.997274 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.997351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.997433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.997506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.997607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.997692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.997772 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.997856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.997935 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.998016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.998089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.998166 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.998236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.998313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.998386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.998470 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.998542 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.998622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.998707 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:06.998783 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.000353 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.000545 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.000701 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.000858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.001024 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.001187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.001433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.002149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.002306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.002470 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.002694 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.002849 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.003006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.003160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.003319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.003467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.003623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.003771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.003771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.004059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.004206 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.004360 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.004526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.004683 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.004841 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.004988 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.005141 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.005289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.005442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.005612 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.005778 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.005925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.006071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.006225 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.006379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.006547 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.006704 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.006851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.007004 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.007158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.007313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.007473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.007628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.007776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.007929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.008075 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.008221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.008375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.008544 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.008703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.008851 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.008996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.009141 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.009297 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.009452 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.009629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.009793 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.010641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.010815 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.010980 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.011150 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.011306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.011453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.011600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.011958 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.012116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.012270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.012425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.012571 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.012723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.012890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.012890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.013192 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.013356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.013515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.013746 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.013915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.014070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.014222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.014374 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.014527 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.014693 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.014847 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.015005 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.015160 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.015320 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.015491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.015653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.015815 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.015982 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.016146 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.016299 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.016459 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.016626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.016787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.017055 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.017299 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.017501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.017694 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.017876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.018031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.018184 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.018336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.018488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.018647 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.018814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.018969 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.019122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.019283 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.019447 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.019679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.019854 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.020017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.020856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.021038 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.021202 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.021368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.021523 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.021701 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.021866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.021866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.022165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.022328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.022482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.022645 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.022797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.022965 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.023119 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.023285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.023448 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.023601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.023753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.023905 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.024070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.024223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.024375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.024529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.024699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.024853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.025025 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.025179 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.025331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.025491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.025705 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.025870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.026040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.026203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.026356 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.026508 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.026508 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.026819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.026980 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.027134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.027294 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.027456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.027610 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.027775 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.027928 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.028087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.028239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.028392 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.028542 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.028709 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.028872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.029025 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.029184 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.029344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.029504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.029699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.029855 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.030007 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.030158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.030953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.031129 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.031298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.031463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.031626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.031779 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.031948 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.032111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.032265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.032417 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.032646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.032823 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.032982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.033144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.033326 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.033522 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.033810 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.033987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.034193 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.034444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.034712 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.034958 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.035243 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.035459 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.035664 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.035899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.036142 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.036390 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.036635 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.036817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.036972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.037142 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.037305 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.037457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.037657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.037824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.037993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.038161 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.038315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.038481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.038635 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.038787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.038965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.039118 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.039273 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.039425 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.039577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.039738 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.039738 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.040048 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.040048 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.040356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.041289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.041455 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.041649 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.041827 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.041982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.042134 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.042288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.042456 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.042611 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.042772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.042926 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.043078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.043238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.043402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.043564 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.043729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.043884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.044036 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.044036 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.044337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.044506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.044506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.044797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.044949 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.045110 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.045110 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.045759 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.045915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.046819 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.046982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.047286 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.047448 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.047612 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.047775 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.047944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.047944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.047944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.048996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.049254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.049530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.049732 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.049900 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.050055 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.050216 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.050370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.050537 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.051506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.051683 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.051850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.052058 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.052277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.052496 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.052715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.052931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.053140 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.053355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.053654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.053654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.053654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.053654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.054557 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.054770 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.054978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.057885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.058143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.058354 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.058620 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.058797 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.058955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.059124 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.059338 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.059537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.059757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.059958 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.060168 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.060370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.062546 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.062825 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.063018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.063190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.063353 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.063510 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.063665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.063922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.064602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.064769 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.064926 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.065088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.065427 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.065684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.065856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.066024 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.066198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.066452 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.066613 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.066777 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.066946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.067108 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.067270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.067424 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.067588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.067743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.067905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.068060 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.068233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.068403 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.068569 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.068733 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.068894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.069047 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.069208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.069208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.069576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.069743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.069897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.070050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.070214 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.070389 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.070552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.070708 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.070870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.071141 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.071684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.071929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.072097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.072252 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.072600 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.072777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.072933 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.072933 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.073271 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.073425 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.073598 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.073772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.073928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.074089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.074245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.074405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.074574 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.074736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.074892 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.075046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.075046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.075046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.075497 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.075497 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.075497 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.075944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.076097 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.076251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.076418 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.076573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.076735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.076898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.077066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.077238 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.077407 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.077582 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.077753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.077916 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.078087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.078251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.078413 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.078413 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.078705 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.078865 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.079020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.079186 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.079532 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.079844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.080002 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.080164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.080326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.080499 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.080653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.080815 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.080977 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.081169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.081779 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.082041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.082224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.082379 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.082560 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.082900 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.083070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.083234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.083390 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.083543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.083695 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.083847 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.084009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.084163 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.084318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.084491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.084653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.084814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.084982 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.085136 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.085298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.085502 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.085688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.085857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.086020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.086224 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.086381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.086543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.086709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.086917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.087075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.087278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.087440 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.087604 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.087767 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.087932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.088094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.088248 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.088402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.088564 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.088726 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.088900 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.089054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.089234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.089491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.089696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.089870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.089870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.090173 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.090328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.090480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.090633 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.090795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.090972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.091126 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.091279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.091722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.092065 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.092312 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.092472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.092636 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.093003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.093165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.093319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.093319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.093678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.093902 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.094066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.094219 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.094381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.094590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.094753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.094913 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.095693 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.095897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.096136 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.096294 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.096448 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.096601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.096767 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.096934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.097143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.097303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.097456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.097684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.097793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.097885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.097986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.098072 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.098153 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.098224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.098294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.098377 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.098475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.098563 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.098653 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.098746 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.098826 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.098910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.098984 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.099054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.099123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.099200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.099279 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.099364 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.099437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.099506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.099575 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.099651 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.099742 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.099824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.099918 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.100012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.100105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.100190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.100280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.100377 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.100471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.100562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.100648 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.100731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.100896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.100991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.101083 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.101175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.101261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.101343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.101440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.101525 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.101695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.101771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.101848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.101926 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102284 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102357 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102655 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.102983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.103054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.103054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.103189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.103271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.103356 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.103446 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.103535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.103630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.103723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.103817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.103910 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.103994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.104076 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.104166 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.104258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.104351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.104436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.104518 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.104607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.104691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.104784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.104875 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.104959 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.105050 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.105142 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.105236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.105317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.105401 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.105491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.105592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.105695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.105790 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.105889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.105982 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.106075 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.106159 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.106249 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.106335 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.106431 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.106516 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.106599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.106681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.106681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.106845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.106845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.106999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.107082 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.107164 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.107254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.107347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.107432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.107513 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.107605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.107697 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.107782 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.107874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.107958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.108041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.108124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.108124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.108273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.108365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.108450 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.108532 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.108622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.108707 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.108802 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.108888 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.108978 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.109070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.109163 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.109255 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.109349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.109435 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.109517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.109631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.109727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.109821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.109915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.110000 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.110090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.110182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.110274 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.110366 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.110461 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.110554 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.110691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.110781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.111856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.112031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.112137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.112234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.112327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.112457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.112581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.112683 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.112778 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.112864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.112948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.113031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.113123 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.113197 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.113275 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.113355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.113434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.113528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.113646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.113797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.113797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.113978 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.113978 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.114215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.114215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.114371 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.114463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.114548 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.114644 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.114738 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.114831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.114916 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.114999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.115089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.115182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.115280 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.115367 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.115457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.115543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.115634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.115730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.115803 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.115886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.115976 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.116061 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.116151 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.116249 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.116334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.116417 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.116500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.116500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.116833 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.116948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.117045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.117127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.117208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.117278 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.117370 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.117450 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.117529 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.117868 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.118184 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.118279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.118363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.118490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.118585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.118670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.118786 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.118929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.119078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.119200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.119293 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.119365 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.119594 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.119703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.119791 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.119878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.119949 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.120026 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.120110 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.120202 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.120312 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.120394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.120486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.120569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.120569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.120946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.121046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.121140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.121226 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.121309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.121392 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.121490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.121607 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.121683 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.121754 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.121838 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.121918 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.122003 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.122082 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.122161 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.122239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.122317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.122401 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.122496 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.122577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.122658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.122737 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.122737 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.122873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.122944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.123013 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.123091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.123163 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.123240 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.123321 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.123400 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.123472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.123551 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.123631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.123709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.123790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.123861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.123938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.124015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.124086 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.124415 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.124494 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.124564 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.124641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.124641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.124641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.124641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.124908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.124908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.125043 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.125121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.125199 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.125283 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.125358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.127249 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.127420 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.127576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.127741 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.127907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.128005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.128091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.128183 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.128278 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.128375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.128375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.128541 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.128628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.128718 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.128812 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.128906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.128992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.129074 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.129157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.129240 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.129332 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.129426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.129519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.129622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.129708 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.129787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.129886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.129971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.130055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.130255 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.130623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.130906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.131013 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.131132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.131261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.131468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.131578 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.131844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.131958 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.132166 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.132270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.132481 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.132591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.132800 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.132925 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.133114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.133249 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.133429 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.133737 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.133908 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.134041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.134169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.134319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.134460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.134647 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.134790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.134979 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.135112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.135308 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.135449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.135618 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.135756 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.135968 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.136128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.136295 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.136452 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.136667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.136802 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.136920 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.137140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.137460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.137627 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.137821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.137954 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.138142 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.138275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.138462 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.138604 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.138783 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.138918 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.139103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.139241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.139418 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.139558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.139730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.139861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.140039 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.140179 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.140349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.140494 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.140658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.140796 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.140966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.141099 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.141290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.141432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.141624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.141758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.141951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.142131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.142306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.142564 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.142988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.143139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.143318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.143460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.143644 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.143778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.143970 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.144111 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.144336 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.144472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.144659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.144792 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.144979 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.145114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.145301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.145443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.145633 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.145778 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.145944 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.146077 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.146260 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.146406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.146570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.146700 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.146878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.147012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.147187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.147333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.147499 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.147630 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.147807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.147939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.148103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.148249 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.148429 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.148601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.148783 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.148945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.149102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.149259 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.149442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.149617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.149785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.149917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.150122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.150280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.150466 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.150639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.150639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.150976 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.151164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.151307 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.151440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.151576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.151706 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.151844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.151982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.152121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.152259 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.152397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.152511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.152693 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.152786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.153037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.153152 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.153305 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.153397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.153633 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.153751 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.153948 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.154076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.154257 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.154388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.154567 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.154731 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.154892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.155069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.155200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.155339 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.155477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.155642 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.155801 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.155928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.156113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.156247 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.156470 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.156660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.156831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.157037 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.157170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.157331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.158260 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.158393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.158604 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.158928 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.159046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.159270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.159395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.159607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.159734 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.159920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.160047 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.160232 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.160350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.160543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.160661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.160870 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.161183 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.161496 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.161642 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.161838 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.161955 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.162218 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.162362 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.162637 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.162774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.162894 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.163005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.163147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.163366 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.163489 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.163599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.163760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.163882 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.164044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.164207 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.164370 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.164521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.164686 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.164826 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.164983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.165165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.165332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.165464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.165679 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.165811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.165938 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.166067 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.166223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.166352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.166480 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.166607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.166791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.166925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.167128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.167266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.167402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.167615 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.167747 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.167875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.168051 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.168217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.168379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.168565 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.168714 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.168866 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.169043 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.169201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.169420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.169605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.169804 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.169963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.170107 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.170548 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.170712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.170863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.171015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.171159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.171310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.171453 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.171610 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.171765 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.171907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.172049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.172190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.172333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.172503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.172719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.172892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.173045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.173045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.174165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.174353 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.174353 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.174658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.174807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.174952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.175104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.175248 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.175422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.175580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.175762 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.175912 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.176069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.176215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.176364 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.176536 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.176719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.176915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.177082 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.177276 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.177424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.177591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.177741 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.177896 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.178041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.178191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.178373 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.178552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.178740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.178935 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.179150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.179356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.179534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.179716 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.179863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.180075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.180224 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.180405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.180625 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.180833 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.181053 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.181224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.181415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.181755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.181918 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.182138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.182352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.182505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.182693 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.182872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.183030 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.183213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.183373 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.183585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.183751 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.183897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.184039 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.184212 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.184371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.184522 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.184665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.184808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.184951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.185101 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.185244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.185397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.185565 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.185715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.185858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.186012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.186156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.186298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.186449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.186599 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.186741 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.186892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.187046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.187190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.187392 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.187548 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.187700 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.187843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.187999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.188171 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.188329 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.188535 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.188719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.188907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.189057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.189216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.189381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.189531 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.189735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.189888 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.190045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.190196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.190352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.190352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.190654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.190804 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.190960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.191117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.191284 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.191447 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.191597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.191745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.191893 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.192041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.192198 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.192358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.192514 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.192665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.192822 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.192974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.193132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.193293 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.193442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.193611 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.193765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.193924 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.194087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.194244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.194395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.194550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.194707 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.194858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.195015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.195015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.195317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.195475 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.195623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.195771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.195928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.196086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.196235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.196391 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.196541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.196703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.196862 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.197012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.197177 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.197341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.197535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.197773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.197931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.198080 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.198228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.198383 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.198533 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.198769 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.198929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.199086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.199235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.199395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.199597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.199844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.199999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 04:38:07.200157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.200157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.200157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.200157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.200157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.200858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.200858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.201148 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.201308 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.201505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.201842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.202180 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.202494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.202807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.203121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.203432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.203744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.204054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.204417 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.205036 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.205825 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.206178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.206511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.206854 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.207181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.207499 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.207837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.208159 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.208480 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.208797 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.209116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.209433 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.209780 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.210097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.210513 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.210732 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.211078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.211394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.211728 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.212042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.212401 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.212736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.213099 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.213416 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.213818 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.214149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.214468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.214828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.215246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:38:07.215425 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 04:38:07.355814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO dbcounter [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] Registered counter for database nova_api Aug 04 04:38:07.377223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO dbcounter [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] Registered counter for database nova_api Aug 04 04:38:07.378091 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_db.sqlalchemy.engines [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:38:07.385393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writer thread running {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:38:07.398167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_db.sqlalchemy.engines [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:38:07.405016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writer thread running {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:38:07.445054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.context [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc17ecad-4eac-4f3a-b656-dcc6b9ec830f(cell1) {{(pid=134883) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 04:38:07.449373 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:07.451028 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:07.451862 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:07.453938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:07.456559 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO dbcounter [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] Registered counter for database nova_cell0 Aug 04 04:38:07.460740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO dbcounter [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] Registered counter for database nova_cell1 Aug 04 04:38:07.466491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.context [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dc17ecad-4eac-4f3a-b656-dcc6b9ec830f(cell1) {{(pid=134884) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 04:38:07.468646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_db.sqlalchemy.engines [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:38:07.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_db.sqlalchemy.engines [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:38:07.471826 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:07.473444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:07.474294 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:07.476351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:07.477715 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writer thread running {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:38:07.478467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO dbcounter [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] Registered counter for database nova_cell0 Aug 04 04:38:07.482731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO dbcounter [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] Registered counter for database nova_cell1 Aug 04 04:38:07.491055 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_db.sqlalchemy.engines [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:38:07.493400 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_db.sqlalchemy.engines [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:38:07.498030 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writer thread running {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:38:07.504303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writer thread running {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:38:07.619120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writer thread running {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:38:07.629573 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO dbcounter [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] Registered counter for database nova_cell0 Aug 04 04:38:07.636394 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_db.sqlalchemy.engines [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:38:07.641113 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writer thread running {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:38:07.655559 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO dbcounter [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] Registered counter for database nova_cell0 Aug 04 04:38:07.663828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_db.sqlalchemy.engines [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:38:07.668477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writer thread running {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:38:07.964930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: WARNING keystonemiddleware.auth_token [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:38:07.972831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: WARNING keystonemiddleware.auth_token [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:38:08.003526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: WARNING keystonemiddleware.auth_token [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:38:08.011089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: WARNING keystonemiddleware.auth_token [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:38:08.351358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: WARNING keystonemiddleware.auth_token [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:38:08.357480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: WARNING keystonemiddleware.auth_token [None req-12438b3d-3fd2-4614-a387-3d484f1fffe4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:38:08.362439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: WARNING keystonemiddleware.auth_token [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 04:38:08.364381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1f0d029c0 pid: 134883 (default app) Aug 04 04:38:08.368608 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: WARNING keystonemiddleware.auth_token [None req-075e7db8-5cba-4b51-b14d-7ba28b5f1e09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 04:38:08.375302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1f0d029c0 pid: 134884 (default app) Aug 04 04:38:43.998990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=3 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:44.001774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=3 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:44.002548 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=3 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:44.003327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=3 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:44.943129 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=3 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:44.944699 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=3 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:44.945596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=3 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:44.946775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=3 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:45.705628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b747093b-22d3-4450-bef8-48fbbcebce26 tempest-VolumesGetTestJSON-1706024978 tempest-VolumesGetTestJSON-1706024978-project] Action: 'create', calling method: .version_select at 0x7fc9441c5d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1027082977", "metadata": {"Type": "work"}}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:47.149096 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3833381d-eeb6-4050-83c5-5637a44f7d93 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Action: 'create', calling method: .version_select at 0x7fc9441b5d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1064484048"}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:48.318137 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b747093b-22d3-4450-bef8-48fbbcebce26 tempest-VolumesGetTestJSON-1706024978 tempest-VolumesGetTestJSON-1706024978-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.332357 Aug 04 04:38:48.318773 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1156 bytes} [Thu Aug 4 04:38:43 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4335 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 04:38:48.334440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b0d932f7-27ee-4b65-8e26-e2d6bb307cea tempest-VolumesGetTestJSON-1706024978 tempest-VolumesGetTestJSON-1706024978-project] Calling method '.version_select at 0x7fc94401cb80>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:48.749298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b0d932f7-27ee-4b65-8e26-e2d6bb307cea tempest-VolumesGetTestJSON-1706024978 tempest-VolumesGetTestJSON-1706024978-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/615ecd60-15d2-44aa-b475-bd0d767b64a0" status: 200 len: 354 microversion: 2.1 time: 0.420012 Aug 04 04:38:48.750203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 2/2] 10.222.0.47 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:48 2022] GET /compute/v2.1/os-volumes/615ecd60-15d2-44aa-b475-bd0d767b64a0 => generated 354 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:48.762453 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-01ed393b-8fe0-48b7-91a4-434d174eca4f tempest-VolumesGetTestJSON-1706024978 tempest-VolumesGetTestJSON-1706024978-project] Calling method '.version_select at 0x7fc944035280>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:48.917114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3833381d-eeb6-4050-83c5-5637a44f7d93 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.986845 Aug 04 04:38:48.929140 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1155 bytes} [Thu Aug 4 04:38:44 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3992 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 04:38:48.937994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8863d23a-dabd-45f3-a52c-36329fa6d0d2 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc94401eb80>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:49.010516 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-01ed393b-8fe0-48b7-91a4-434d174eca4f tempest-VolumesGetTestJSON-1706024978 tempest-VolumesGetTestJSON-1706024978-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/615ecd60-15d2-44aa-b475-bd0d767b64a0" status: 200 len: 354 microversion: 2.1 time: 0.251729 Aug 04 04:38:49.022166 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 3/4] 10.222.0.47 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:48 2022] GET /compute/v2.1/os-volumes/615ecd60-15d2-44aa-b475-bd0d767b64a0 => generated 354 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:38:49.034173 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ec6191c3-ea12-47cc-8179-92a566d3b2c5 tempest-VolumesGetTestJSON-1706024978 tempest-VolumesGetTestJSON-1706024978-project] Calling method '.version_select at 0x7fc944035940>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:49.097122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8863d23a-dabd-45f3-a52c-36329fa6d0d2 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f" status: 200 len: 345 microversion: 2.1 time: 0.166058 Aug 04 04:38:49.177216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 2/5] 10.222.0.47 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:48 2022] GET /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f => generated 345 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:49.196435 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d5e8e2ea-d669-4b0b-9833-469a80834bed tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] Calling method '.version_select at 0x7fc944035310>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:49.545766 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d5e8e2ea-d669-4b0b-9833-469a80834bed tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ee8495bf-16b0-438f-bcdd-9870c3abacda" status: 200 len: 351 microversion: 2.1 time: 0.367226 Aug 04 04:38:49.547070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 3/6] 10.222.0.47 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:49 2022] GET /compute/v2.1/os-volumes/ee8495bf-16b0-438f-bcdd-9870c3abacda => generated 351 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:49.568531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ec6191c3-ea12-47cc-8179-92a566d3b2c5 tempest-VolumesGetTestJSON-1706024978 tempest-VolumesGetTestJSON-1706024978-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/615ecd60-15d2-44aa-b475-bd0d767b64a0" status: 202 len: 0 microversion: 2.1 time: 0.538451 Aug 04 04:38:49.569469 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1248 bytes} [Thu Aug 4 04:38:49 2022] DELETE /compute/v2.1/os-volumes/615ecd60-15d2-44aa-b475-bd0d767b64a0 => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:38:49.583660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0b892cbd-b305-4153-96cb-69ac8e2a697e tempest-VolumesGetTestJSON-1706024978 tempest-VolumesGetTestJSON-1706024978-project] Calling method '.version_select at 0x7fc944035a60>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:49.939672 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-0b892cbd-b305-4153-96cb-69ac8e2a697e tempest-VolumesGetTestJSON-1706024978 tempest-VolumesGetTestJSON-1706024978-project] HTTP exception thrown: Volume 615ecd60-15d2-44aa-b475-bd0d767b64a0 could not be found. Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0b892cbd-b305-4153-96cb-69ac8e2a697e tempest-VolumesGetTestJSON-1706024978 tempest-VolumesGetTestJSON-1706024978-project] Request method failure captured: Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/os-volumes/615ecd60-15d2-44aa-b475-bd0d767b64a0 HTTP/1.1 Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601T8gTXv94Ksei57iiLv834FfAMacyRB8Kbu4kw69tNg_hWJdMB9j1dLeV4b0IanW3P19LrUAjgGFDRjmxPe2MuQ2J6_UFpMvmMS73x6IENf2mwh1xYPyj8zcPuYDaPKpJE8-OuCu4HmOKXUrm5vgPF-2w6ZjUEGIJmvpbCVwDDCPc Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 26ffb724e028422eb6f69be51973fe9b Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-VolumesGetTestJSON-1706024978 Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:38:49.947236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:38:49.948934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/26ffb724e028422eb6f69be51973fe9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/26ffb724e028422eb6f69be51973fe9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_26ffb724e028422eb6f69be51973fe9b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/26ffb724e028422eb6f69be51973fe9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:38:49.948934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-VolumesGetTestJSON-1706024978 Aug 04 04:38:49.948934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 26ffb724e028422eb6f69be51973fe9b Aug 04 04:38:49.948934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-VolumesGetTestJSON-1706024978 Aug 04 04:38:49.948934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-VolumesGetTestJSON-1706024978-project Aug 04 04:38:49.948934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:38:49.948934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:38:49.948934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 85b8ce0f906e4f1796ca66fb4b98fc2b Aug 04 04:38:49.948934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-VolumesGetTestJSON-1706024978-project Aug 04 04:38:49.948934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: Aug 04 04:38:49.948934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Volume 615ecd60-15d2-44aa-b475-bd0d767b64a0 could not be found. Aug 04 04:38:49.948934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '615ecd60-15d2-44aa-b475-bd0d767b64a0'} Aug 04 04:38:49.948934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 615ecd60-15d2-44aa-b475-bd0d767b64a0 could not be found. (HTTP 404) (Request-ID: req-2afca501-814b-4020-840c-62732fb73332) Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:49.949923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:49.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 615ecd60-15d2-44aa-b475-bd0d767b64a0 could not be found. Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 04:38:49.952555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:49.955969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 615ecd60-15d2-44aa-b475-bd0d767b64a0 could not be found. Aug 04 04:38:49.955969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:49.955969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:49.955969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:49.955969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:49.955969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:49.955969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:49.955969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:49.955969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:49.955969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 615ecd60-15d2-44aa-b475-bd0d767b64a0 could not be found. Aug 04 04:38:49.955969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:49.955969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0b892cbd-b305-4153-96cb-69ac8e2a697e tempest-VolumesGetTestJSON-1706024978 tempest-VolumesGetTestJSON-1706024978-project] Returning 404 to user: Volume 615ecd60-15d2-44aa-b475-bd0d767b64a0 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:49.955969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0b892cbd-b305-4153-96cb-69ac8e2a697e tempest-VolumesGetTestJSON-1706024978 tempest-VolumesGetTestJSON-1706024978-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/615ecd60-15d2-44aa-b475-bd0d767b64a0" status: 404 len: 109 microversion: 2.1 time: 0.375043 Aug 04 04:38:49.958046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:49 2022] GET /compute/v2.1/os-volumes/615ecd60-15d2-44aa-b475-bd0d767b64a0 => generated 109 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:50.112871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-266e2be7-1c43-4978-8e22-89f4540e9b21 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc94401cdc0>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:50.310357 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-266e2be7-1c43-4978-8e22-89f4540e9b21 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f" status: 200 len: 346 microversion: 2.1 time: 0.201475 Aug 04 04:38:50.318544 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 5/9] 10.222.0.47 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:50 2022] GET /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f => generated 346 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:50.324228 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c3d8f179-45a0-42d7-b954-91d961cb3335 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Action: 'create', calling method: .version_select at 0x7fc943f9c430>, body: {"snapshot": {"volume_id": "eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-300617088"}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:51.004430 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c3d8f179-45a0-42d7-b954-91d961cb3335 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.683970 Aug 04 04:38:51.006748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 5/10] 10.222.0.47 () {60 vars in 1162 bytes} [Thu Aug 4 04:38:50 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:38:51.019094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cbd3d93b-2529-4676-a341-d5fa55ea9032 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc944035af0>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:51.261787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cbd3d93b-2529-4676-a341-d5fa55ea9032 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86" status: 200 len: 286 microversion: 2.1 time: 0.248133 Aug 04 04:38:51.262713 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 6/11] 10.222.0.47 () {58 vars in 1251 bytes} [Thu Aug 4 04:38:51 2022] GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86 => generated 286 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:51.273464 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b67a41a6-9dd5-4e62-8945-9bd78d856779 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc943f9ca60>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:51.347540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b67a41a6-9dd5-4e62-8945-9bd78d856779 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.077728 Aug 04 04:38:51.348111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1140 bytes} [Thu Aug 4 04:38:51 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:51.359313 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b33eb49d-b5c7-4b9a-8a6f-9169a4d782dd tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc944035280>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:51.428151 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b33eb49d-b5c7-4b9a-8a6f-9169a4d782dd tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86" status: 200 len: 286 microversion: 2.1 time: 0.072649 Aug 04 04:38:51.428964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1251 bytes} [Thu Aug 4 04:38:51 2022] GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:51.590308 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bc891d92-e685-4ddb-b4c5-064e3a76e315 tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] Calling method '.version_select at 0x7fc943f9f040>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:51.774883 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bc891d92-e685-4ddb-b4c5-064e3a76e315 tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/c23f1194-f6de-42a1-984c-d53af1cf4d91" status: 200 len: 350 microversion: 2.1 time: 0.188760 Aug 04 04:38:51.775468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 7/14] 10.222.0.47 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:51 2022] GET /compute/v2.1/os-volumes/c23f1194-f6de-42a1-984c-d53af1cf4d91 => generated 350 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:52.440711 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a92b2e74-b71f-45b5-a96f-98c68188d2bf tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc944035040>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:52.626239 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a92b2e74-b71f-45b5-a96f-98c68188d2bf tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86" status: 200 len: 286 microversion: 2.1 time: 0.189137 Aug 04 04:38:52.626956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 8/15] 10.222.0.47 () {58 vars in 1251 bytes} [Thu Aug 4 04:38:52 2022] GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86 => generated 286 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:53.641875 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a5f3bc2c-3563-4edd-8c7d-5bf8c2227f78 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc943f9f790>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:53.701390 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a5f3bc2c-3563-4edd-8c7d-5bf8c2227f78 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86" status: 200 len: 286 microversion: 2.1 time: 0.065489 Aug 04 04:38:53.703349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1251 bytes} [Thu Aug 4 04:38:53 2022] GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:54.715925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8581d2ff-dec0-4812-9db7-ecd43f20ec1a tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc9440359d0>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:54.807441 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8581d2ff-dec0-4812-9db7-ecd43f20ec1a tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86" status: 200 len: 287 microversion: 2.1 time: 0.095790 Aug 04 04:38:54.808266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 9/17] 10.222.0.47 () {58 vars in 1251 bytes} [Thu Aug 4 04:38:54 2022] GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:54.821195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2fe1a978-b94f-4fa7-ab93-be0fd1a92711 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc944035f70>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:55.035744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2fe1a978-b94f-4fa7-ab93-be0fd1a92711 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86" status: 202 len: 0 microversion: 2.1 time: 0.219253 Aug 04 04:38:55.047246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 9/18] 10.222.0.47 () {58 vars in 1254 bytes} [Thu Aug 4 04:38:54 2022] DELETE /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:38:55.049932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-443d40e8-bef1-481f-8d10-b28c1829566b tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc94401caf0>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:55.062830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e3889502-252b-4d81-a16b-eafdb1ea5fde tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] Calling method '.version_select at 0x7fc943f9c790>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:55.151791 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-443d40e8-bef1-481f-8d10-b28c1829566b tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86" status: 200 len: 286 microversion: 2.1 time: 0.109469 Aug 04 04:38:55.157647 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 10/19] 10.222.0.47 () {58 vars in 1251 bytes} [Thu Aug 4 04:38:55 2022] GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86 => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:55.191598 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e3889502-252b-4d81-a16b-eafdb1ea5fde tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/f6390ddc-3b4f-45e0-9172-82e63444db19" status: 200 len: 350 microversion: 2.1 time: 0.137806 Aug 04 04:38:55.192171 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 10/20] 10.222.0.47 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:55 2022] GET /compute/v2.1/os-volumes/f6390ddc-3b4f-45e0-9172-82e63444db19 => generated 350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:55.210036 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c682dce0-cddb-4954-abd3-2e15f1b67ff7 tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] Calling method '.version_select at 0x7fc9440451f0>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:55.426947 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c682dce0-cddb-4954-abd3-2e15f1b67ff7 tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.225247 Aug 04 04:38:55.427504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 11/21] 10.222.0.47 () {58 vars in 1134 bytes} [Thu Aug 4 04:38:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:55.449503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-30d0a14c-9233-40e0-bc20-35afe6044fbd tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] Calling method '.version_select at 0x7fc943f9c940>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:55.703762 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-30d0a14c-9233-40e0-bc20-35afe6044fbd tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.257873 Aug 04 04:38:55.704333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 11/22] 10.222.0.47 () {58 vars in 1149 bytes} [Thu Aug 4 04:38:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:55.717684 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-edfb7039-ba2d-4a91-930e-ad6bf24a90cf tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] Calling method '.version_select at 0x7fc9440359d0>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:55.894152 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-edfb7039-ba2d-4a91-930e-ad6bf24a90cf tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.180265 Aug 04 04:38:55.894717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 12/23] 10.222.0.47 () {58 vars in 1134 bytes} [Thu Aug 4 04:38:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:55.910338 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2d220233-e1b6-4d7c-97ef-f8418dcf56d5 tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] Calling method '.version_select at 0x7fc943f9cd30>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:56.164875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bfc9f659-5c68-40b2-b85a-9c9c8fb640f3 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc944045d30>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:56.169421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2d220233-e1b6-4d7c-97ef-f8418dcf56d5 tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.262868 Aug 04 04:38:56.170276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 12/24] 10.222.0.47 () {58 vars in 1167 bytes} [Thu Aug 4 04:38:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:56.184598 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-021dbc25-6191-4b8c-8805-842ef8a6d0e6 tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] Calling method '.version_select at 0x7fc9441b5ee0>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:56.225456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-bfc9f659-5c68-40b2-b85a-9c9c8fb640f3 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] HTTP exception thrown: Snapshot 609061c7-1b4d-42ec-9ca7-5f836b0a3f86 could not be found. Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bfc9f659-5c68-40b2-b85a-9c9c8fb640f3 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Request method failure captured: Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86 HTTP/1.1 Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi601Um3MfxfhQ9c7Tk6V8697GDeR_JXqMrvrlKPr4Gp614O4eLOhAWRbHHDT4hYDADklLpw3Y56XhrD1I4nKh1huZTOBsUqY8BhpBSyHnbvOsEsU8m_BdYDPbCSVNcU6EYEL1ZXCx3vCWeWaV5eVPwzpIiYzyXj8Z65JApfH8mVEUVIs Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 3c72f723819849228c8763c36ded1d11 Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-210625183 Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 04:38:56.229195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 04:38:56.230585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3c72f723819849228c8763c36ded1d11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c72f723819849228c8763c36ded1d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3c72f723819849228c8763c36ded1d11", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c72f723819849228c8763c36ded1d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:38:56.230585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-VolumesSnapshotsTestJSON-210625183 Aug 04 04:38:56.230585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 3c72f723819849228c8763c36ded1d11 Aug 04 04:38:56.230585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-210625183 Aug 04 04:38:56.230585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-VolumesSnapshotsTestJSON-210625183-project Aug 04 04:38:56.230585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 04:38:56.230585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 04:38:56.230585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: fa8866699789473ca655509b6c3e6fe6 Aug 04 04:38:56.230585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-VolumesSnapshotsTestJSON-210625183-project Aug 04 04:38:56.230585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: Aug 04 04:38:56.230585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Snapshot 609061c7-1b4d-42ec-9ca7-5f836b0a3f86 could not be found. Aug 04 04:38:56.230585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': '609061c7-1b4d-42ec-9ca7-5f836b0a3f86'} Aug 04 04:38:56.230585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 609061c7-1b4d-42ec-9ca7-5f836b0a3f86 could not be found. (HTTP 404) (Request-ID: req-44c30d70-25e3-4846-a82f-b5f82176dca0) Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:38:56.231336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:56.232206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 609061c7-1b4d-42ec-9ca7-5f836b0a3f86 could not be found. Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 04:38:56.234162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:56.236307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 609061c7-1b4d-42ec-9ca7-5f836b0a3f86 could not be found. Aug 04 04:38:56.236307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:38:56.236307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:56.236307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:38:56.236307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:56.236307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:56.236307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:56.236307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:56.236307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:56.236307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 609061c7-1b4d-42ec-9ca7-5f836b0a3f86 could not be found. Aug 04 04:38:56.236307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:38:56.241382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bfc9f659-5c68-40b2-b85a-9c9c8fb640f3 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Returning 404 to user: Snapshot 609061c7-1b4d-42ec-9ca7-5f836b0a3f86 could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:56.242417 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-bfc9f659-5c68-40b2-b85a-9c9c8fb640f3 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86" status: 404 len: 111 microversion: 2.1 time: 0.081929 Aug 04 04:38:56.242984 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 13/25] 10.222.0.47 () {58 vars in 1251 bytes} [Thu Aug 4 04:38:56 2022] GET /compute/v2.1/os-snapshots/609061c7-1b4d-42ec-9ca7-5f836b0a3f86 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:38:56.545702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-021dbc25-6191-4b8c-8805-842ef8a6d0e6 tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.365125 Aug 04 04:38:56.546526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 13/26] 10.222.0.47 () {58 vars in 1170 bytes} [Thu Aug 4 04:38:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:38:56.561071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6ea8ca92-7667-49e8-b422-23f198931c40 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc943fab0d0>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:56.730310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6ea8ca92-7667-49e8-b422-23f198931c40 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f" status: 202 len: 0 microversion: 2.1 time: 0.182268 Aug 04 04:38:56.731272 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 14/27] 10.222.0.47 () {58 vars in 1248 bytes} [Thu Aug 4 04:38:56 2022] DELETE /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:38:56.738833 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-463a456b-6db3-48c0-8979-519efe930d5b tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] Calling method '.version_select at 0x7fc944033c10>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:56.936066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-43029037", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "networks": [{"uuid": "3d65ecb2-5ee0-42fb-a6f1-34cc031fe1e3"}]}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:38:57.040676 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-463a456b-6db3-48c0-8979-519efe930d5b tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.307843 Aug 04 04:38:57.041165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 15/28] 10.222.0.47 () {58 vars in 1155 bytes} [Thu Aug 4 04:38:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:57.046729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7aa061a3-0ba1-4f09-a4bc-8d2ddef194bb tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc943f9c430>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:57.118935 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-7aa061a3-0ba1-4f09-a4bc-8d2ddef194bb tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] HTTP exception thrown: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7aa061a3-0ba1-4f09-a4bc-8d2ddef194bb tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Request method failure captured: Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f HTTP/1.1 Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601Um3MfxfhQ9c7Tk6V8697GDeR_JXqMrvrlKPr4Gp614O4eLOhAWRbHHDT4hYDADklLpw3Y56XhrD1I4nKh1huZTOBsUqY8BhpBSyHnbvOsEsU8m_BdYDPbCSVNcU6EYEL1ZXCx3vCWeWaV5eVPwzpIiYzyXj8Z65JApfH8mVEUVIs Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 3c72f723819849228c8763c36ded1d11 Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-210625183 Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:38:57.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:38:57.123147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3c72f723819849228c8763c36ded1d11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c72f723819849228c8763c36ded1d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3c72f723819849228c8763c36ded1d11", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c72f723819849228c8763c36ded1d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:38:57.123147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-VolumesSnapshotsTestJSON-210625183 Aug 04 04:38:57.123147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 3c72f723819849228c8763c36ded1d11 Aug 04 04:38:57.123147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-210625183 Aug 04 04:38:57.123147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-VolumesSnapshotsTestJSON-210625183-project Aug 04 04:38:57.123147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:38:57.123147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:38:57.123147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: fa8866699789473ca655509b6c3e6fe6 Aug 04 04:38:57.123147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-VolumesSnapshotsTestJSON-210625183-project Aug 04 04:38:57.123147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: Aug 04 04:38:57.123147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.123147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f'} Aug 04 04:38:57.123147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. (HTTP 404) (Request-ID: req-c803f6f2-4f92-4205-af9c-6dfe7d3e135a) Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:57.123844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:57.124768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 04:38:57.126569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:57.128127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.128127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.128127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:57.128127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.128127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:57.128127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:57.128127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:57.128127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:57.128127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:57.128127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.128127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.128127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7aa061a3-0ba1-4f09-a4bc-8d2ddef194bb tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Returning 404 to user: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:57.128127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7aa061a3-0ba1-4f09-a4bc-8d2ddef194bb tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f" status: 404 len: 109 microversion: 2.1 time: 0.080801 Aug 04 04:38:57.131214 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 16/29] 10.222.0.47 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:57 2022] GET /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:57.137887 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0b998b0a-2338-430f-9f20-1dc93093353b tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] Calling method '.version_select at 0x7fc944035160>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:57.193727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] validate_networks() for [('3d65ecb2-5ee0-42fb-a6f1-34cc031fe1e3', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:38:57.382573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0b998b0a-2338-430f-9f20-1dc93093353b tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.250046 Aug 04 04:38:57.383358 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 17/30] 10.222.0.47 () {58 vars in 1188 bytes} [Thu Aug 4 04:38:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:38:57.392924 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f2d055a8-10d5-4054-9a8d-35cc3062ac26 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc943f9c310>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:57.463068 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-f2d055a8-10d5-4054-9a8d-35cc3062ac26 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] HTTP exception thrown: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f2d055a8-10d5-4054-9a8d-35cc3062ac26 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Request method failure captured: Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: DELETE /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f HTTP/1.1 Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601Um3MfxfhQ9c7Tk6V8697GDeR_JXqMrvrlKPr4Gp614O4eLOhAWRbHHDT4hYDADklLpw3Y56XhrD1I4nKh1huZTOBsUqY8BhpBSyHnbvOsEsU8m_BdYDPbCSVNcU6EYEL1ZXCx3vCWeWaV5eVPwzpIiYzyXj8Z65JApfH8mVEUVIs Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 3c72f723819849228c8763c36ded1d11 Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-210625183 Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:38:57.466710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:38:57.468040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3c72f723819849228c8763c36ded1d11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c72f723819849228c8763c36ded1d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3c72f723819849228c8763c36ded1d11", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c72f723819849228c8763c36ded1d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:38:57.468040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-VolumesSnapshotsTestJSON-210625183 Aug 04 04:38:57.468040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 3c72f723819849228c8763c36ded1d11 Aug 04 04:38:57.468040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-210625183 Aug 04 04:38:57.468040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-VolumesSnapshotsTestJSON-210625183-project Aug 04 04:38:57.468040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:38:57.468040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:38:57.468040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: fa8866699789473ca655509b6c3e6fe6 Aug 04 04:38:57.468040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-VolumesSnapshotsTestJSON-210625183-project Aug 04 04:38:57.468040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: Aug 04 04:38:57.468040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.468040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f'} Aug 04 04:38:57.468040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. (HTTP 404) (Request-ID: req-c9b11bd7-e819-484b-9adc-ded309f24602) Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:57.468789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 04:38:57.470007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 04:38:57.471147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:57.472891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.472891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.472891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:57.472891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.472891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:57.472891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:57.472891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:57.472891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:57.472891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:57.472891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.472891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.474810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f2d055a8-10d5-4054-9a8d-35cc3062ac26 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Returning 404 to user: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:57.476465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f2d055a8-10d5-4054-9a8d-35cc3062ac26 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f" status: 404 len: 109 microversion: 2.1 time: 0.091844 Aug 04 04:38:57.477027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 18/31] 10.222.0.47 () {58 vars in 1248 bytes} [Thu Aug 4 04:38:57 2022] DELETE /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:57.482337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f6c953e5-3f1c-4173-94e3-bb0987fc8da2 tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] Calling method '.version_select at 0x7fc943f9cd30>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:57.617031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f6c953e5-3f1c-4173-94e3-bb0987fc8da2 tempest-VolumesTestJSON-2131683869 tempest-VolumesTestJSON-2131683869-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.138678 Aug 04 04:38:57.618670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 19/32] 10.222.0.47 () {58 vars in 1155 bytes} [Thu Aug 4 04:38:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:38:57.623817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2392a244-04d0-4007-86ea-5cabe9cfbc95 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Calling method '.version_select at 0x7fc944035700>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:57.768499 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-2392a244-04d0-4007-86ea-5cabe9cfbc95 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] HTTP exception thrown: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2392a244-04d0-4007-86ea-5cabe9cfbc95 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Request method failure captured: Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f HTTP/1.1 Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601Um3MfxfhQ9c7Tk6V8697GDeR_JXqMrvrlKPr4Gp614O4eLOhAWRbHHDT4hYDADklLpw3Y56XhrD1I4nKh1huZTOBsUqY8BhpBSyHnbvOsEsU8m_BdYDPbCSVNcU6EYEL1ZXCx3vCWeWaV5eVPwzpIiYzyXj8Z65JApfH8mVEUVIs Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 3c72f723819849228c8763c36ded1d11 Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-210625183 Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:38:57.770922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:38:57.771967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3c72f723819849228c8763c36ded1d11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c72f723819849228c8763c36ded1d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3c72f723819849228c8763c36ded1d11", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3c72f723819849228c8763c36ded1d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:38:57.771967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-VolumesSnapshotsTestJSON-210625183 Aug 04 04:38:57.771967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 3c72f723819849228c8763c36ded1d11 Aug 04 04:38:57.771967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-210625183 Aug 04 04:38:57.771967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-VolumesSnapshotsTestJSON-210625183-project Aug 04 04:38:57.771967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:38:57.771967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:38:57.771967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: fa8866699789473ca655509b6c3e6fe6 Aug 04 04:38:57.771967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-VolumesSnapshotsTestJSON-210625183-project Aug 04 04:38:57.771967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: Aug 04 04:38:57.771967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.771967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f'} Aug 04 04:38:57.771967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. (HTTP 404) (Request-ID: req-3c4e7888-8364-4a15-9454-c8a428f01069) Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:57.772568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 04:38:57.773434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 04:38:57.774961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:38:57.775897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.775897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.775897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:38:57.775897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.775897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:38:57.775897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:38:57.775897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:38:57.775897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:38:57.775897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:38:57.775897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. Aug 04 04:38:57.775897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:38:57.777891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2392a244-04d0-4007-86ea-5cabe9cfbc95 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] Returning 404 to user: Volume eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:38:57.779323 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2392a244-04d0-4007-86ea-5cabe9cfbc95 tempest-VolumesSnapshotsTestJSON-210625183 tempest-VolumesSnapshotsTestJSON-210625183-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f" status: 404 len: 109 microversion: 2.1 time: 0.159290 Aug 04 04:38:57.780279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 20/33] 10.222.0.47 () {58 vars in 1245 bytes} [Thu Aug 4 04:38:57 2022] GET /compute/v2.1/os-volumes/eaf60b5b-ecf2-47cc-896b-49e5be8a7f3f => generated 109 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:38:59.335016 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:38:59.335601 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:38:59.337734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:38:59.337734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:38:59.337734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:38:59.417040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:59.422235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:59.424452 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:38:59.427258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:38:59.540333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Getting quotas for project a89819385e8b42bb89e40449dd21ca86. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:38:59.551599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Getting quotas for user 99d00c09d8374f59ac1260ade95be9ec and project a89819385e8b42bb89e40449dd21ca86. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:38:59.585235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:38:59.592262 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:38:59.752306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d42b0c78-975a-4419-88d7-1e0a38bdf0c7 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.495423 Aug 04 04:38:59.753608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 14/34] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:38:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:38:59.773218 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-55f7d0a8-2867-4697-abe2-661ab3325128 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:38:59.774557 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-55f7d0a8-2867-4697-abe2-661ab3325128 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:00.212078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-55f7d0a8-2867-4697-abe2-661ab3325128 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:00.240551 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-55f7d0a8-2867-4697-abe2-661ab3325128 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1213 microversion: 2.1 time: 0.477097 Aug 04 04:39:00.252659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 21/35] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:38:59 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1213 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:01.279110 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9aa7266a-cdcf-4ace-98e7-47151eaee77f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:01.281948 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9aa7266a-cdcf-4ace-98e7-47151eaee77f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:01.465212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9aa7266a-cdcf-4ace-98e7-47151eaee77f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:01.554216 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9aa7266a-cdcf-4ace-98e7-47151eaee77f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1213 microversion: 2.1 time: 0.278285 Aug 04 04:39:01.559370 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 15/36] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:01 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1213 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:02.584818 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-54af18fc-da44-46aa-bc66-4155af9f3d7f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:02.585511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-54af18fc-da44-46aa-bc66-4155af9f3d7f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:02.605281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-54af18fc-da44-46aa-bc66-4155af9f3d7f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:02.612441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-54af18fc-da44-46aa-bc66-4155af9f3d7f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:02.613562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-54af18fc-da44-46aa-bc66-4155af9f3d7f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:02.618110 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-54af18fc-da44-46aa-bc66-4155af9f3d7f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:03.638601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-54af18fc-da44-46aa-bc66-4155af9f3d7f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:03.664065 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-54af18fc-da44-46aa-bc66-4155af9f3d7f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1217 microversion: 2.1 time: 1.080796 Aug 04 04:39:03.665054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 22/37] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:02 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1217 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:04.446564 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-30fec912-c319-4ec3-9893-4bb804023ff0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Action: 'create', calling method: .version_select at 0x7fc9436d0940>, body: {"keypair": {"name": "tempest-keypair-1531736435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3FTGNgc4ZWN+vz5B15wNtUBCytSHLwoQKNFDcusv1+xHTlfBfp4oOWxc64DM/34E8nyRMe6vDucw5SOOmgsY5N+50/GFxPbjnzc1XZ91IgSC1rTETsZaN01pEn1Km57Q=="}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:04.532707 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-30fec912-c319-4ec3-9893-4bb804023ff0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for project 9124d19d48f44fe2a904a715e5db1223. Resources: {'key_pairs'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:04.543634 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-30fec912-c319-4ec3-9893-4bb804023ff0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for user 49a7ce9a27734dc0a187d1b217206785 and project 9124d19d48f44fe2a904a715e5db1223. Resources: {'key_pairs'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:04.645776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-30fec912-c319-4ec3-9893-4bb804023ff0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.849910 Aug 04 04:39:04.649146 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 16/38] 10.222.0.47 () {60 vars in 1159 bytes} [Thu Aug 4 04:39:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:04.692369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-54b42a9d-d775-4245-a46e-9f3c28cbf973 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:04.693102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-54b42a9d-d775-4245-a46e-9f3c28cbf973 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:04.736550 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-54b42a9d-d775-4245-a46e-9f3c28cbf973 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:04.743332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-54b42a9d-d775-4245-a46e-9f3c28cbf973 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:04.744227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-54b42a9d-d775-4245-a46e-9f3c28cbf973 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:04.744675 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-54b42a9d-d775-4245-a46e-9f3c28cbf973 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:05.236764 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-54b42a9d-d775-4245-a46e-9f3c28cbf973 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:05.247825 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-54b42a9d-d775-4245-a46e-9f3c28cbf973 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1271 microversion: 2.1 time: 0.560136 Aug 04 04:39:05.256084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 23/39] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:04 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1271 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:06.281213 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-99240d2e-0298-42cb-9675-eb619d7fe285 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:06.282451 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-99240d2e-0298-42cb-9675-eb619d7fe285 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:06.303325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99240d2e-0298-42cb-9675-eb619d7fe285 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:06.303789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99240d2e-0298-42cb-9675-eb619d7fe285 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:06.314692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99240d2e-0298-42cb-9675-eb619d7fe285 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:06.315460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99240d2e-0298-42cb-9675-eb619d7fe285 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:07.075357 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-99240d2e-0298-42cb-9675-eb619d7fe285 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:07.114157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-99240d2e-0298-42cb-9675-eb619d7fe285 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1271 microversion: 2.1 time: 0.840152 Aug 04 04:39:07.121687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 17/40] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:06 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1271 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:07.882739 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b445d27b-a532-4778-944f-831a21653b5c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Action: 'create', calling method: .version_select at 0x7fc943eebe50>, body: {"keypair": {"name": "tempest-keypair-249672397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHokc4x81uNgG+j2WqXW7H4VGxju5TXUDxnROhXZab/MlNTh13EqolQSiAid6Lo+viup5gS0Lpcbnl2CsIbFdvPAq4vsokccVI00DVEM4XsHblJXC48t2+/fHPOVwMb+lw=="}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:08.029079 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-b445d27b-a532-4778-944f-831a21653b5c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Getting quotas for project 157a41f0f76c41cb8dfff71a14138534. Resources: {'key_pairs'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:08.062719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-b445d27b-a532-4778-944f-831a21653b5c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Getting quotas for user 12f7b1c19d824ac7b8207bf001b79057 and project 157a41f0f76c41cb8dfff71a14138534. Resources: {'key_pairs'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:08.142849 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4b1b53c9-2526-4654-ae7b-ac00d04e86f3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:08.143956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4b1b53c9-2526-4654-ae7b-ac00d04e86f3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:08.166174 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4b1b53c9-2526-4654-ae7b-ac00d04e86f3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:08.168488 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4b1b53c9-2526-4654-ae7b-ac00d04e86f3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:08.172403 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4b1b53c9-2526-4654-ae7b-ac00d04e86f3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:08.180265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4b1b53c9-2526-4654-ae7b-ac00d04e86f3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:08.241227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b445d27b-a532-4778-944f-831a21653b5c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.822179 Aug 04 04:39:08.251477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 24/41] 10.222.0.47 () {60 vars in 1159 bytes} [Thu Aug 4 04:39:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:39:09.300034 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4b1b53c9-2526-4654-ae7b-ac00d04e86f3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:09.333026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4b1b53c9-2526-4654-ae7b-ac00d04e86f3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1271 microversion: 2.1 time: 1.194269 Aug 04 04:39:09.340455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 18/42] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:08 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1271 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:10.370596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a590d8f6-36f2-4dd1-b71b-a1f00b3fcb42 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:10.371347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a590d8f6-36f2-4dd1-b71b-a1f00b3fcb42 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:10.392454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a590d8f6-36f2-4dd1-b71b-a1f00b3fcb42 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:10.393052 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a590d8f6-36f2-4dd1-b71b-a1f00b3fcb42 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:10.398306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a590d8f6-36f2-4dd1-b71b-a1f00b3fcb42 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:10.398676 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a590d8f6-36f2-4dd1-b71b-a1f00b3fcb42 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:11.320579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a590d8f6-36f2-4dd1-b71b-a1f00b3fcb42 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:11.332944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a590d8f6-36f2-4dd1-b71b-a1f00b3fcb42 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1313 microversion: 2.1 time: 0.966198 Aug 04 04:39:11.336838 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 25/43] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:10 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1313 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:12.364136 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4e10d9c2-fa3c-4aa0-baa0-3949e4a335b3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:12.365682 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4e10d9c2-fa3c-4aa0-baa0-3949e4a335b3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:12.388856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:12.395332 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e10d9c2-fa3c-4aa0-baa0-3949e4a335b3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:12.396768 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e10d9c2-fa3c-4aa0-baa0-3949e4a335b3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:12.398874 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e10d9c2-fa3c-4aa0-baa0-3949e4a335b3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:12.421503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e10d9c2-fa3c-4aa0-baa0-3949e4a335b3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:12.962392 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4e10d9c2-fa3c-4aa0-baa0-3949e4a335b3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:12.975270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4e10d9c2-fa3c-4aa0-baa0-3949e4a335b3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1313 microversion: 2.1 time: 0.618729 Aug 04 04:39:12.978708 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 19/44] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:12 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1313 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:13.186408 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1462621431", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67ecd182-cac3-46ef-97d0-ee767463d615"}], "security_groups": [{"name": "tempest-securitygroup--1118077724"}], "key_name": "tempest-keypair-1531736435", "user_data": "}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:14.004024 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e7616051-b5b0-4180-949e-a86083ca61e0 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:14.005685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e7616051-b5b0-4180-949e-a86083ca61e0 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:14.020561 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e7616051-b5b0-4180-949e-a86083ca61e0 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:14.024170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e7616051-b5b0-4180-949e-a86083ca61e0 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:14.024170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e7616051-b5b0-4180-949e-a86083ca61e0 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:14.024170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e7616051-b5b0-4180-949e-a86083ca61e0 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:14.370751 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.network.neutron [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] validate_networks() for [('67ecd182-cac3-46ef-97d0-ee767463d615', None, None, None, None, None)] {{(pid=134884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:39:14.563228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=12 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:15.022294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e7616051-b5b0-4180-949e-a86083ca61e0 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:15.037637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e7616051-b5b0-4180-949e-a86083ca61e0 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1313 microversion: 2.1 time: 1.035019 Aug 04 04:39:15.041863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 20/45] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:13 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1313 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:15.056517 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-146050039", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a74bfc1f-40a0-4124-8b9e-742f5d37af4d"}], "security_groups": [{"name": "tempest-securitygroup--2099682161"}], "key_name": "tempest-keypair-249672397", "user_data": "}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:15.800291 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] validate_networks() for [('a74bfc1f-40a0-4124-8b9e-742f5d37af4d', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:39:17.467331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:39:17.467331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:39:17.467331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:39:17.467331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:39:17.467331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:39:17.480221 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:17.480561 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:17.487690 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:17.488296 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:17.535061 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Getting quotas for project 157a41f0f76c41cb8dfff71a14138534. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:17.541947 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Getting quotas for user 12f7b1c19d824ac7b8207bf001b79057 and project 157a41f0f76c41cb8dfff71a14138534. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:17.559742 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:39:17.573240 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:39:17.652511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7ac98026-b6bb-43de-b6bc-5595bd22ad6d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.608450 Aug 04 04:39:17.653233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 21/46] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:39:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 2611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:39:17.667623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c8a01f9d-36f2-4de8-bba7-02fde449e571 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:17.668589 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c8a01f9d-36f2-4de8-bba7-02fde449e571 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:17.677771 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8a01f9d-36f2-4de8-bba7-02fde449e571 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:17.678490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8a01f9d-36f2-4de8-bba7-02fde449e571 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:17.679571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8a01f9d-36f2-4de8-bba7-02fde449e571 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:17.680202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8a01f9d-36f2-4de8-bba7-02fde449e571 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:17.976130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Flavor limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:39:17.976782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Image limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:39:17.977126 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Flavor pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:39:17.977556 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Image pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:39:17.978008 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:39:18.035922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:18.038625 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:18.043594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:18.045322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:18.107629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for project 9124d19d48f44fe2a904a715e5db1223. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:18.111535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c8a01f9d-36f2-4de8-bba7-02fde449e571 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:18.116962 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for user 49a7ce9a27734dc0a187d1b217206785 and project 9124d19d48f44fe2a904a715e5db1223. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:18.126583 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c8a01f9d-36f2-4de8-bba7-02fde449e571 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1313 microversion: 2.1 time: 0.460013 Aug 04 04:39:18.127212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 22/47] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:17 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:18.151056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-290061c0-8079-49e5-92db-2a1550b2b9f0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:18.155738 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-290061c0-8079-49e5-92db-2a1550b2b9f0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:18.172827 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Going to run 1 instances... {{(pid=134884) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:39:18.213433 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:39:18.354259 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-290061c0-8079-49e5-92db-2a1550b2b9f0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:18.377491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-290061c0-8079-49e5-92db-2a1550b2b9f0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1236 microversion: 2.1 time: 0.240346 Aug 04 04:39:18.379241 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 23/48] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:18 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1236 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:18.528115 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f3a6d119-f7a4-4f02-826b-efec6d7a3a28 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.347664 Aug 04 04:39:18.530958 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 26/49] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:39:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 5351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:39:18.546269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4e649b55-b2af-4993-aa49-23dfb933237d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:18.554720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4e649b55-b2af-4993-aa49-23dfb933237d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:18.814405 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4e649b55-b2af-4993-aa49-23dfb933237d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:18.846365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4e649b55-b2af-4993-aa49-23dfb933237d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1242 microversion: 2.1 time: 0.288563 Aug 04 04:39:18.852438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 24/50] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:18 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1242 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:19.164877 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1f7be11b-0833-4a1d-8dcb-60bb1732ab3f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:19.166958 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1f7be11b-0833-4a1d-8dcb-60bb1732ab3f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:19.208860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1f7be11b-0833-4a1d-8dcb-60bb1732ab3f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:19.209359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1f7be11b-0833-4a1d-8dcb-60bb1732ab3f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:19.211135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1f7be11b-0833-4a1d-8dcb-60bb1732ab3f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:19.211589 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1f7be11b-0833-4a1d-8dcb-60bb1732ab3f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:19.400408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-94a90110-15bb-434b-8eca-3af5e16f9bd9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:19.402417 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-94a90110-15bb-434b-8eca-3af5e16f9bd9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:19.646057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-94a90110-15bb-434b-8eca-3af5e16f9bd9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:19.655039 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-94a90110-15bb-434b-8eca-3af5e16f9bd9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1236 microversion: 2.1 time: 0.258024 Aug 04 04:39:19.669619 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 25/51] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:19 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1236 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:19.737005 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1f7be11b-0833-4a1d-8dcb-60bb1732ab3f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:19.748257 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1f7be11b-0833-4a1d-8dcb-60bb1732ab3f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1313 microversion: 2.1 time: 0.589746 Aug 04 04:39:19.764778 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 27/52] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:19 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:19.898060 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d7825d52-390b-44aa-af30-159903c5a5af tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:19.901506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d7825d52-390b-44aa-af30-159903c5a5af tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:19.975988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d7825d52-390b-44aa-af30-159903c5a5af tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:19.984315 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d7825d52-390b-44aa-af30-159903c5a5af tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1242 microversion: 2.1 time: 0.098627 Aug 04 04:39:19.985376 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 28/53] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:19 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:20.131195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-0ec2ed89-5ee1-4112-8f01-7fb8ce0f52e5 req-325f7e6e-99c6-483c-8667-a4a01789e350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b78c6e-0f44-4c3f-bee2-ea84b333101b", "tag": "2ae96030-5622-4eb9-869d-3624c736cd89"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:20.178080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-0ec2ed89-5ee1-4112-8f01-7fb8ce0f52e5 req-325f7e6e-99c6-483c-8667-a4a01789e350 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:20.179691 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-0ec2ed89-5ee1-4112-8f01-7fb8ce0f52e5 req-325f7e6e-99c6-483c-8667-a4a01789e350 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:20.205762 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-0ec2ed89-5ee1-4112-8f01-7fb8ce0f52e5 req-325f7e6e-99c6-483c-8667-a4a01789e350 service nova] Creating event network-changed:2ae96030-5622-4eb9-869d-3624c736cd89 for instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b on hv-cinder-85127 Aug 04 04:39:20.206576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-0ec2ed89-5ee1-4112-8f01-7fb8ce0f52e5 req-325f7e6e-99c6-483c-8667-a4a01789e350 service nova] Acquired lock "compute-rpcapi-router" {{(pid=134883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:39:20.208015 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7aa282f6-053f-4943-a20c-b9368f913797 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:20.208629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7aa282f6-053f-4943-a20c-b9368f913797 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:20.209644 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7aa282f6-053f-4943-a20c-b9368f913797 None None] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:20.210393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7aa282f6-053f-4943-a20c-b9368f913797 None None] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:20.222103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.compute.rpcapi [None req-7aa282f6-053f-4943-a20c-b9368f913797 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 04:39:20.223534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7aa282f6-053f-4943-a20c-b9368f913797 None None] Releasing lock "compute-rpcapi-router" {{(pid=134883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:39:20.252584 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7aa282f6-053f-4943-a20c-b9368f913797 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.581461 Aug 04 04:39:20.253462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 26/54] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:20.678446 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-888746ca-ecb0-4c05-bb66-a2aaca9afc29 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:20.679299 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-888746ca-ecb0-4c05-bb66-a2aaca9afc29 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:20.686591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-888746ca-ecb0-4c05-bb66-a2aaca9afc29 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:20.687657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-888746ca-ecb0-4c05-bb66-a2aaca9afc29 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:20.689230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-888746ca-ecb0-4c05-bb66-a2aaca9afc29 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:20.690364 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-888746ca-ecb0-4c05-bb66-a2aaca9afc29 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:20.772917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6a13a93a-68e3-4655-be1f-776d5d16eb6b tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:20.774545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6a13a93a-68e3-4655-be1f-776d5d16eb6b tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:20.786193 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6a13a93a-68e3-4655-be1f-776d5d16eb6b tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:20.790291 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6a13a93a-68e3-4655-be1f-776d5d16eb6b tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:20.791341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6a13a93a-68e3-4655-be1f-776d5d16eb6b tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:20.791952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6a13a93a-68e3-4655-be1f-776d5d16eb6b tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:20.793808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-888746ca-ecb0-4c05-bb66-a2aaca9afc29 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:20.818678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-888746ca-ecb0-4c05-bb66-a2aaca9afc29 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1240 microversion: 2.1 time: 0.143952 Aug 04 04:39:20.821610 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 29/55] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:20 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1240 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:21.011584 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8dbeb575-fadd-4b75-baf8-827fc912b66e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:21.012137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8dbeb575-fadd-4b75-baf8-827fc912b66e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:21.025832 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8dbeb575-fadd-4b75-baf8-827fc912b66e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:21.027713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8dbeb575-fadd-4b75-baf8-827fc912b66e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:21.029636 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8dbeb575-fadd-4b75-baf8-827fc912b66e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:21.032818 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8dbeb575-fadd-4b75-baf8-827fc912b66e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:21.035865 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6a13a93a-68e3-4655-be1f-776d5d16eb6b tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:21.045881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6a13a93a-68e3-4655-be1f-776d5d16eb6b tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1313 microversion: 2.1 time: 0.277889 Aug 04 04:39:21.069219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 27/56] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:20 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:21.114858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8dbeb575-fadd-4b75-baf8-827fc912b66e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:21.136376 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8dbeb575-fadd-4b75-baf8-827fc912b66e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1246 microversion: 2.1 time: 0.132941 Aug 04 04:39:21.149694 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 30/57] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:21 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1246 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:21.859972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-99a1615d-ce34-4f89-a5d4-97f685fa52fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:21.863195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-99a1615d-ce34-4f89-a5d4-97f685fa52fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:21.893310 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99a1615d-ce34-4f89-a5d4-97f685fa52fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:21.895218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99a1615d-ce34-4f89-a5d4-97f685fa52fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:21.899285 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99a1615d-ce34-4f89-a5d4-97f685fa52fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:21.900700 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99a1615d-ce34-4f89-a5d4-97f685fa52fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:22.069571 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6540f4ca-43d1-4904-baad-be60fa4e502e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:22.070285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6540f4ca-43d1-4904-baad-be60fa4e502e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:22.082287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6540f4ca-43d1-4904-baad-be60fa4e502e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:22.082743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6540f4ca-43d1-4904-baad-be60fa4e502e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:22.083597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6540f4ca-43d1-4904-baad-be60fa4e502e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:22.083963 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6540f4ca-43d1-4904-baad-be60fa4e502e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:22.183382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-99a1615d-ce34-4f89-a5d4-97f685fa52fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:22.204759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-99a1615d-ce34-4f89-a5d4-97f685fa52fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1240 microversion: 2.1 time: 0.362782 Aug 04 04:39:22.220737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 28/58] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:21 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1240 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:22.236896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-03a6b04c-5e42-4317-8369-58c73211d4c6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:22.237538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-03a6b04c-5e42-4317-8369-58c73211d4c6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:22.254184 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03a6b04c-5e42-4317-8369-58c73211d4c6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:22.254637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03a6b04c-5e42-4317-8369-58c73211d4c6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:22.260102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03a6b04c-5e42-4317-8369-58c73211d4c6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:22.260893 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03a6b04c-5e42-4317-8369-58c73211d4c6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:22.437327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-03a6b04c-5e42-4317-8369-58c73211d4c6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:22.464140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-03a6b04c-5e42-4317-8369-58c73211d4c6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1238 microversion: 2.1 time: 0.241274 Aug 04 04:39:22.466058 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 29/59] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:22 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1238 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:22.957382 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6540f4ca-43d1-4904-baad-be60fa4e502e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:22.976378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6540f4ca-43d1-4904-baad-be60fa4e502e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1313 microversion: 2.1 time: 0.907323 Aug 04 04:39:22.977265 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 31/60] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:22 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1313 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:23.235180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9ba15cb3-a3d7-49e3-8e92-ec18268d5a31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:23.236718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9ba15cb3-a3d7-49e3-8e92-ec18268d5a31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:23.250591 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9ba15cb3-a3d7-49e3-8e92-ec18268d5a31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:23.251466 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9ba15cb3-a3d7-49e3-8e92-ec18268d5a31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:23.252792 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9ba15cb3-a3d7-49e3-8e92-ec18268d5a31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:23.253574 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9ba15cb3-a3d7-49e3-8e92-ec18268d5a31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:23.417443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9ba15cb3-a3d7-49e3-8e92-ec18268d5a31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:23.432480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9ba15cb3-a3d7-49e3-8e92-ec18268d5a31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1296 microversion: 2.1 time: 0.203902 Aug 04 04:39:23.437692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 30/61] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:23 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1296 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:23.496022 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bbf6c706-f443-4b0f-9de0-6e6e46c2e770 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:23.497287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bbf6c706-f443-4b0f-9de0-6e6e46c2e770 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:23.510010 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bbf6c706-f443-4b0f-9de0-6e6e46c2e770 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:23.510758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bbf6c706-f443-4b0f-9de0-6e6e46c2e770 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:23.519170 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bbf6c706-f443-4b0f-9de0-6e6e46c2e770 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:23.519632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bbf6c706-f443-4b0f-9de0-6e6e46c2e770 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:23.631419 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bbf6c706-f443-4b0f-9de0-6e6e46c2e770 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:23.642169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bbf6c706-f443-4b0f-9de0-6e6e46c2e770 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1300 microversion: 2.1 time: 0.150148 Aug 04 04:39:23.648184 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 32/62] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:23 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1300 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:24.001328 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8aa525ff-382e-4c01-8bf9-bb1cd036f548 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:24.002211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8aa525ff-382e-4c01-8bf9-bb1cd036f548 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:24.008789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8aa525ff-382e-4c01-8bf9-bb1cd036f548 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:24.009637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8aa525ff-382e-4c01-8bf9-bb1cd036f548 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:24.010820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8aa525ff-382e-4c01-8bf9-bb1cd036f548 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:24.011609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8aa525ff-382e-4c01-8bf9-bb1cd036f548 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:24.183550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8aa525ff-382e-4c01-8bf9-bb1cd036f548 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:24.193129 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8aa525ff-382e-4c01-8bf9-bb1cd036f548 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1313 microversion: 2.1 time: 0.196550 Aug 04 04:39:24.194214 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 31/63] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:23 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:24.457583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-04d7ef92-3b2f-43d4-b36d-d568c5b3116f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:24.458198 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-04d7ef92-3b2f-43d4-b36d-d568c5b3116f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:24.469675 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-04d7ef92-3b2f-43d4-b36d-d568c5b3116f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:24.470128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-04d7ef92-3b2f-43d4-b36d-d568c5b3116f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:24.471128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-04d7ef92-3b2f-43d4-b36d-d568c5b3116f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:24.473570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-04d7ef92-3b2f-43d4-b36d-d568c5b3116f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:24.618103 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-04d7ef92-3b2f-43d4-b36d-d568c5b3116f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:24.631296 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-04d7ef92-3b2f-43d4-b36d-d568c5b3116f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1294 microversion: 2.1 time: 0.177979 Aug 04 04:39:24.633404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 33/64] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:24 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1294 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:24.665613 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-88fd89c7-8ee3-46f9-a41b-c18bb7f43e61 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:24.667364 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-88fd89c7-8ee3-46f9-a41b-c18bb7f43e61 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:24.675779 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-88fd89c7-8ee3-46f9-a41b-c18bb7f43e61 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:24.676550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-88fd89c7-8ee3-46f9-a41b-c18bb7f43e61 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:24.677707 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-88fd89c7-8ee3-46f9-a41b-c18bb7f43e61 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:24.678354 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-88fd89c7-8ee3-46f9-a41b-c18bb7f43e61 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:24.734504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=69 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:24.836974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-88fd89c7-8ee3-46f9-a41b-c18bb7f43e61 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:24.851189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-88fd89c7-8ee3-46f9-a41b-c18bb7f43e61 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1300 microversion: 2.1 time: 0.188746 Aug 04 04:39:24.853053 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 32/65] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:24 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1300 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:25.218254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7c2c129a-5f22-436b-b9ea-814f3ad55950 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:25.218946 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7c2c129a-5f22-436b-b9ea-814f3ad55950 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:25.235480 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:25.237095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c2c129a-5f22-436b-b9ea-814f3ad55950 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:25.237577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c2c129a-5f22-436b-b9ea-814f3ad55950 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:25.239402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c2c129a-5f22-436b-b9ea-814f3ad55950 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:25.240352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c2c129a-5f22-436b-b9ea-814f3ad55950 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:25.248388 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=57 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:25.575175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7c2c129a-5f22-436b-b9ea-814f3ad55950 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:25.587346 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7c2c129a-5f22-436b-b9ea-814f3ad55950 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1313 microversion: 2.1 time: 0.374282 Aug 04 04:39:25.588038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 34/66] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:25 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:25.653685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f77b9a72-bef9-422b-91c4-131878429318 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:25.654494 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f77b9a72-bef9-422b-91c4-131878429318 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:25.663241 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:25.666388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f77b9a72-bef9-422b-91c4-131878429318 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:25.667089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f77b9a72-bef9-422b-91c4-131878429318 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:25.670610 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f77b9a72-bef9-422b-91c4-131878429318 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:25.672109 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f77b9a72-bef9-422b-91c4-131878429318 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:25.801820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f77b9a72-bef9-422b-91c4-131878429318 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:25.817518 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f77b9a72-bef9-422b-91c4-131878429318 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1294 microversion: 2.1 time: 0.167304 Aug 04 04:39:25.819009 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 33/67] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:25 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1294 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:25.876591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-44189eea-f2ef-41e1-8731-6873aaee8e9c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:25.877135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-44189eea-f2ef-41e1-8731-6873aaee8e9c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:25.887866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44189eea-f2ef-41e1-8731-6873aaee8e9c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:25.888383 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44189eea-f2ef-41e1-8731-6873aaee8e9c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:25.892350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44189eea-f2ef-41e1-8731-6873aaee8e9c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:25.895004 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44189eea-f2ef-41e1-8731-6873aaee8e9c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:26.156931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-44189eea-f2ef-41e1-8731-6873aaee8e9c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:26.182937 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-44189eea-f2ef-41e1-8731-6873aaee8e9c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1300 microversion: 2.1 time: 0.311542 Aug 04 04:39:26.189405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 35/68] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:25 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1300 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:26.614038 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-880b1ea0-335e-4320-90f5-131ec06fad79 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:26.614831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-880b1ea0-335e-4320-90f5-131ec06fad79 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:26.644680 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-880b1ea0-335e-4320-90f5-131ec06fad79 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:26.645221 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-880b1ea0-335e-4320-90f5-131ec06fad79 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:26.646050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-880b1ea0-335e-4320-90f5-131ec06fad79 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:26.646980 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-880b1ea0-335e-4320-90f5-131ec06fad79 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:26.841816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c2083426-e5e3-4bc8-ac00-f7f5a7977dbf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:26.842960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c2083426-e5e3-4bc8-ac00-f7f5a7977dbf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:26.852428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2083426-e5e3-4bc8-ac00-f7f5a7977dbf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:26.853642 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2083426-e5e3-4bc8-ac00-f7f5a7977dbf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:26.854992 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2083426-e5e3-4bc8-ac00-f7f5a7977dbf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:26.855783 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2083426-e5e3-4bc8-ac00-f7f5a7977dbf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:27.015855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-880b1ea0-335e-4320-90f5-131ec06fad79 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:27.033848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-880b1ea0-335e-4320-90f5-131ec06fad79 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1313 microversion: 2.1 time: 0.422513 Aug 04 04:39:27.035157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 34/69] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:26 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:27.156936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c2083426-e5e3-4bc8-ac00-f7f5a7977dbf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:27.171604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c2083426-e5e3-4bc8-ac00-f7f5a7977dbf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1362 microversion: 2.1 time: 0.335779 Aug 04 04:39:27.172567 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 36/70] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:26 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:27.217255 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-09c75892-b10a-42f2-a1f5-a2d9ef6d3500 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:27.218027 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-09c75892-b10a-42f2-a1f5-a2d9ef6d3500 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:27.231208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-09c75892-b10a-42f2-a1f5-a2d9ef6d3500 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:27.236742 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-09c75892-b10a-42f2-a1f5-a2d9ef6d3500 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:27.237767 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-09c75892-b10a-42f2-a1f5-a2d9ef6d3500 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:27.238221 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-09c75892-b10a-42f2-a1f5-a2d9ef6d3500 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:27.707503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-09c75892-b10a-42f2-a1f5-a2d9ef6d3500 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:27.719443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-09c75892-b10a-42f2-a1f5-a2d9ef6d3500 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1368 microversion: 2.1 time: 0.507367 Aug 04 04:39:27.721290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 35/71] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:27 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1368 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:28.056861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0e318aaa-24e3-4447-ad7b-2832cfac1736 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:28.057606 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0e318aaa-24e3-4447-ad7b-2832cfac1736 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:28.074078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:28.079136 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0e318aaa-24e3-4447-ad7b-2832cfac1736 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:28.079597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0e318aaa-24e3-4447-ad7b-2832cfac1736 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:28.080380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0e318aaa-24e3-4447-ad7b-2832cfac1736 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:28.080934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0e318aaa-24e3-4447-ad7b-2832cfac1736 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:28.194050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4325f6a9-e8d2-4e15-b9d7-8864f874697c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:28.195340 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4325f6a9-e8d2-4e15-b9d7-8864f874697c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:28.210500 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4325f6a9-e8d2-4e15-b9d7-8864f874697c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:28.213047 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4325f6a9-e8d2-4e15-b9d7-8864f874697c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:28.214502 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4325f6a9-e8d2-4e15-b9d7-8864f874697c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:28.215862 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4325f6a9-e8d2-4e15-b9d7-8864f874697c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:28.537363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0e318aaa-24e3-4447-ad7b-2832cfac1736 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:28.555312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0e318aaa-24e3-4447-ad7b-2832cfac1736 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1313 microversion: 2.1 time: 0.502608 Aug 04 04:39:28.556369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 37/72] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:28 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:28.587591 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4325f6a9-e8d2-4e15-b9d7-8864f874697c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:28.596274 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4325f6a9-e8d2-4e15-b9d7-8864f874697c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1362 microversion: 2.1 time: 0.407360 Aug 04 04:39:28.596722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 36/73] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:28 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:28.744370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-351607fc-10b7-45a2-8b97-dee5d9b5aca7 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:28.745358 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-351607fc-10b7-45a2-8b97-dee5d9b5aca7 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:28.755774 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-351607fc-10b7-45a2-8b97-dee5d9b5aca7 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:28.756240 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-351607fc-10b7-45a2-8b97-dee5d9b5aca7 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:28.757030 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-351607fc-10b7-45a2-8b97-dee5d9b5aca7 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:28.757464 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-351607fc-10b7-45a2-8b97-dee5d9b5aca7 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:29.127443 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-351607fc-10b7-45a2-8b97-dee5d9b5aca7 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:29.143178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-351607fc-10b7-45a2-8b97-dee5d9b5aca7 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1368 microversion: 2.1 time: 0.401386 Aug 04 04:39:29.145270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 38/74] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:28 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1368 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:29.418414 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-f842e1cf-93ed-4814-8265-5d1afec4ae7d req-49fa554e-8c23-4e3f-9d49-fa70bb075f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b78c6e-0f44-4c3f-bee2-ea84b333101b", "name": "network-vif-plugged", "status": "completed", "tag": "2ae96030-5622-4eb9-869d-3624c736cd89"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:29.436603 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-f842e1cf-93ed-4814-8265-5d1afec4ae7d req-49fa554e-8c23-4e3f-9d49-fa70bb075f2b service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:29.437690 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-f842e1cf-93ed-4814-8265-5d1afec4ae7d req-49fa554e-8c23-4e3f-9d49-fa70bb075f2b service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:29.471297 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-f842e1cf-93ed-4814-8265-5d1afec4ae7d req-49fa554e-8c23-4e3f-9d49-fa70bb075f2b service nova] Creating event network-vif-plugged:2ae96030-5622-4eb9-869d-3624c736cd89 for instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b on hv-cinder-85127 Aug 04 04:39:29.482664 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-f842e1cf-93ed-4814-8265-5d1afec4ae7d req-49fa554e-8c23-4e3f-9d49-fa70bb075f2b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.326961 Aug 04 04:39:29.484678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 37/75] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:29.585763 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c6d2f890-acef-4d75-b1b0-f1630a255462 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:29.586529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c6d2f890-acef-4d75-b1b0-f1630a255462 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:29.599855 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6d2f890-acef-4d75-b1b0-f1630a255462 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:29.601320 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6d2f890-acef-4d75-b1b0-f1630a255462 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:29.602438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6d2f890-acef-4d75-b1b0-f1630a255462 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:29.603129 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6d2f890-acef-4d75-b1b0-f1630a255462 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:29.619753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a2ac17c8-c8cc-40a3-9774-5f7632d1c33b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:29.620559 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a2ac17c8-c8cc-40a3-9774-5f7632d1c33b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:29.635750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a2ac17c8-c8cc-40a3-9774-5f7632d1c33b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:29.636671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a2ac17c8-c8cc-40a3-9774-5f7632d1c33b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:29.637870 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a2ac17c8-c8cc-40a3-9774-5f7632d1c33b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:29.639798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a2ac17c8-c8cc-40a3-9774-5f7632d1c33b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:29.652160 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=12 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:29.897718 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c6d2f890-acef-4d75-b1b0-f1630a255462 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:29.911662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c6d2f890-acef-4d75-b1b0-f1630a255462 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1313 microversion: 2.1 time: 0.334473 Aug 04 04:39:29.925661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 39/76] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:29 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:30.057233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a2ac17c8-c8cc-40a3-9774-5f7632d1c33b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:30.071593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a2ac17c8-c8cc-40a3-9774-5f7632d1c33b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1362 microversion: 2.1 time: 0.456124 Aug 04 04:39:30.072183 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 38/77] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:29 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1362 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:30.170778 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1588ca4a-4424-44ca-a908-56fe43c03c7f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:30.171318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1588ca4a-4424-44ca-a908-56fe43c03c7f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:30.173218 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=14 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:30.192673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1588ca4a-4424-44ca-a908-56fe43c03c7f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:30.194738 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1588ca4a-4424-44ca-a908-56fe43c03c7f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:30.196838 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1588ca4a-4424-44ca-a908-56fe43c03c7f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:30.198522 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1588ca4a-4424-44ca-a908-56fe43c03c7f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:30.474386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=4 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:30.559047 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1588ca4a-4424-44ca-a908-56fe43c03c7f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:30.568739 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1588ca4a-4424-44ca-a908-56fe43c03c7f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1368 microversion: 2.1 time: 0.403245 Aug 04 04:39:30.577661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 40/78] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:30 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1368 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:30.816236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-474d905d-edce-4a8b-8219-b0a8da2387c1 req-d8d6bb2f-3501-4a8a-8fc5-8686c93cf3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce02b26c-276e-4d87-9790-87a8469fac7a", "tag": "53a920ec-439a-4a5f-9d51-66dee4c91777"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:30.828615 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-474d905d-edce-4a8b-8219-b0a8da2387c1 req-d8d6bb2f-3501-4a8a-8fc5-8686c93cf3ba service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:30.828615 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-474d905d-edce-4a8b-8219-b0a8da2387c1 req-d8d6bb2f-3501-4a8a-8fc5-8686c93cf3ba service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:30.839630 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-474d905d-edce-4a8b-8219-b0a8da2387c1 req-d8d6bb2f-3501-4a8a-8fc5-8686c93cf3ba service nova] Creating event network-changed:53a920ec-439a-4a5f-9d51-66dee4c91777 for instance ce02b26c-276e-4d87-9790-87a8469fac7a on hv-cinder-85127 Aug 04 04:39:30.846325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-474d905d-edce-4a8b-8219-b0a8da2387c1 req-d8d6bb2f-3501-4a8a-8fc5-8686c93cf3ba service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.379230 Aug 04 04:39:30.846938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 39/79] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:30.933330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e03a877b-f80d-454b-bbae-ae225bacae3d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:30.933879 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e03a877b-f80d-454b-bbae-ae225bacae3d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:30.940552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e03a877b-f80d-454b-bbae-ae225bacae3d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:30.941008 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e03a877b-f80d-454b-bbae-ae225bacae3d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:30.941859 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e03a877b-f80d-454b-bbae-ae225bacae3d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:30.942294 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e03a877b-f80d-454b-bbae-ae225bacae3d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:31.096901 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d58c0041-d19b-46f5-a845-7ff8583ea483 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:31.098035 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d58c0041-d19b-46f5-a845-7ff8583ea483 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:31.110334 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d58c0041-d19b-46f5-a845-7ff8583ea483 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:31.111211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d58c0041-d19b-46f5-a845-7ff8583ea483 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:31.112219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d58c0041-d19b-46f5-a845-7ff8583ea483 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:31.112883 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d58c0041-d19b-46f5-a845-7ff8583ea483 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:31.123396 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e03a877b-f80d-454b-bbae-ae225bacae3d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:31.131538 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e03a877b-f80d-454b-bbae-ae225bacae3d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1313 microversion: 2.1 time: 0.202488 Aug 04 04:39:31.149615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 41/80] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:30 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:31.290827 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d58c0041-d19b-46f5-a845-7ff8583ea483 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:31.303470 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d58c0041-d19b-46f5-a845-7ff8583ea483 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1362 microversion: 2.1 time: 0.211385 Aug 04 04:39:31.304212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 40/81] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:31 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:31.610820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bfc2f439-c8cc-4492-b56f-202cd3125808 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:31.611446 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bfc2f439-c8cc-4492-b56f-202cd3125808 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:31.620313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bfc2f439-c8cc-4492-b56f-202cd3125808 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:31.620823 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bfc2f439-c8cc-4492-b56f-202cd3125808 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:31.621752 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bfc2f439-c8cc-4492-b56f-202cd3125808 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:31.622838 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bfc2f439-c8cc-4492-b56f-202cd3125808 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:31.831570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bfc2f439-c8cc-4492-b56f-202cd3125808 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:31.845974 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bfc2f439-c8cc-4492-b56f-202cd3125808 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1368 microversion: 2.1 time: 0.258572 Aug 04 04:39:31.855193 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 42/82] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:31 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:32.158203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-caba8ef1-f702-4dd4-94cb-d97210d69a8f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:32.158578 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-caba8ef1-f702-4dd4-94cb-d97210d69a8f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:32.165069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-caba8ef1-f702-4dd4-94cb-d97210d69a8f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.170371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-caba8ef1-f702-4dd4-94cb-d97210d69a8f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.171191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-caba8ef1-f702-4dd4-94cb-d97210d69a8f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.173478 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-caba8ef1-f702-4dd4-94cb-d97210d69a8f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.329702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-778a9bb6-8c13-4927-9e8c-4e4a997a6914 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:32.330457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-778a9bb6-8c13-4927-9e8c-4e4a997a6914 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:32.339722 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-778a9bb6-8c13-4927-9e8c-4e4a997a6914 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.340589 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-778a9bb6-8c13-4927-9e8c-4e4a997a6914 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.342013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-778a9bb6-8c13-4927-9e8c-4e4a997a6914 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.342460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-778a9bb6-8c13-4927-9e8c-4e4a997a6914 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.409199 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-caba8ef1-f702-4dd4-94cb-d97210d69a8f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:32.418345 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-caba8ef1-f702-4dd4-94cb-d97210d69a8f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1500 microversion: 2.1 time: 0.265544 Aug 04 04:39:32.429609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 41/83] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:32 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1500 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:32.544870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-778a9bb6-8c13-4927-9e8c-4e4a997a6914 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:32.556426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-778a9bb6-8c13-4927-9e8c-4e4a997a6914 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1362 microversion: 2.1 time: 0.232893 Aug 04 04:39:32.557367 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 43/84] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:32 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:32.871801 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-f4cc6a10-5804-4264-af62-345fec179997 req-aae6e81f-f34a-430e-8801-378b8e306bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66d5fe6-f2d3-45e8-a225-8d7d10522e92", "tag": "399fc288-7263-4519-916b-0f65a42f8c19"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:32.874084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b6153df1-18fc-4425-ac34-c49032af9261 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:32.874772 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b6153df1-18fc-4425-ac34-c49032af9261 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:32.892696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6153df1-18fc-4425-ac34-c49032af9261 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.892696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6153df1-18fc-4425-ac34-c49032af9261 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.901140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6153df1-18fc-4425-ac34-c49032af9261 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.901736 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6153df1-18fc-4425-ac34-c49032af9261 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.930244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-f4cc6a10-5804-4264-af62-345fec179997 req-aae6e81f-f34a-430e-8801-378b8e306bca service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.931010 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-f4cc6a10-5804-4264-af62-345fec179997 req-aae6e81f-f34a-430e-8801-378b8e306bca service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.958909 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-f4cc6a10-5804-4264-af62-345fec179997 req-aae6e81f-f34a-430e-8801-378b8e306bca service nova] Creating event network-changed:399fc288-7263-4519-916b-0f65a42f8c19 for instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 on hv-cinder-85127 Aug 04 04:39:32.959728 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-f4cc6a10-5804-4264-af62-345fec179997 req-aae6e81f-f34a-430e-8801-378b8e306bca service nova] Acquired lock "compute-rpcapi-router" {{(pid=134884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 04:39:32.960634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa53fe52-2eee-4b8c-9a5a-78e277bccc00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.968517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa53fe52-2eee-4b8c-9a5a-78e277bccc00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.970097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa53fe52-2eee-4b8c-9a5a-78e277bccc00 None None] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:32.970551 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa53fe52-2eee-4b8c-9a5a-78e277bccc00 None None] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:32.980342 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.compute.rpcapi [None req-fa53fe52-2eee-4b8c-9a5a-78e277bccc00 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 04:39:32.986539 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa53fe52-2eee-4b8c-9a5a-78e277bccc00 None None] Releasing lock "compute-rpcapi-router" {{(pid=134884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 04:39:33.038225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fa53fe52-2eee-4b8c-9a5a-78e277bccc00 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171539 Aug 04 04:39:33.038882 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 44/85] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:33.323870 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b6153df1-18fc-4425-ac34-c49032af9261 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:33.336860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b6153df1-18fc-4425-ac34-c49032af9261 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1368 microversion: 2.1 time: 0.472418 Aug 04 04:39:33.338534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 42/86] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:32 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1368 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:33.586448 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-57137e09-7dab-4a15-ac1d-967265410216 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:33.588191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-57137e09-7dab-4a15-ac1d-967265410216 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:33.600764 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-57137e09-7dab-4a15-ac1d-967265410216 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:33.601725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-57137e09-7dab-4a15-ac1d-967265410216 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:33.605788 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-57137e09-7dab-4a15-ac1d-967265410216 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:33.606673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-57137e09-7dab-4a15-ac1d-967265410216 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:34.097970 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-57137e09-7dab-4a15-ac1d-967265410216 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:34.110683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-57137e09-7dab-4a15-ac1d-967265410216 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1362 microversion: 2.1 time: 0.530096 Aug 04 04:39:34.111466 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 45/87] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:33 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1362 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:34.241112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3202c1d7-9d46-4ac9-a4dd-07e533853c72 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edf8a940-260e-468a-aeae-786f0a64f5ab"}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:34.243971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3202c1d7-9d46-4ac9-a4dd-07e533853c72 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:34.253446 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3202c1d7-9d46-4ac9-a4dd-07e533853c72 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:34.253978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3202c1d7-9d46-4ac9-a4dd-07e533853c72 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:34.254765 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3202c1d7-9d46-4ac9-a4dd-07e533853c72 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:34.255200 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3202c1d7-9d46-4ac9-a4dd-07e533853c72 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:34.359583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-017ad58d-7617-4631-9a50-dca9b51fbe79 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:34.360562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-017ad58d-7617-4631-9a50-dca9b51fbe79 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:34.370293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-017ad58d-7617-4631-9a50-dca9b51fbe79 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:34.370939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-017ad58d-7617-4631-9a50-dca9b51fbe79 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:34.372831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-017ad58d-7617-4631-9a50-dca9b51fbe79 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:34.373670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-017ad58d-7617-4631-9a50-dca9b51fbe79 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:34.545444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-017ad58d-7617-4631-9a50-dca9b51fbe79 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:34.554380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-017ad58d-7617-4631-9a50-dca9b51fbe79 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1368 microversion: 2.1 time: 0.199136 Aug 04 04:39:34.554985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 46/88] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:34 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:35.132775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6b7ed4d2-2535-46bc-99cd-c4fe94fc5515 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:35.133413 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6b7ed4d2-2535-46bc-99cd-c4fe94fc5515 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:35.140385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b7ed4d2-2535-46bc-99cd-c4fe94fc5515 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:35.140828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b7ed4d2-2535-46bc-99cd-c4fe94fc5515 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:35.146536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b7ed4d2-2535-46bc-99cd-c4fe94fc5515 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:35.153934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b7ed4d2-2535-46bc-99cd-c4fe94fc5515 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:35.316041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6b7ed4d2-2535-46bc-99cd-c4fe94fc5515 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:35.326580 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6b7ed4d2-2535-46bc-99cd-c4fe94fc5515 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1362 microversion: 2.1 time: 0.196441 Aug 04 04:39:35.327183 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 47/89] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:35 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:35.576960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b63bfec9-d254-4f62-89a5-e213faeace90 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:35.577493 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b63bfec9-d254-4f62-89a5-e213faeace90 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:35.583752 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b63bfec9-d254-4f62-89a5-e213faeace90 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:35.584207 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b63bfec9-d254-4f62-89a5-e213faeace90 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:35.584973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b63bfec9-d254-4f62-89a5-e213faeace90 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:35.585453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b63bfec9-d254-4f62-89a5-e213faeace90 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:35.725412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b63bfec9-d254-4f62-89a5-e213faeace90 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:35.733257 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b63bfec9-d254-4f62-89a5-e213faeace90 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1368 microversion: 2.1 time: 0.161028 Aug 04 04:39:35.734456 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 48/90] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:35 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:36.348069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b673be3c-9e80-47b1-a185-4ffc640af034 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:36.348727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b673be3c-9e80-47b1-a185-4ffc640af034 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:36.354848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b673be3c-9e80-47b1-a185-4ffc640af034 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:36.355293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b673be3c-9e80-47b1-a185-4ffc640af034 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:36.356081 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b673be3c-9e80-47b1-a185-4ffc640af034 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:36.356576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b673be3c-9e80-47b1-a185-4ffc640af034 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:36.494009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b673be3c-9e80-47b1-a185-4ffc640af034 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:36.502485 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b673be3c-9e80-47b1-a185-4ffc640af034 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1362 microversion: 2.1 time: 0.158230 Aug 04 04:39:36.503068 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 49/91] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:36 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:36.755997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9a0f857f-f225-47af-a984-a9316dcecb07 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:36.756618 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9a0f857f-f225-47af-a984-a9316dcecb07 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:36.763983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a0f857f-f225-47af-a984-a9316dcecb07 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:36.765003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a0f857f-f225-47af-a984-a9316dcecb07 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:36.765987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a0f857f-f225-47af-a984-a9316dcecb07 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:36.766433 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a0f857f-f225-47af-a984-a9316dcecb07 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:36.872769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3202c1d7-9d46-4ac9-a4dd-07e533853c72 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "POST /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.636773 Aug 04 04:39:36.873531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 43/92] 10.222.0.47 () {60 vars in 1323 bytes} [Thu Aug 4 04:39:34 2022] POST /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b/os-volume_attachments => generated 194 bytes in 2639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:36.932868 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9a0f857f-f225-47af-a984-a9316dcecb07 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:36.952185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9a0f857f-f225-47af-a984-a9316dcecb07 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1368 microversion: 2.1 time: 0.200642 Aug 04 04:39:36.952696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 50/93] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:36 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:37.236658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-7af92c27-6e35-468f-a4de-dab84a83f682 req-b79f7599-c69e-49d7-86f2-c8e62a086d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce02b26c-276e-4d87-9790-87a8469fac7a", "name": "network-vif-plugged", "status": "completed", "tag": "53a920ec-439a-4a5f-9d51-66dee4c91777"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:37.248250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-7af92c27-6e35-468f-a4de-dab84a83f682 req-b79f7599-c69e-49d7-86f2-c8e62a086d5e service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:37.248250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-7af92c27-6e35-468f-a4de-dab84a83f682 req-b79f7599-c69e-49d7-86f2-c8e62a086d5e service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:37.259889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-7af92c27-6e35-468f-a4de-dab84a83f682 req-b79f7599-c69e-49d7-86f2-c8e62a086d5e service nova] Creating event network-vif-plugged:53a920ec-439a-4a5f-9d51-66dee4c91777 for instance ce02b26c-276e-4d87-9790-87a8469fac7a on hv-cinder-85127 Aug 04 04:39:37.266002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-7af92c27-6e35-468f-a4de-dab84a83f682 req-b79f7599-c69e-49d7-86f2-c8e62a086d5e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034881 Aug 04 04:39:37.267199 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 44/94] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:37.523647 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d2e6388c-3e6d-45ee-b8dc-cbb1c86b4fb0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:37.524305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d2e6388c-3e6d-45ee-b8dc-cbb1c86b4fb0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:37.531125 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d2e6388c-3e6d-45ee-b8dc-cbb1c86b4fb0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:37.531576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d2e6388c-3e6d-45ee-b8dc-cbb1c86b4fb0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:37.532358 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d2e6388c-3e6d-45ee-b8dc-cbb1c86b4fb0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:37.532981 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d2e6388c-3e6d-45ee-b8dc-cbb1c86b4fb0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:37.536111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:37.679907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d2e6388c-3e6d-45ee-b8dc-cbb1c86b4fb0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:37.688191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d2e6388c-3e6d-45ee-b8dc-cbb1c86b4fb0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1362 microversion: 2.1 time: 0.168242 Aug 04 04:39:37.689021 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 51/95] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:37 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:37.974936 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-95c8bae1-7405-4b20-9a94-1ebf2b424e58 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:37.975877 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-95c8bae1-7405-4b20-9a94-1ebf2b424e58 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:37.982607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-95c8bae1-7405-4b20-9a94-1ebf2b424e58 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:37.983082 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-95c8bae1-7405-4b20-9a94-1ebf2b424e58 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:37.983852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-95c8bae1-7405-4b20-9a94-1ebf2b424e58 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:37.984279 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-95c8bae1-7405-4b20-9a94-1ebf2b424e58 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:38.131545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-95c8bae1-7405-4b20-9a94-1ebf2b424e58 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:38.139996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-95c8bae1-7405-4b20-9a94-1ebf2b424e58 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1368 microversion: 2.1 time: 0.170530 Aug 04 04:39:38.140757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 45/96] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:37 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:38.709422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-357b2964-7d33-4d7a-862f-b985c09cbf55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:38.710071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-357b2964-7d33-4d7a-862f-b985c09cbf55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:38.717476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-357b2964-7d33-4d7a-862f-b985c09cbf55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:38.717961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-357b2964-7d33-4d7a-862f-b985c09cbf55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:38.718695 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-357b2964-7d33-4d7a-862f-b985c09cbf55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:38.719122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-357b2964-7d33-4d7a-862f-b985c09cbf55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:38.859740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-357b2964-7d33-4d7a-862f-b985c09cbf55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:38.872901 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-357b2964-7d33-4d7a-862f-b985c09cbf55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1362 microversion: 2.1 time: 0.167158 Aug 04 04:39:38.873657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 52/97] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:38 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:39.166577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9d3a1049-cd7a-477f-8c0a-f4b712548d6d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:39.167200 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9d3a1049-cd7a-477f-8c0a-f4b712548d6d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:39.179290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d3a1049-cd7a-477f-8c0a-f4b712548d6d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:39.180167 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d3a1049-cd7a-477f-8c0a-f4b712548d6d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:39.181263 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d3a1049-cd7a-477f-8c0a-f4b712548d6d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:39.182016 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d3a1049-cd7a-477f-8c0a-f4b712548d6d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:39.335891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9d3a1049-cd7a-477f-8c0a-f4b712548d6d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:39.344743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9d3a1049-cd7a-477f-8c0a-f4b712548d6d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1368 microversion: 2.1 time: 0.182704 Aug 04 04:39:39.345632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 46/98] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:39 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:39.894680 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e0a8cba6-97ed-4b2c-a3a3-69f769ede255 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:39.895288 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e0a8cba6-97ed-4b2c-a3a3-69f769ede255 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:39.901405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e0a8cba6-97ed-4b2c-a3a3-69f769ede255 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:39.901901 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e0a8cba6-97ed-4b2c-a3a3-69f769ede255 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:39.902656 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e0a8cba6-97ed-4b2c-a3a3-69f769ede255 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:39.903682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e0a8cba6-97ed-4b2c-a3a3-69f769ede255 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:40.049654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e0a8cba6-97ed-4b2c-a3a3-69f769ede255 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:40.058114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e0a8cba6-97ed-4b2c-a3a3-69f769ede255 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1362 microversion: 2.1 time: 0.167041 Aug 04 04:39:40.058698 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 53/99] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:39 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:40.369471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-22bbbe7b-cdee-4371-87ec-aaa559beaa29 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:40.370119 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-22bbbe7b-cdee-4371-87ec-aaa559beaa29 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:40.377814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-22bbbe7b-cdee-4371-87ec-aaa559beaa29 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:40.378507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-22bbbe7b-cdee-4371-87ec-aaa559beaa29 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:40.381340 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-22bbbe7b-cdee-4371-87ec-aaa559beaa29 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:40.381340 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-22bbbe7b-cdee-4371-87ec-aaa559beaa29 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:40.426531 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-b74954d9-f839-4a90-a583-c35bb6ee1c05 req-6ba68b22-098c-4e62-b970-01acd3c0b355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66d5fe6-f2d3-45e8-a225-8d7d10522e92", "name": "network-vif-plugged", "status": "completed", "tag": "399fc288-7263-4519-916b-0f65a42f8c19"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:40.441391 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-b74954d9-f839-4a90-a583-c35bb6ee1c05 req-6ba68b22-098c-4e62-b970-01acd3c0b355 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:40.441391 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-b74954d9-f839-4a90-a583-c35bb6ee1c05 req-6ba68b22-098c-4e62-b970-01acd3c0b355 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:40.452542 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-b74954d9-f839-4a90-a583-c35bb6ee1c05 req-6ba68b22-098c-4e62-b970-01acd3c0b355 service nova] Creating event network-vif-plugged:399fc288-7263-4519-916b-0f65a42f8c19 for instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 on hv-cinder-85127 Aug 04 04:39:40.457949 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-b74954d9-f839-4a90-a583-c35bb6ee1c05 req-6ba68b22-098c-4e62-b970-01acd3c0b355 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035499 Aug 04 04:39:40.458711 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 54/100] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:39:40.536458 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-22bbbe7b-cdee-4371-87ec-aaa559beaa29 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:40.545579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-22bbbe7b-cdee-4371-87ec-aaa559beaa29 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1368 microversion: 2.1 time: 0.181389 Aug 04 04:39:40.546464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 47/101] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:40 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:41.081064 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-769ff09f-6a8f-4b5f-a130-b48bf452b7d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:41.082104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-769ff09f-6a8f-4b5f-a130-b48bf452b7d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:41.089975 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-769ff09f-6a8f-4b5f-a130-b48bf452b7d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:41.091071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-769ff09f-6a8f-4b5f-a130-b48bf452b7d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:41.092335 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-769ff09f-6a8f-4b5f-a130-b48bf452b7d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:41.092973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-769ff09f-6a8f-4b5f-a130-b48bf452b7d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:41.285015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-769ff09f-6a8f-4b5f-a130-b48bf452b7d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:41.295504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-769ff09f-6a8f-4b5f-a130-b48bf452b7d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1362 microversion: 2.1 time: 0.219891 Aug 04 04:39:41.303509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 55/102] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:41 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:41.567497 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b157b3ec-0718-4394-9c5f-b1075526f39d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:41.568776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b157b3ec-0718-4394-9c5f-b1075526f39d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:41.577905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b157b3ec-0718-4394-9c5f-b1075526f39d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:41.578514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b157b3ec-0718-4394-9c5f-b1075526f39d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:41.579288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b157b3ec-0718-4394-9c5f-b1075526f39d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:41.579909 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b157b3ec-0718-4394-9c5f-b1075526f39d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:41.740167 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b157b3ec-0718-4394-9c5f-b1075526f39d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:41.756005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b157b3ec-0718-4394-9c5f-b1075526f39d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1368 microversion: 2.1 time: 0.192881 Aug 04 04:39:41.756917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 48/103] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:41 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:42.319453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1b5aea28-3aa4-4e49-befe-5d82a40b9a58 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:42.320139 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1b5aea28-3aa4-4e49-befe-5d82a40b9a58 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:42.334477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1b5aea28-3aa4-4e49-befe-5d82a40b9a58 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:42.334954 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1b5aea28-3aa4-4e49-befe-5d82a40b9a58 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:42.337080 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1b5aea28-3aa4-4e49-befe-5d82a40b9a58 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:42.337531 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1b5aea28-3aa4-4e49-befe-5d82a40b9a58 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:42.711104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1b5aea28-3aa4-4e49-befe-5d82a40b9a58 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:42.722758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1b5aea28-3aa4-4e49-befe-5d82a40b9a58 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1546 microversion: 2.1 time: 0.408904 Aug 04 04:39:42.724196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 56/104] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:42 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1546 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:42.746286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ba4f622f-6313-4169-b90e-4c8d74c239d3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:42.747064 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ba4f622f-6313-4169-b90e-4c8d74c239d3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:42.761899 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ba4f622f-6313-4169-b90e-4c8d74c239d3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:42.762903 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ba4f622f-6313-4169-b90e-4c8d74c239d3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:42.769669 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ba4f622f-6313-4169-b90e-4c8d74c239d3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:42.770254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ba4f622f-6313-4169-b90e-4c8d74c239d3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:42.780468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-91623fd0-37dc-42a1-8b92-5fa3ffe9137d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:42.781203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-91623fd0-37dc-42a1-8b92-5fa3ffe9137d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:42.789075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-91623fd0-37dc-42a1-8b92-5fa3ffe9137d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:42.789917 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-91623fd0-37dc-42a1-8b92-5fa3ffe9137d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:42.790918 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-91623fd0-37dc-42a1-8b92-5fa3ffe9137d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:42.792163 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-91623fd0-37dc-42a1-8b92-5fa3ffe9137d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:42.797159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:42.979479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:43.015750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ba4f622f-6313-4169-b90e-4c8d74c239d3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.274147 Aug 04 04:39:43.016435 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 49/105] 10.222.0.47 () {58 vars in 1275 bytes} [Thu Aug 4 04:39:42 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/os-interface => generated 284 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:43.188038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-91623fd0-37dc-42a1-8b92-5fa3ffe9137d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:43.201234 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-91623fd0-37dc-42a1-8b92-5fa3ffe9137d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1368 microversion: 2.1 time: 0.426064 Aug 04 04:39:43.202120 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 57/106] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:42 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1368 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:44.224219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a3b3f526-0042-41c2-9ff6-312196378425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:44.225119 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a3b3f526-0042-41c2-9ff6-312196378425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:44.243526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3b3f526-0042-41c2-9ff6-312196378425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:44.244008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3b3f526-0042-41c2-9ff6-312196378425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:44.244849 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3b3f526-0042-41c2-9ff6-312196378425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:44.245374 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3b3f526-0042-41c2-9ff6-312196378425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:44.588433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a3b3f526-0042-41c2-9ff6-312196378425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:44.608055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a3b3f526-0042-41c2-9ff6-312196378425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1558 microversion: 2.1 time: 0.387720 Aug 04 04:39:44.609351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 50/107] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:44 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1558 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:44.631578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6b059a49-fa70-4d5f-8f52-da81cb003189 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:44.632697 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6b059a49-fa70-4d5f-8f52-da81cb003189 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:44.641766 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b059a49-fa70-4d5f-8f52-da81cb003189 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:44.642222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b059a49-fa70-4d5f-8f52-da81cb003189 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:44.643001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b059a49-fa70-4d5f-8f52-da81cb003189 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:44.647711 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b059a49-fa70-4d5f-8f52-da81cb003189 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:44.966901 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6b059a49-fa70-4d5f-8f52-da81cb003189 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.339339 Aug 04 04:39:44.968076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 58/108] 10.222.0.47 () {58 vars in 1275 bytes} [Thu Aug 4 04:39:44 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/os-interface => generated 284 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:45.402455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-4eb41e46-63c2-42df-afda-85eea5fdcbc0 req-b75b3b6b-8883-4f7c-89ac-fe9b60da77e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce02b26c-276e-4d87-9790-87a8469fac7a", "tag": "53a920ec-439a-4a5f-9d51-66dee4c91777"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:45.428703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-4eb41e46-63c2-42df-afda-85eea5fdcbc0 req-b75b3b6b-8883-4f7c-89ac-fe9b60da77e3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:45.429781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-4eb41e46-63c2-42df-afda-85eea5fdcbc0 req-b75b3b6b-8883-4f7c-89ac-fe9b60da77e3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:45.465917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-4eb41e46-63c2-42df-afda-85eea5fdcbc0 req-b75b3b6b-8883-4f7c-89ac-fe9b60da77e3 service nova] Creating event network-changed:53a920ec-439a-4a5f-9d51-66dee4c91777 for instance ce02b26c-276e-4d87-9790-87a8469fac7a on hv-cinder-85127 Aug 04 04:39:45.490585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-4eb41e46-63c2-42df-afda-85eea5fdcbc0 req-b75b3b6b-8883-4f7c-89ac-fe9b60da77e3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092211 Aug 04 04:39:45.495119 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 51/109] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:47.703932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-de90aa27-71bb-4741-8ea5-63a43a2ed167 req-9b998a01-18bb-4f83-8083-6090c7a71bbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66d5fe6-f2d3-45e8-a225-8d7d10522e92", "tag": "399fc288-7263-4519-916b-0f65a42f8c19"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:47.725790 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-de90aa27-71bb-4741-8ea5-63a43a2ed167 req-9b998a01-18bb-4f83-8083-6090c7a71bbb service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:47.727841 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-de90aa27-71bb-4741-8ea5-63a43a2ed167 req-9b998a01-18bb-4f83-8083-6090c7a71bbb service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:47.753501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-de90aa27-71bb-4741-8ea5-63a43a2ed167 req-9b998a01-18bb-4f83-8083-6090c7a71bbb service nova] Creating event network-changed:399fc288-7263-4519-916b-0f65a42f8c19 for instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 on hv-cinder-85127 Aug 04 04:39:47.764015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-de90aa27-71bb-4741-8ea5-63a43a2ed167 req-9b998a01-18bb-4f83-8083-6090c7a71bbb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064335 Aug 04 04:39:47.765677 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 59/110] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:47.825394 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-486284458", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452"}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:47.953985 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] validate_networks() for None {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:39:48.453057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:39:48.453057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:39:48.453057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:39:48.453790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:39:48.454202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:39:48.466469 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:48.467602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:48.468658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:48.469252 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:48.496004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Getting quotas for project 4f04dacfa01e42539204572c99bed3f6. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:39:48.502241 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Getting quotas for user 13679676132642b88b2c88b58c4afc55 and project 4f04dacfa01e42539204572c99bed3f6. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:39:48.517006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:39:48.521688 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:39:48.595898 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f61ce4ec-0f61-47f9-b76e-ca4dff417816 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777644 Aug 04 04:39:48.597631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 52/111] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:39:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:39:48.609622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9d24e714-2ea1-48d2-a428-a51990705f5c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:48.610586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9d24e714-2ea1-48d2-a428-a51990705f5c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:48.761625 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9d24e714-2ea1-48d2-a428-a51990705f5c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:48.771450 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9d24e714-2ea1-48d2-a428-a51990705f5c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1214 microversion: 2.1 time: 0.167203 Aug 04 04:39:48.783747 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 60/112] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:48 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:49.822883 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f5bc6d49-618a-4aa2-b995-76e591dd8265 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:49.827543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f5bc6d49-618a-4aa2-b995-76e591dd8265 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:49.840894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f5bc6d49-618a-4aa2-b995-76e591dd8265 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:49.842639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f5bc6d49-618a-4aa2-b995-76e591dd8265 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:49.844019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f5bc6d49-618a-4aa2-b995-76e591dd8265 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:49.844950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f5bc6d49-618a-4aa2-b995-76e591dd8265 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:49.946090 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f5bc6d49-618a-4aa2-b995-76e591dd8265 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:49.958112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f5bc6d49-618a-4aa2-b995-76e591dd8265 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1218 microversion: 2.1 time: 0.155554 Aug 04 04:39:49.959234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 53/113] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:49 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1218 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:39:50.983603 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d38f72d7-c9d9-4ffd-9fbf-542729385a14 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:50.984232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d38f72d7-c9d9-4ffd-9fbf-542729385a14 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:51.003057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d38f72d7-c9d9-4ffd-9fbf-542729385a14 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.004295 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d38f72d7-c9d9-4ffd-9fbf-542729385a14 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.011014 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d38f72d7-c9d9-4ffd-9fbf-542729385a14 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.013721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d38f72d7-c9d9-4ffd-9fbf-542729385a14 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.145178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d38f72d7-c9d9-4ffd-9fbf-542729385a14 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:51.156723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d38f72d7-c9d9-4ffd-9fbf-542729385a14 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1266 microversion: 2.1 time: 0.177821 Aug 04 04:39:51.162777 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 61/114] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:50 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:51.677353 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-af61283a-d6cd-4592-8111-2034a28d945c tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:51.677895 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-af61283a-d6cd-4592-8111-2034a28d945c tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:51.693894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-af61283a-d6cd-4592-8111-2034a28d945c tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.694393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-af61283a-d6cd-4592-8111-2034a28d945c tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.698963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-af61283a-d6cd-4592-8111-2034a28d945c tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.703732 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-af61283a-d6cd-4592-8111-2034a28d945c tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.776678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-af61283a-d6cd-4592-8111-2034a28d945c tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Going to try to terminate instance {{(pid=134883) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:39:51.922154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-af61283a-d6cd-4592-8111-2034a28d945c tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 204 len: 0 microversion: 2.1 time: 0.248345 Aug 04 04:39:51.923136 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 54/115] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:39:51 2022] DELETE /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:39:51.932072 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-98d00952-0896-48e4-ab76-1aa70e96a876 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:51.932791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-98d00952-0896-48e4-ab76-1aa70e96a876 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:51.946116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98d00952-0896-48e4-ab76-1aa70e96a876 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.946847 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98d00952-0896-48e4-ab76-1aa70e96a876 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:51.948936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98d00952-0896-48e4-ab76-1aa70e96a876 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:51.951139 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98d00952-0896-48e4-ab76-1aa70e96a876 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:52.141430 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-98d00952-0896-48e4-ab76-1aa70e96a876 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:52.151241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-98d00952-0896-48e4-ab76-1aa70e96a876 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1552 microversion: 2.1 time: 0.223926 Aug 04 04:39:52.162057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 62/116] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:51 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1552 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:52.181514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0a2f1a9e-04fd-4029-b834-350b8f5f1c7d tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:52.184163 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0a2f1a9e-04fd-4029-b834-350b8f5f1c7d tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:52.197844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a2f1a9e-04fd-4029-b834-350b8f5f1c7d tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:52.198914 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a2f1a9e-04fd-4029-b834-350b8f5f1c7d tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:52.199955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a2f1a9e-04fd-4029-b834-350b8f5f1c7d tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:52.202076 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a2f1a9e-04fd-4029-b834-350b8f5f1c7d tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:52.277507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0a2f1a9e-04fd-4029-b834-350b8f5f1c7d tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:52.287314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0a2f1a9e-04fd-4029-b834-350b8f5f1c7d tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1272 microversion: 2.1 time: 0.110205 Aug 04 04:39:52.287917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 55/117] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:52 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:53.173836 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-136bf208-7101-4c31-a01d-c0641bd5446d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:53.174506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-136bf208-7101-4c31-a01d-c0641bd5446d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:53.180669 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-136bf208-7101-4c31-a01d-c0641bd5446d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:53.181145 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-136bf208-7101-4c31-a01d-c0641bd5446d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:53.182121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-136bf208-7101-4c31-a01d-c0641bd5446d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:53.182558 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-136bf208-7101-4c31-a01d-c0641bd5446d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:53.310425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-83cc2e30-7d15-4554-9f25-9b688ada50cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:53.311647 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-83cc2e30-7d15-4554-9f25-9b688ada50cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:53.319498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83cc2e30-7d15-4554-9f25-9b688ada50cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:53.320524 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83cc2e30-7d15-4554-9f25-9b688ada50cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:53.321877 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83cc2e30-7d15-4554-9f25-9b688ada50cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:53.322530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83cc2e30-7d15-4554-9f25-9b688ada50cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:53.388041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-136bf208-7101-4c31-a01d-c0641bd5446d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:53.405125 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-136bf208-7101-4c31-a01d-c0641bd5446d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1552 microversion: 2.1 time: 0.234858 Aug 04 04:39:53.406723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 63/118] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:53 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1552 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:53.407535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-83cc2e30-7d15-4554-9f25-9b688ada50cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:53.415881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-83cc2e30-7d15-4554-9f25-9b688ada50cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1272 microversion: 2.1 time: 0.110210 Aug 04 04:39:53.428368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 56/119] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:53 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:54.430243 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cc5ccf83-475b-44fe-a307-06d6f67b348f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:54.431661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cc5ccf83-475b-44fe-a307-06d6f67b348f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:54.440262 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c547e170-d818-4e92-9754-4dcceb7ad965 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:54.441093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c547e170-d818-4e92-9754-4dcceb7ad965 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:54.443557 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cc5ccf83-475b-44fe-a307-06d6f67b348f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:54.445205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cc5ccf83-475b-44fe-a307-06d6f67b348f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.446554 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cc5ccf83-475b-44fe-a307-06d6f67b348f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:54.447367 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cc5ccf83-475b-44fe-a307-06d6f67b348f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.454631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c547e170-d818-4e92-9754-4dcceb7ad965 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:54.456742 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c547e170-d818-4e92-9754-4dcceb7ad965 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.457881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c547e170-d818-4e92-9754-4dcceb7ad965 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:54.459288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c547e170-d818-4e92-9754-4dcceb7ad965 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:54.614517 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c547e170-d818-4e92-9754-4dcceb7ad965 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:54.624220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c547e170-d818-4e92-9754-4dcceb7ad965 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1272 microversion: 2.1 time: 0.187646 Aug 04 04:39:54.625757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 57/120] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:54 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:54.703614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-cc5ccf83-475b-44fe-a307-06d6f67b348f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:54.716366 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cc5ccf83-475b-44fe-a307-06d6f67b348f tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1552 microversion: 2.1 time: 0.292769 Aug 04 04:39:54.718374 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 64/121] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:54 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1552 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:55.648650 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b516d1ff-9d30-44d3-ba42-93e50e12719c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:55.650077 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b516d1ff-9d30-44d3-ba42-93e50e12719c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:55.659507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b516d1ff-9d30-44d3-ba42-93e50e12719c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:55.660212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b516d1ff-9d30-44d3-ba42-93e50e12719c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:55.661425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b516d1ff-9d30-44d3-ba42-93e50e12719c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:55.662122 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b516d1ff-9d30-44d3-ba42-93e50e12719c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:55.745031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5a1459fa-ec57-450e-9890-ef96e8606380 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:55.749168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5a1459fa-ec57-450e-9890-ef96e8606380 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:55.753856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=64 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:55.773161 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a1459fa-ec57-450e-9890-ef96e8606380 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:55.773735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a1459fa-ec57-450e-9890-ef96e8606380 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:55.776081 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a1459fa-ec57-450e-9890-ef96e8606380 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:55.776641 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a1459fa-ec57-450e-9890-ef96e8606380 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:56.450604 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b516d1ff-9d30-44d3-ba42-93e50e12719c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:56.464216 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b516d1ff-9d30-44d3-ba42-93e50e12719c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1314 microversion: 2.1 time: 0.815474 Aug 04 04:39:56.468959 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 58/122] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:55 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:56.513885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5a1459fa-ec57-450e-9890-ef96e8606380 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:56.530301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5a1459fa-ec57-450e-9890-ef96e8606380 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1552 microversion: 2.1 time: 0.790405 Aug 04 04:39:56.532790 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 65/123] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:55 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1552 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:56.985539 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-671b6445-7351-4700-8f37-84f32f9c9b81 req-fbeda280-d79d-428e-a313-58a9dee053ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b78c6e-0f44-4c3f-bee2-ea84b333101b", "name": "network-vif-deleted", "tag": "2ae96030-5622-4eb9-869d-3624c736cd89"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:57.006834 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:57.013766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-671b6445-7351-4700-8f37-84f32f9c9b81 req-fbeda280-d79d-428e-a313-58a9dee053ae service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:57.013871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-671b6445-7351-4700-8f37-84f32f9c9b81 req-fbeda280-d79d-428e-a313-58a9dee053ae service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:57.049128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-671b6445-7351-4700-8f37-84f32f9c9b81 req-fbeda280-d79d-428e-a313-58a9dee053ae service nova] Creating event network-vif-deleted:2ae96030-5622-4eb9-869d-3624c736cd89 for instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b on hv-cinder-85127 Aug 04 04:39:57.080858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-671b6445-7351-4700-8f37-84f32f9c9b81 req-fbeda280-d79d-428e-a313-58a9dee053ae service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078813 Aug 04 04:39:57.085691 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 59/124] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:57.495335 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fad1966c-0c3a-4880-8682-56382b6fd201 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:57.498090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fad1966c-0c3a-4880-8682-56382b6fd201 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:57.505832 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fad1966c-0c3a-4880-8682-56382b6fd201 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:57.506908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fad1966c-0c3a-4880-8682-56382b6fd201 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:57.509429 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fad1966c-0c3a-4880-8682-56382b6fd201 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:57.510090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fad1966c-0c3a-4880-8682-56382b6fd201 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:57.561281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0dc792a8-e761-4a54-b4e5-d0a912805bc4 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:57.562013 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0dc792a8-e761-4a54-b4e5-d0a912805bc4 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:57.574234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0dc792a8-e761-4a54-b4e5-d0a912805bc4 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:57.575633 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0dc792a8-e761-4a54-b4e5-d0a912805bc4 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:57.577627 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0dc792a8-e761-4a54-b4e5-d0a912805bc4 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:57.578616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0dc792a8-e761-4a54-b4e5-d0a912805bc4 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:57.696259 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0dc792a8-e761-4a54-b4e5-d0a912805bc4 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d00c09d8374f59ac1260ade95be9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89819385e8b42bb89e40449dd21ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:57.710122 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0dc792a8-e761-4a54-b4e5-d0a912805bc4 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 200 len: 1344 microversion: 2.1 time: 0.154022 Aug 04 04:39:57.711349 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 60/125] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:57 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 1344 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:57.717853 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-bc30f397-7136-4242-bff9-e2f32e0abee8 req-3594be56-c2a6-4b57-93f7-45061a5ee1ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa53eb23-31e0-4e0e-9329-f38f1d64bbe2", "tag": "ff13f058-d1c0-4c2f-8d2a-208f89919f0f"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:39:57.733352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-bc30f397-7136-4242-bff9-e2f32e0abee8 req-3594be56-c2a6-4b57-93f7-45061a5ee1ed service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:57.734062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-bc30f397-7136-4242-bff9-e2f32e0abee8 req-3594be56-c2a6-4b57-93f7-45061a5ee1ed service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:57.755471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-bc30f397-7136-4242-bff9-e2f32e0abee8 req-3594be56-c2a6-4b57-93f7-45061a5ee1ed service nova] Creating event network-changed:ff13f058-d1c0-4c2f-8d2a-208f89919f0f for instance aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 on hv-cinder-85127 Aug 04 04:39:57.761855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-bc30f397-7136-4242-bff9-e2f32e0abee8 req-3594be56-c2a6-4b57-93f7-45061a5ee1ed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048224 Aug 04 04:39:57.763144 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 61/126] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:39:57.782972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fad1966c-0c3a-4880-8682-56382b6fd201 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:57.790903 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fad1966c-0c3a-4880-8682-56382b6fd201 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1314 microversion: 2.1 time: 0.302780 Aug 04 04:39:57.791489 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 66/127] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:57 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:39:58.737316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5169a2f3-886d-4b1a-b4eb-16e4438a690e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:58.741754 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5169a2f3-886d-4b1a-b4eb-16e4438a690e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:58.746252 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:58.747706 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=6 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:58.758832 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5169a2f3-886d-4b1a-b4eb-16e4438a690e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:58.759772 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5169a2f3-886d-4b1a-b4eb-16e4438a690e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:58.762847 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5169a2f3-886d-4b1a-b4eb-16e4438a690e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:58.769496 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5169a2f3-886d-4b1a-b4eb-16e4438a690e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:58.794431 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-5169a2f3-886d-4b1a-b4eb-16e4438a690e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] HTTP exception thrown: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5169a2f3-886d-4b1a-b4eb-16e4438a690e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Request method failure captured: Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b HTTP/1.1 Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi601fh31SmT1vN4P-gPxHm8Afc325sZsC22puy4-8TZpWKyNmOvLapvW1rEUtNmnbaXPNJImTm5kss8D9T9VudR0gw0_s98ZVmLnc-AzZfwKY8zHQULIihoTYNzg8IiihKWHBKOAJiv1RsgkXgtvUPvDWzg9S3CIICUEMP8civX8j6M8 Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: a89819385e8b42bb89e40449dd21ca86 Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-DeleteServersTestJSON-1697200487 Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 04:39:58.800798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 04:39:58.802327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a89819385e8b42bb89e40449dd21ca86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89819385e8b42bb89e40449dd21ca86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a89819385e8b42bb89e40449dd21ca86", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89819385e8b42bb89e40449dd21ca86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:39:58.802327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-DeleteServersTestJSON-1697200487 Aug 04 04:39:58.802327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: a89819385e8b42bb89e40449dd21ca86 Aug 04 04:39:58.802327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-DeleteServersTestJSON-1697200487 Aug 04 04:39:58.802327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-DeleteServersTestJSON-1697200487-project Aug 04 04:39:58.802327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 04:39:58.802327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 04:39:58.802327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 99d00c09d8374f59ac1260ade95be9ec Aug 04 04:39:58.802327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-DeleteServersTestJSON-1697200487-project Aug 04 04:39:58.802327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 04:39:58.802327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:39:58.802327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': 'f3b78c6e-0f44-4c3f-bee2-ea84b333101b'} Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:39:58.803169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:39:58.804456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:39:58.808616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5169a2f3-886d-4b1a-b4eb-16e4438a690e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Returning 404 to user: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:39:58.809916 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5169a2f3-886d-4b1a-b4eb-16e4438a690e tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 404 len: 111 microversion: 2.1 time: 0.080299 Aug 04 04:39:58.810642 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 62/128] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:58 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:39:58.817682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8bb067cb-f887-42cf-bd7d-3d9cd03ab4cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:58.818727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8bb067cb-f887-42cf-bd7d-3d9cd03ab4cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:58.822582 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:39:58.835390 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8bb067cb-f887-42cf-bd7d-3d9cd03ab4cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:58.837416 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8bb067cb-f887-42cf-bd7d-3d9cd03ab4cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:58.841106 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8bb067cb-f887-42cf-bd7d-3d9cd03ab4cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:58.843379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8bb067cb-f887-42cf-bd7d-3d9cd03ab4cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:58.989260 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0c356980-a7f9-4547-8ac8-865e0a7b703d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:39:58.991477 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0c356980-a7f9-4547-8ac8-865e0a7b703d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:39:58.998860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c356980-a7f9-4547-8ac8-865e0a7b703d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:58.999308 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c356980-a7f9-4547-8ac8-865e0a7b703d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:59.000084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c356980-a7f9-4547-8ac8-865e0a7b703d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:39:59.000517 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c356980-a7f9-4547-8ac8-865e0a7b703d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:39:59.016053 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-0c356980-a7f9-4547-8ac8-865e0a7b703d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] HTTP exception thrown: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0c356980-a7f9-4547-8ac8-865e0a7b703d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Request method failure captured: Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b/os-volume_attachments HTTP/1.1 Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi601fh31SmT1vN4P-gPxHm8Afc325sZsC22puy4-8TZpWKyNmOvLapvW1rEUtNmnbaXPNJImTm5kss8D9T9VudR0gw0_s98ZVmLnc-AzZfwKY8zHQULIihoTYNzg8IiihKWHBKOAJiv1RsgkXgtvUPvDWzg9S3CIICUEMP8civX8j6M8 Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: a89819385e8b42bb89e40449dd21ca86 Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-DeleteServersTestJSON-1697200487 Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 04:39:59.018181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 04:39:59.019558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a89819385e8b42bb89e40449dd21ca86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89819385e8b42bb89e40449dd21ca86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a89819385e8b42bb89e40449dd21ca86", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89819385e8b42bb89e40449dd21ca86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:39:59.019558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-DeleteServersTestJSON-1697200487 Aug 04 04:39:59.019558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: a89819385e8b42bb89e40449dd21ca86 Aug 04 04:39:59.019558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-DeleteServersTestJSON-1697200487 Aug 04 04:39:59.019558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-DeleteServersTestJSON-1697200487-project Aug 04 04:39:59.019558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 04:39:59.019558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 04:39:59.019558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 99d00c09d8374f59ac1260ade95be9ec Aug 04 04:39:59.019558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-DeleteServersTestJSON-1697200487-project Aug 04 04:39:59.019558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 04:39:59.019558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:39:59.019558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'server_id': 'f3b78c6e-0f44-4c3f-bee2-ea84b333101b'} Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:39:59.020325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:39:59.021534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:39:59.022795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0c356980-a7f9-4547-8ac8-865e0a7b703d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Returning 404 to user: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:39:59.022795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0c356980-a7f9-4547-8ac8-865e0a7b703d tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034945 Aug 04 04:39:59.022795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 63/129] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:39:58 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:39:59.329812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8bb067cb-f887-42cf-bd7d-3d9cd03ab4cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:39:59.333928 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8bb067cb-f887-42cf-bd7d-3d9cd03ab4cc tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1314 microversion: 2.1 time: 0.525470 Aug 04 04:39:59.334580 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 67/130] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:39:58 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:00.360415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-984a444e-8a7a-4622-8c19-f369c808700c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:00.362910 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-984a444e-8a7a-4622-8c19-f369c808700c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:00.375293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7da7c627-f2a3-456a-8cfc-379c08cd98c3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:00.375805 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7da7c627-f2a3-456a-8cfc-379c08cd98c3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:00.379300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-984a444e-8a7a-4622-8c19-f369c808700c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:00.379753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-984a444e-8a7a-4622-8c19-f369c808700c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:00.384796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-984a444e-8a7a-4622-8c19-f369c808700c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:00.384971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7da7c627-f2a3-456a-8cfc-379c08cd98c3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:00.385829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-984a444e-8a7a-4622-8c19-f369c808700c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:00.385962 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7da7c627-f2a3-456a-8cfc-379c08cd98c3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:00.387733 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7da7c627-f2a3-456a-8cfc-379c08cd98c3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:00.388515 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7da7c627-f2a3-456a-8cfc-379c08cd98c3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:00.418226 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-7da7c627-f2a3-456a-8cfc-379c08cd98c3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] HTTP exception thrown: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7da7c627-f2a3-456a-8cfc-379c08cd98c3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Request method failure captured: Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: DELETE /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b HTTP/1.1 Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601fh31SmT1vN4P-gPxHm8Afc325sZsC22puy4-8TZpWKyNmOvLapvW1rEUtNmnbaXPNJImTm5kss8D9T9VudR0gw0_s98ZVmLnc-AzZfwKY8zHQULIihoTYNzg8IiihKWHBKOAJiv1RsgkXgtvUPvDWzg9S3CIICUEMP8civX8j6M8 Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: a89819385e8b42bb89e40449dd21ca86 Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-DeleteServersTestJSON-1697200487 Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:40:00.426574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:40:00.428476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a89819385e8b42bb89e40449dd21ca86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89819385e8b42bb89e40449dd21ca86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a89819385e8b42bb89e40449dd21ca86", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89819385e8b42bb89e40449dd21ca86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:40:00.428476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-DeleteServersTestJSON-1697200487 Aug 04 04:40:00.428476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: a89819385e8b42bb89e40449dd21ca86 Aug 04 04:40:00.428476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-DeleteServersTestJSON-1697200487 Aug 04 04:40:00.428476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-DeleteServersTestJSON-1697200487-project Aug 04 04:40:00.428476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:40:00.428476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:40:00.428476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 99d00c09d8374f59ac1260ade95be9ec Aug 04 04:40:00.428476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-DeleteServersTestJSON-1697200487-project Aug 04 04:40:00.428476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 04:40:00.428476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:40:00.428476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'f3b78c6e-0f44-4c3f-bee2-ea84b333101b'} Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:00.429131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:40:00.430167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:00.431302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7da7c627-f2a3-456a-8cfc-379c08cd98c3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Returning 404 to user: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:00.431302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7da7c627-f2a3-456a-8cfc-379c08cd98c3 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 404 len: 111 microversion: 2.1 time: 0.058959 Aug 04 04:40:00.431302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 68/131] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:40:00 2022] DELETE /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:40:00.444603 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a4210a89-4b29-47ec-86a6-b4f7b66d3a14 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:00.446194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a4210a89-4b29-47ec-86a6-b4f7b66d3a14 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] [instance: f3b78c6e-0f44-4c3f-bee2-ea84b333101b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:00.469646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4210a89-4b29-47ec-86a6-b4f7b66d3a14 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:00.471138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4210a89-4b29-47ec-86a6-b4f7b66d3a14 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:00.472204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4210a89-4b29-47ec-86a6-b4f7b66d3a14 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:00.473449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4210a89-4b29-47ec-86a6-b4f7b66d3a14 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:00.506338 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-a4210a89-4b29-47ec-86a6-b4f7b66d3a14 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] HTTP exception thrown: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a4210a89-4b29-47ec-86a6-b4f7b66d3a14 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Request method failure captured: Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b HTTP/1.1 Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601fh31SmT1vN4P-gPxHm8Afc325sZsC22puy4-8TZpWKyNmOvLapvW1rEUtNmnbaXPNJImTm5kss8D9T9VudR0gw0_s98ZVmLnc-AzZfwKY8zHQULIihoTYNzg8IiihKWHBKOAJiv1RsgkXgtvUPvDWzg9S3CIICUEMP8civX8j6M8 Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: a89819385e8b42bb89e40449dd21ca86 Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-DeleteServersTestJSON-1697200487 Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:40:00.509397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:40:00.510824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a89819385e8b42bb89e40449dd21ca86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89819385e8b42bb89e40449dd21ca86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a89819385e8b42bb89e40449dd21ca86", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89819385e8b42bb89e40449dd21ca86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:40:00.510824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-DeleteServersTestJSON-1697200487 Aug 04 04:40:00.510824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: a89819385e8b42bb89e40449dd21ca86 Aug 04 04:40:00.510824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-DeleteServersTestJSON-1697200487 Aug 04 04:40:00.510824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-DeleteServersTestJSON-1697200487-project Aug 04 04:40:00.510824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:40:00.510824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:40:00.510824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 99d00c09d8374f59ac1260ade95be9ec Aug 04 04:40:00.510824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-DeleteServersTestJSON-1697200487-project Aug 04 04:40:00.510824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 04:40:00.510824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:40:00.510824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'f3b78c6e-0f44-4c3f-bee2-ea84b333101b'} Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:00.511729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. Aug 04 04:40:00.512749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:00.513678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a4210a89-4b29-47ec-86a6-b4f7b66d3a14 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] Returning 404 to user: Instance f3b78c6e-0f44-4c3f-bee2-ea84b333101b could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:00.515119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a4210a89-4b29-47ec-86a6-b4f7b66d3a14 tempest-DeleteServersTestJSON-1697200487 tempest-DeleteServersTestJSON-1697200487-project] 10.222.0.47 "GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b" status: 404 len: 111 microversion: 2.1 time: 0.077870 Aug 04 04:40:00.516926 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 69/132] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:00 2022] GET /compute/v2.1/servers/f3b78c6e-0f44-4c3f-bee2-ea84b333101b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:40:00.661785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-984a444e-8a7a-4622-8c19-f369c808700c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:00.674628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-984a444e-8a7a-4622-8c19-f369c808700c tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1314 microversion: 2.1 time: 0.320695 Aug 04 04:40:00.675781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 64/133] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:00 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:01.700616 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-409d7015-dd22-42ec-a9c1-00463f7c95e1 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:01.701413 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-409d7015-dd22-42ec-a9c1-00463f7c95e1 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:01.709312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-409d7015-dd22-42ec-a9c1-00463f7c95e1 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:01.710034 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-409d7015-dd22-42ec-a9c1-00463f7c95e1 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:01.712080 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-409d7015-dd22-42ec-a9c1-00463f7c95e1 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:01.712831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-409d7015-dd22-42ec-a9c1-00463f7c95e1 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:01.892827 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-409d7015-dd22-42ec-a9c1-00463f7c95e1 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:01.902841 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-409d7015-dd22-42ec-a9c1-00463f7c95e1 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1314 microversion: 2.1 time: 0.206316 Aug 04 04:40:01.917294 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 70/134] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:01 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:02.578543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2038276277", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "networks": [{"uuid": "87c3a83a-edef-4e74-924c-63cb4e317fa7"}]}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:02.665301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] validate_networks() for [('87c3a83a-edef-4e74-924c-63cb4e317fa7', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:40:02.923999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-908176fc-ca20-4829-b290-0bd6c8a62322 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:02.924607 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-908176fc-ca20-4829-b290-0bd6c8a62322 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:02.935318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-908176fc-ca20-4829-b290-0bd6c8a62322 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:02.944764 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-908176fc-ca20-4829-b290-0bd6c8a62322 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:02.946058 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-908176fc-ca20-4829-b290-0bd6c8a62322 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:02.946645 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-908176fc-ca20-4829-b290-0bd6c8a62322 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:03.293193 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-908176fc-ca20-4829-b290-0bd6c8a62322 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:03.295947 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:03.309709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-908176fc-ca20-4829-b290-0bd6c8a62322 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1314 microversion: 2.1 time: 0.389480 Aug 04 04:40:03.325839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 71/135] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:02 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:03.549727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:40:03.550313 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:40:03.551350 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:40:03.553837 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:40:03.556316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:40:03.584531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:03.585120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:03.589858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:03.590716 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:03.621796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Getting quotas for project 23ec86581683456b8c52c649eed292e7. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:03.628294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Getting quotas for user 1b23dd1311554910a19399aa74df9e4c and project 23ec86581683456b8c52c649eed292e7. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:03.644387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:40:03.647439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:40:03.720491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-03df9760-0893-43cf-8aea-d7b21aaff3c2 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.145700 Aug 04 04:40:03.727113 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 65/136] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:40:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:40:03.741636 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-051243e3-b332-4fa5-bfe8-de02d3ca9cfe tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:03.742260 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-051243e3-b332-4fa5-bfe8-de02d3ca9cfe tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:03.856472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-051243e3-b332-4fa5-bfe8-de02d3ca9cfe tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:03.870019 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-051243e3-b332-4fa5-bfe8-de02d3ca9cfe tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1214 microversion: 2.1 time: 0.135786 Aug 04 04:40:03.870709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 72/137] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:03 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:04.333998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-481c9957-91c1-44ab-963a-81e851eb3d59 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:04.334416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-481c9957-91c1-44ab-963a-81e851eb3d59 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:04.343769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-481c9957-91c1-44ab-963a-81e851eb3d59 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:04.344467 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-481c9957-91c1-44ab-963a-81e851eb3d59 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:04.345447 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-481c9957-91c1-44ab-963a-81e851eb3d59 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:04.346189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-481c9957-91c1-44ab-963a-81e851eb3d59 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:04.563114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-481c9957-91c1-44ab-963a-81e851eb3d59 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:04.574478 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-481c9957-91c1-44ab-963a-81e851eb3d59 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1314 microversion: 2.1 time: 0.244420 Aug 04 04:40:04.575491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 66/138] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:04 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:04.892523 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-58bc8848-684a-4194-ade0-65f3065a5cad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:04.893742 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-58bc8848-684a-4194-ade0-65f3065a5cad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:04.902343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-58bc8848-684a-4194-ade0-65f3065a5cad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:04.903216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-58bc8848-684a-4194-ade0-65f3065a5cad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:04.904160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-58bc8848-684a-4194-ade0-65f3065a5cad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:04.904763 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-58bc8848-684a-4194-ade0-65f3065a5cad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:05.006185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-58bc8848-684a-4194-ade0-65f3065a5cad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:05.025932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-58bc8848-684a-4194-ade0-65f3065a5cad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1218 microversion: 2.1 time: 0.138456 Aug 04 04:40:05.026953 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 73/139] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:04 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:05.598586 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0d767753-d4f1-470d-9498-d875c077f28a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:05.599324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0d767753-d4f1-470d-9498-d875c077f28a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:05.607422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d767753-d4f1-470d-9498-d875c077f28a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:05.608008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d767753-d4f1-470d-9498-d875c077f28a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:05.608923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d767753-d4f1-470d-9498-d875c077f28a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:05.609463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d767753-d4f1-470d-9498-d875c077f28a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:05.657195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-1d9aedfb-1701-4118-a673-64a5073d93de req-2e4a3d4f-dfb6-4aa0-82ee-914db647980b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa53eb23-31e0-4e0e-9329-f38f1d64bbe2", "name": "network-vif-plugged", "status": "completed", "tag": "ff13f058-d1c0-4c2f-8d2a-208f89919f0f"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:05.679392 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-1d9aedfb-1701-4118-a673-64a5073d93de req-2e4a3d4f-dfb6-4aa0-82ee-914db647980b service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:05.679936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-1d9aedfb-1701-4118-a673-64a5073d93de req-2e4a3d4f-dfb6-4aa0-82ee-914db647980b service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:05.695491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-1d9aedfb-1701-4118-a673-64a5073d93de req-2e4a3d4f-dfb6-4aa0-82ee-914db647980b service nova] Creating event network-vif-plugged:ff13f058-d1c0-4c2f-8d2a-208f89919f0f for instance aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 on hv-cinder-85127 Aug 04 04:40:05.701993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-1d9aedfb-1701-4118-a673-64a5073d93de req-2e4a3d4f-dfb6-4aa0-82ee-914db647980b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054068 Aug 04 04:40:05.703302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 74/140] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:40:05.954541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0d767753-d4f1-470d-9498-d875c077f28a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:05.964760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0d767753-d4f1-470d-9498-d875c077f28a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1314 microversion: 2.1 time: 0.370339 Aug 04 04:40:05.965415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 67/141] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:05 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:06.060758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2de4834f-1b14-452d-ab59-c9d37e164988 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:06.062923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2de4834f-1b14-452d-ab59-c9d37e164988 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:06.075057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2de4834f-1b14-452d-ab59-c9d37e164988 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:06.075656 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2de4834f-1b14-452d-ab59-c9d37e164988 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:06.076921 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2de4834f-1b14-452d-ab59-c9d37e164988 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:06.078026 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2de4834f-1b14-452d-ab59-c9d37e164988 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:06.394092 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2de4834f-1b14-452d-ab59-c9d37e164988 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:06.402680 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2de4834f-1b14-452d-ab59-c9d37e164988 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1210 microversion: 2.1 time: 0.353521 Aug 04 04:40:06.403672 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 75/142] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:06 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1210 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:07.002799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-70ebb5be-3624-47c9-9440-6c5e583da00a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:07.004045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-70ebb5be-3624-47c9-9440-6c5e583da00a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:07.013982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-70ebb5be-3624-47c9-9440-6c5e583da00a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:07.014498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-70ebb5be-3624-47c9-9440-6c5e583da00a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:07.015554 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-70ebb5be-3624-47c9-9440-6c5e583da00a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:07.016083 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-70ebb5be-3624-47c9-9440-6c5e583da00a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:07.222089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-70ebb5be-3624-47c9-9440-6c5e583da00a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:07.237344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-70ebb5be-3624-47c9-9440-6c5e583da00a tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1314 microversion: 2.1 time: 0.238693 Aug 04 04:40:07.238533 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 68/143] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:06 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:07.425353 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-18502eec-ecf0-4b41-b91a-83e9c54e20ee tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:07.426090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-18502eec-ecf0-4b41-b91a-83e9c54e20ee tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:07.437127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18502eec-ecf0-4b41-b91a-83e9c54e20ee tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:07.438550 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18502eec-ecf0-4b41-b91a-83e9c54e20ee tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:07.440750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18502eec-ecf0-4b41-b91a-83e9c54e20ee tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:07.444339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18502eec-ecf0-4b41-b91a-83e9c54e20ee tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:07.548419 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-18502eec-ecf0-4b41-b91a-83e9c54e20ee tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:07.561091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-18502eec-ecf0-4b41-b91a-83e9c54e20ee tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1272 microversion: 2.1 time: 0.140069 Aug 04 04:40:07.562367 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 76/144] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:07 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1272 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:08.258702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3fbe679f-3bcc-4374-b0b3-eb74881d0c12 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:08.259316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3fbe679f-3bcc-4374-b0b3-eb74881d0c12 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:08.268347 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3fbe679f-3bcc-4374-b0b3-eb74881d0c12 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:08.278773 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3fbe679f-3bcc-4374-b0b3-eb74881d0c12 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:08.280047 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3fbe679f-3bcc-4374-b0b3-eb74881d0c12 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:08.280622 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3fbe679f-3bcc-4374-b0b3-eb74881d0c12 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:08.304601 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:08.469877 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3fbe679f-3bcc-4374-b0b3-eb74881d0c12 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:08.479563 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3fbe679f-3bcc-4374-b0b3-eb74881d0c12 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1314 microversion: 2.1 time: 0.224333 Aug 04 04:40:08.480601 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 69/145] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:08 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:08.582701 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8a829ad0-0289-4322-a632-d547944050a0 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:08.583476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8a829ad0-0289-4322-a632-d547944050a0 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:08.597833 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a829ad0-0289-4322-a632-d547944050a0 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:08.598531 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a829ad0-0289-4322-a632-d547944050a0 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:08.599485 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a829ad0-0289-4322-a632-d547944050a0 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:08.600070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a829ad0-0289-4322-a632-d547944050a0 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:08.806558 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8a829ad0-0289-4322-a632-d547944050a0 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:08.818230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8a829ad0-0289-4322-a632-d547944050a0 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1314 microversion: 2.1 time: 0.239845 Aug 04 04:40:08.819525 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 77/146] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:08 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:09.508385 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a0a709ac-4590-4d02-a5bb-372a2adbd634 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:09.521265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a0a709ac-4590-4d02-a5bb-372a2adbd634 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:09.535880 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0a709ac-4590-4d02-a5bb-372a2adbd634 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:09.536599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0a709ac-4590-4d02-a5bb-372a2adbd634 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:09.537651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0a709ac-4590-4d02-a5bb-372a2adbd634 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:09.538239 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0a709ac-4590-4d02-a5bb-372a2adbd634 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:09.817187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a0a709ac-4590-4d02-a5bb-372a2adbd634 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:09.832915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a0a709ac-4590-4d02-a5bb-372a2adbd634 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1314 microversion: 2.1 time: 0.336907 Aug 04 04:40:09.833511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 70/147] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:09 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:09.843232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9cde573a-8e72-4878-afe7-6fdcc45d8088 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:09.844417 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9cde573a-8e72-4878-afe7-6fdcc45d8088 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:09.852735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9cde573a-8e72-4878-afe7-6fdcc45d8088 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:09.853419 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9cde573a-8e72-4878-afe7-6fdcc45d8088 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:09.855130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9cde573a-8e72-4878-afe7-6fdcc45d8088 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:09.856102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9cde573a-8e72-4878-afe7-6fdcc45d8088 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:10.123317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9cde573a-8e72-4878-afe7-6fdcc45d8088 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:10.131743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9cde573a-8e72-4878-afe7-6fdcc45d8088 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1314 microversion: 2.1 time: 0.295268 Aug 04 04:40:10.132723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 78/148] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:09 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:10.857790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5f6ac3c6-2321-4c25-a6c7-0089f1db7f8f tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:10.858540 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5f6ac3c6-2321-4c25-a6c7-0089f1db7f8f tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:10.865801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5f6ac3c6-2321-4c25-a6c7-0089f1db7f8f tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:10.866219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5f6ac3c6-2321-4c25-a6c7-0089f1db7f8f tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:10.867377 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5f6ac3c6-2321-4c25-a6c7-0089f1db7f8f tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:10.867701 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5f6ac3c6-2321-4c25-a6c7-0089f1db7f8f tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:11.031105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5f6ac3c6-2321-4c25-a6c7-0089f1db7f8f tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:11.047504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5f6ac3c6-2321-4c25-a6c7-0089f1db7f8f tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1314 microversion: 2.1 time: 0.194884 Aug 04 04:40:11.048321 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 71/149] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:10 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:11.155052 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-88519cc0-f5a4-4431-b490-b905508a9bca tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:11.156309 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-88519cc0-f5a4-4431-b490-b905508a9bca tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:11.163004 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88519cc0-f5a4-4431-b490-b905508a9bca tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:11.163597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88519cc0-f5a4-4431-b490-b905508a9bca tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:11.164591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88519cc0-f5a4-4431-b490-b905508a9bca tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:11.165251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88519cc0-f5a4-4431-b490-b905508a9bca tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:11.381533 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-efd391b8-9f58-453c-bebb-c1584fb4b8d0 req-c4ae95c5-b897-4d02-91bf-241368ea3e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc1a461-2936-44e5-b56f-2e94b0946d63", "tag": "8bfec917-6543-4aeb-9b73-d30bfeddeaee"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:11.406154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-efd391b8-9f58-453c-bebb-c1584fb4b8d0 req-c4ae95c5-b897-4d02-91bf-241368ea3e46 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:11.406597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-efd391b8-9f58-453c-bebb-c1584fb4b8d0 req-c4ae95c5-b897-4d02-91bf-241368ea3e46 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:11.435566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-efd391b8-9f58-453c-bebb-c1584fb4b8d0 req-c4ae95c5-b897-4d02-91bf-241368ea3e46 service nova] Creating event network-changed:8bfec917-6543-4aeb-9b73-d30bfeddeaee for instance 4cc1a461-2936-44e5-b56f-2e94b0946d63 on hv-cinder-85127 Aug 04 04:40:11.442091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-88519cc0-f5a4-4431-b490-b905508a9bca tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:11.445767 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-efd391b8-9f58-453c-bebb-c1584fb4b8d0 req-c4ae95c5-b897-4d02-91bf-241368ea3e46 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067760 Aug 04 04:40:11.446374 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 72/150] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:40:11.453713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-88519cc0-f5a4-4431-b490-b905508a9bca tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1314 microversion: 2.1 time: 0.303486 Aug 04 04:40:11.454303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 79/151] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:11 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:12.072558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d84641b1-7dce-412e-a269-9f6efe2f1661 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:12.074930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d84641b1-7dce-412e-a269-9f6efe2f1661 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:12.083830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d84641b1-7dce-412e-a269-9f6efe2f1661 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:12.084279 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d84641b1-7dce-412e-a269-9f6efe2f1661 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.085067 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d84641b1-7dce-412e-a269-9f6efe2f1661 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:12.085510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d84641b1-7dce-412e-a269-9f6efe2f1661 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.359685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d84641b1-7dce-412e-a269-9f6efe2f1661 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:12.367590 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d84641b1-7dce-412e-a269-9f6efe2f1661 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1463 microversion: 2.1 time: 0.300231 Aug 04 04:40:12.368279 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 73/152] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:12 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1463 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:12.427288 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bc957201-86f6-4a87-b55a-d213e38a4642 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:12.429199 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bc957201-86f6-4a87-b55a-d213e38a4642 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:12.434944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc957201-86f6-4a87-b55a-d213e38a4642 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:12.435402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc957201-86f6-4a87-b55a-d213e38a4642 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.436161 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc957201-86f6-4a87-b55a-d213e38a4642 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:12.436592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc957201-86f6-4a87-b55a-d213e38a4642 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.463033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bc957201-86f6-4a87-b55a-d213e38a4642 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Going to try to terminate instance {{(pid=134884) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:40:12.475334 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4fac724c-9d63-4dfc-a7d7-74e4e51a023c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:12.476114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4fac724c-9d63-4dfc-a7d7-74e4e51a023c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:12.484254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fac724c-9d63-4dfc-a7d7-74e4e51a023c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:12.485021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fac724c-9d63-4dfc-a7d7-74e4e51a023c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.485833 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fac724c-9d63-4dfc-a7d7-74e4e51a023c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:12.486275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fac724c-9d63-4dfc-a7d7-74e4e51a023c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.581942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bc957201-86f6-4a87-b55a-d213e38a4642 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "DELETE /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 204 len: 0 microversion: 2.1 time: 0.158623 Aug 04 04:40:12.583013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 80/153] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:40:12 2022] DELETE /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:40:12.593395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fa4aa3b6-5269-44a3-b2dc-a2a5c1a771ba tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:12.594163 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fa4aa3b6-5269-44a3-b2dc-a2a5c1a771ba tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:12.602165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa4aa3b6-5269-44a3-b2dc-a2a5c1a771ba tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:12.603015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa4aa3b6-5269-44a3-b2dc-a2a5c1a771ba tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.603987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa4aa3b6-5269-44a3-b2dc-a2a5c1a771ba tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:12.604644 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa4aa3b6-5269-44a3-b2dc-a2a5c1a771ba tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:12.779508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4fac724c-9d63-4dfc-a7d7-74e4e51a023c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:12.787563 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4fac724c-9d63-4dfc-a7d7-74e4e51a023c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1314 microversion: 2.1 time: 0.315974 Aug 04 04:40:12.801953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 74/154] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:12 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:12.849802 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fa4aa3b6-5269-44a3-b2dc-a2a5c1a771ba tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:12.860769 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fa4aa3b6-5269-44a3-b2dc-a2a5c1a771ba tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1469 microversion: 2.1 time: 0.272994 Aug 04 04:40:12.861350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 81/155] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:12 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1469 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:13.809701 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-83f9f37f-cc18-488f-8bb8-78e3f2198e00 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:13.811100 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-83f9f37f-cc18-488f-8bb8-78e3f2198e00 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:13.813882 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:13.814687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=6 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:13.821087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83f9f37f-cc18-488f-8bb8-78e3f2198e00 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:13.821734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83f9f37f-cc18-488f-8bb8-78e3f2198e00 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:13.822771 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83f9f37f-cc18-488f-8bb8-78e3f2198e00 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:13.824224 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83f9f37f-cc18-488f-8bb8-78e3f2198e00 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:13.894082 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e15bf138-6f0f-4651-aadd-256d589d0b82 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:13.895444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e15bf138-6f0f-4651-aadd-256d589d0b82 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:13.898089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:13.911491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e15bf138-6f0f-4651-aadd-256d589d0b82 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:13.912491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e15bf138-6f0f-4651-aadd-256d589d0b82 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:13.913236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e15bf138-6f0f-4651-aadd-256d589d0b82 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:13.914327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e15bf138-6f0f-4651-aadd-256d589d0b82 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:14.114510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-83f9f37f-cc18-488f-8bb8-78e3f2198e00 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:14.123412 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-83f9f37f-cc18-488f-8bb8-78e3f2198e00 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1314 microversion: 2.1 time: 0.318930 Aug 04 04:40:14.124346 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 75/156] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:13 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:14.147603 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e15bf138-6f0f-4651-aadd-256d589d0b82 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:14.157629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e15bf138-6f0f-4651-aadd-256d589d0b82 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1469 microversion: 2.1 time: 0.275987 Aug 04 04:40:14.158703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 82/157] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:13 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:14.347525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-862721413", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:14.404400 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] validate_networks() for [('de933171-52eb-4683-9f34-62c4f6c44c8a', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:40:15.034220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:40:15.034760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:40:15.035062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:40:15.035464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:40:15.035876 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:40:15.046106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:15.046652 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:15.047452 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:15.047886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:15.065433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Getting quotas for project e43171bfd4564b0c92395767641b91ce. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:15.069571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Getting quotas for user 40a2cbbc654749199e742ae96329a1d9 and project e43171bfd4564b0c92395767641b91ce. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:15.081390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:40:15.083740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:40:15.129439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6cb61f50-0df3-4224-8844-92cc33ab4006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.917529 Aug 04 04:40:15.130119 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 76/158] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:40:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:40:15.141582 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-13784e9e-73c7-4954-a0ea-dc582d7e372c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:15.143471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-13784e9e-73c7-4954-a0ea-dc582d7e372c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:15.144168 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-78653799-a527-495b-b2c7-bb7b645ac867 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:15.146008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-78653799-a527-495b-b2c7-bb7b645ac867 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:15.156512 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78653799-a527-495b-b2c7-bb7b645ac867 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:15.157047 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78653799-a527-495b-b2c7-bb7b645ac867 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:15.157864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78653799-a527-495b-b2c7-bb7b645ac867 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:15.158314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78653799-a527-495b-b2c7-bb7b645ac867 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:15.240311 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-13784e9e-73c7-4954-a0ea-dc582d7e372c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:15.251502 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-13784e9e-73c7-4954-a0ea-dc582d7e372c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1221 microversion: 2.1 time: 0.113710 Aug 04 04:40:15.252300 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 83/159] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:15 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1221 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:15.257525 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0283c5aa-49e6-4ac5-ba90-916ffac7a346 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:15.258311 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0283c5aa-49e6-4ac5-ba90-916ffac7a346 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:15.265914 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0283c5aa-49e6-4ac5-ba90-916ffac7a346 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:15.266772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0283c5aa-49e6-4ac5-ba90-916ffac7a346 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:15.267768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0283c5aa-49e6-4ac5-ba90-916ffac7a346 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:15.268475 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0283c5aa-49e6-4ac5-ba90-916ffac7a346 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:15.447560 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-78653799-a527-495b-b2c7-bb7b645ac867 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:15.460410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-78653799-a527-495b-b2c7-bb7b645ac867 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1314 microversion: 2.1 time: 0.318324 Aug 04 04:40:15.463253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 77/160] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:15 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:15.469288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1286533553", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:15.556273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0283c5aa-49e6-4ac5-ba90-916ffac7a346 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:15.566293 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] validate_networks() for [('de933171-52eb-4683-9f34-62c4f6c44c8a', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:40:15.567216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0283c5aa-49e6-4ac5-ba90-916ffac7a346 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1469 microversion: 2.1 time: 0.313761 Aug 04 04:40:15.567811 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 84/161] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:15 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1469 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:16.015041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:40:16.015788 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:40:16.015917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:40:16.016317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:40:16.016717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:40:16.027907 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:16.028661 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:16.029490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:16.029955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:16.048801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Getting quotas for project e43171bfd4564b0c92395767641b91ce. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:16.052822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Getting quotas for user 40a2cbbc654749199e742ae96329a1d9 and project e43171bfd4564b0c92395767641b91ce. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:16.064736 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:40:16.066808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:40:16.125522 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0a81ba30-8b29-4722-ab24-ff087e94859e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.660478 Aug 04 04:40:16.126440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 78/162] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:40:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:40:16.163905 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8d79049f-a9b3-46bc-98be-e32495189a27 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:16.163905 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8d79049f-a9b3-46bc-98be-e32495189a27 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:16.257318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8d79049f-a9b3-46bc-98be-e32495189a27 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:16.265580 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8d79049f-a9b3-46bc-98be-e32495189a27 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1222 microversion: 2.1 time: 0.126462 Aug 04 04:40:16.266664 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 85/163] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:16 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:16.484483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4ea597c1-afe7-4f1e-87ac-a232bf217558 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:16.485103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4ea597c1-afe7-4f1e-87ac-a232bf217558 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:16.501447 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4ea597c1-afe7-4f1e-87ac-a232bf217558 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:16.501919 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4ea597c1-afe7-4f1e-87ac-a232bf217558 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:16.503139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4ea597c1-afe7-4f1e-87ac-a232bf217558 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:16.503779 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4ea597c1-afe7-4f1e-87ac-a232bf217558 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:16.592025 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5cad10f6-513a-4130-9278-3401f6010133 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:16.592982 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5cad10f6-513a-4130-9278-3401f6010133 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:16.611255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5cad10f6-513a-4130-9278-3401f6010133 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:16.621204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5cad10f6-513a-4130-9278-3401f6010133 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:16.622922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5cad10f6-513a-4130-9278-3401f6010133 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:16.623892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5cad10f6-513a-4130-9278-3401f6010133 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:16.725454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4ea597c1-afe7-4f1e-87ac-a232bf217558 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:16.737570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4ea597c1-afe7-4f1e-87ac-a232bf217558 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1314 microversion: 2.1 time: 0.256213 Aug 04 04:40:16.738203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 79/164] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:16 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:16.943933 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5cad10f6-513a-4130-9278-3401f6010133 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:16.954710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5cad10f6-513a-4130-9278-3401f6010133 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1469 microversion: 2.1 time: 0.369794 Aug 04 04:40:16.966426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 86/165] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:16 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1469 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:17.290822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-71b2371f-d8f7-402d-9cf3-f57e2e0df37d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:17.293004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-71b2371f-d8f7-402d-9cf3-f57e2e0df37d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:17.319400 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-71b2371f-d8f7-402d-9cf3-f57e2e0df37d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:17.322373 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-71b2371f-d8f7-402d-9cf3-f57e2e0df37d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:17.328249 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-71b2371f-d8f7-402d-9cf3-f57e2e0df37d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:17.328741 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-71b2371f-d8f7-402d-9cf3-f57e2e0df37d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:17.546850 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-71b2371f-d8f7-402d-9cf3-f57e2e0df37d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:17.560679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-71b2371f-d8f7-402d-9cf3-f57e2e0df37d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1218 microversion: 2.1 time: 0.274501 Aug 04 04:40:17.576712 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 80/166] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:17 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1218 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:17.769323 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-376b1e53-086e-4cbb-a7a5-55d650224275 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:17.771483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-376b1e53-086e-4cbb-a7a5-55d650224275 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:17.780764 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-376b1e53-086e-4cbb-a7a5-55d650224275 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:17.781250 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-376b1e53-086e-4cbb-a7a5-55d650224275 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:17.782329 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-376b1e53-086e-4cbb-a7a5-55d650224275 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:17.782923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-376b1e53-086e-4cbb-a7a5-55d650224275 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:17.990186 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-95445d70-3c1f-4aa1-9b3c-68bb0cf638ca tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:17.991202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-95445d70-3c1f-4aa1-9b3c-68bb0cf638ca tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:18.008184 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-95445d70-3c1f-4aa1-9b3c-68bb0cf638ca tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:18.009624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-95445d70-3c1f-4aa1-9b3c-68bb0cf638ca tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:18.012577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-95445d70-3c1f-4aa1-9b3c-68bb0cf638ca tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:18.014903 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-95445d70-3c1f-4aa1-9b3c-68bb0cf638ca tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:18.155059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-95445d70-3c1f-4aa1-9b3c-68bb0cf638ca tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13679676132642b88b2c88b58c4afc55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f04dacfa01e42539204572c99bed3f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:18.170922 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-95445d70-3c1f-4aa1-9b3c-68bb0cf638ca tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 200 len: 1427 microversion: 2.1 time: 0.186618 Aug 04 04:40:18.172819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 81/167] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:17 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 1427 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:18.189388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-c40523ba-d09a-46b9-9d8b-2788369d49be req-21a9849b-d7c3-439a-9b08-d0e38bedea4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa53eb23-31e0-4e0e-9329-f38f1d64bbe2", "name": "network-vif-deleted", "tag": "ff13f058-d1c0-4c2f-8d2a-208f89919f0f"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:18.206695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-c40523ba-d09a-46b9-9d8b-2788369d49be req-21a9849b-d7c3-439a-9b08-d0e38bedea4b service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:18.207391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-c40523ba-d09a-46b9-9d8b-2788369d49be req-21a9849b-d7c3-439a-9b08-d0e38bedea4b service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:18.224018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-c40523ba-d09a-46b9-9d8b-2788369d49be req-21a9849b-d7c3-439a-9b08-d0e38bedea4b service nova] Creating event network-vif-deleted:ff13f058-d1c0-4c2f-8d2a-208f89919f0f for instance aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 on hv-cinder-85127 Aug 04 04:40:18.234857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-c40523ba-d09a-46b9-9d8b-2788369d49be req-21a9849b-d7c3-439a-9b08-d0e38bedea4b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057776 Aug 04 04:40:18.236801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 82/168] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:18.309454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-376b1e53-086e-4cbb-a7a5-55d650224275 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:18.329498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-376b1e53-086e-4cbb-a7a5-55d650224275 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1314 microversion: 2.1 time: 0.574243 Aug 04 04:40:18.343633 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 87/169] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:17 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:18.584671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-54fdedae-1e80-4a8d-982f-e9a3a12c7d32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:18.586019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-54fdedae-1e80-4a8d-982f-e9a3a12c7d32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:18.595922 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-54fdedae-1e80-4a8d-982f-e9a3a12c7d32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:18.596548 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-54fdedae-1e80-4a8d-982f-e9a3a12c7d32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:18.597444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-54fdedae-1e80-4a8d-982f-e9a3a12c7d32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:18.598016 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-54fdedae-1e80-4a8d-982f-e9a3a12c7d32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:18.684662 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-54fdedae-1e80-4a8d-982f-e9a3a12c7d32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:18.694932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-54fdedae-1e80-4a8d-982f-e9a3a12c7d32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1280 microversion: 2.1 time: 0.114491 Aug 04 04:40:18.698791 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 83/170] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:18 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1280 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:18.732547 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-ba7d140c-b94d-4352-993e-009922a8b3fc req-6fc41ee9-15bd-4664-9416-df7f1d36ab82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc1a461-2936-44e5-b56f-2e94b0946d63", "name": "network-vif-plugged", "status": "completed", "tag": "8bfec917-6543-4aeb-9b73-d30bfeddeaee"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:18.744581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-ba7d140c-b94d-4352-993e-009922a8b3fc req-6fc41ee9-15bd-4664-9416-df7f1d36ab82 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:18.745933 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-ba7d140c-b94d-4352-993e-009922a8b3fc req-6fc41ee9-15bd-4664-9416-df7f1d36ab82 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:18.777450 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-ba7d140c-b94d-4352-993e-009922a8b3fc req-6fc41ee9-15bd-4664-9416-df7f1d36ab82 service nova] Creating event network-vif-plugged:8bfec917-6543-4aeb-9b73-d30bfeddeaee for instance 4cc1a461-2936-44e5-b56f-2e94b0946d63 on hv-cinder-85127 Aug 04 04:40:18.803237 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-ba7d140c-b94d-4352-993e-009922a8b3fc req-6fc41ee9-15bd-4664-9416-df7f1d36ab82 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075755 Aug 04 04:40:18.810000 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 88/171] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:19.196453 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-25020190-b0de-4d6b-b239-6a06f4ceeaa9 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:19.197060 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-25020190-b0de-4d6b-b239-6a06f4ceeaa9 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] [instance: aa53eb23-31e0-4e0e-9329-f38f1d64bbe2] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:19.220850 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25020190-b0de-4d6b-b239-6a06f4ceeaa9 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:19.222155 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25020190-b0de-4d6b-b239-6a06f4ceeaa9 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:19.224416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25020190-b0de-4d6b-b239-6a06f4ceeaa9 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:19.227230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25020190-b0de-4d6b-b239-6a06f4ceeaa9 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:19.271446 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-25020190-b0de-4d6b-b239-6a06f4ceeaa9 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] HTTP exception thrown: Instance aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 could not be found. Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-25020190-b0de-4d6b-b239-6a06f4ceeaa9 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Request method failure captured: Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 HTTP/1.1 Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi602Q3847C1A_eN43XEQDvaiFnYNbuNaxRPVTnCsmoMdUdiPfqoyMce55ku1vlYwvQ5OpBl0-juc2WaYjjHE6py_wOm0PKbJc5sSHoS3kGQpwUmBD0a6eU1qCUjd3IOl9IZ_8lCQ97-13DROlY05WgybR8hKy9-t8WcpBlxHDftBCJ0Y Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 4f04dacfa01e42539204572c99bed3f6 Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-VolumesNegativeTest-1344131199 Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 04:40:19.274088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 04:40:19.275687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4f04dacfa01e42539204572c99bed3f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4f04dacfa01e42539204572c99bed3f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4f04dacfa01e42539204572c99bed3f6", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4f04dacfa01e42539204572c99bed3f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:40:19.275687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-VolumesNegativeTest-1344131199 Aug 04 04:40:19.275687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 4f04dacfa01e42539204572c99bed3f6 Aug 04 04:40:19.275687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-VolumesNegativeTest-1344131199 Aug 04 04:40:19.275687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-VolumesNegativeTest-1344131199-project Aug 04 04:40:19.275687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 04:40:19.275687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 04:40:19.275687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 13679676132642b88b2c88b58c4afc55 Aug 04 04:40:19.275687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-VolumesNegativeTest-1344131199-project Aug 04 04:40:19.275687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 04:40:19.275687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 could not be found. Aug 04 04:40:19.275687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': 'aa53eb23-31e0-4e0e-9329-f38f1d64bbe2'} Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 could not be found. Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:19.276383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 could not be found. Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 could not be found. Aug 04 04:40:19.277844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:40:19.281418 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-25020190-b0de-4d6b-b239-6a06f4ceeaa9 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] Returning 404 to user: Instance aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:19.283272 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-25020190-b0de-4d6b-b239-6a06f4ceeaa9 tempest-VolumesNegativeTest-1344131199 tempest-VolumesNegativeTest-1344131199-project] 10.222.0.47 "GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2" status: 404 len: 111 microversion: 2.1 time: 0.091493 Aug 04 04:40:19.284853 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 84/172] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:19 2022] GET /compute/v2.1/servers/aa53eb23-31e0-4e0e-9329-f38f1d64bbe2 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:40:19.351015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a79b81e4-a7fe-41ce-b1a5-9b3933624f2b tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:19.351768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a79b81e4-a7fe-41ce-b1a5-9b3933624f2b tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:19.366553 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a79b81e4-a7fe-41ce-b1a5-9b3933624f2b tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:19.369094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a79b81e4-a7fe-41ce-b1a5-9b3933624f2b tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:19.371611 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a79b81e4-a7fe-41ce-b1a5-9b3933624f2b tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:19.372070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a79b81e4-a7fe-41ce-b1a5-9b3933624f2b tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:19.648301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a79b81e4-a7fe-41ce-b1a5-9b3933624f2b tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:19.660569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a79b81e4-a7fe-41ce-b1a5-9b3933624f2b tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1314 microversion: 2.1 time: 0.313739 Aug 04 04:40:19.671705 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 89/173] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:19 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:19.717878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f1e5e589-8e11-497e-a139-4cb715ef7e1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:19.720122 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f1e5e589-8e11-497e-a139-4cb715ef7e1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:19.730738 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1e5e589-8e11-497e-a139-4cb715ef7e1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:19.731454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1e5e589-8e11-497e-a139-4cb715ef7e1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:19.732347 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1e5e589-8e11-497e-a139-4cb715ef7e1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:19.732932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1e5e589-8e11-497e-a139-4cb715ef7e1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:19.812845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f1e5e589-8e11-497e-a139-4cb715ef7e1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:19.820626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f1e5e589-8e11-497e-a139-4cb715ef7e1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1280 microversion: 2.1 time: 0.108145 Aug 04 04:40:19.821343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 85/174] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:19 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1280 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:20.433279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-c20a6026-6a8b-4357-abcf-df929169d56c req-6ff872a5-8a88-43b9-8a59-3c9c027f71a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66e490bd-0671-4049-b64c-74e8dfe5bfb1", "tag": "40ec849e-d21e-47ee-aa1e-70a0ce528fe8"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:20.467788 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-c20a6026-6a8b-4357-abcf-df929169d56c req-6ff872a5-8a88-43b9-8a59-3c9c027f71a3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:20.468239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-c20a6026-6a8b-4357-abcf-df929169d56c req-6ff872a5-8a88-43b9-8a59-3c9c027f71a3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:20.485161 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-c20a6026-6a8b-4357-abcf-df929169d56c req-6ff872a5-8a88-43b9-8a59-3c9c027f71a3 service nova] Creating event network-changed:40ec849e-d21e-47ee-aa1e-70a0ce528fe8 for instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 on hv-cinder-85127 Aug 04 04:40:20.491611 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-c20a6026-6a8b-4357-abcf-df929169d56c req-6ff872a5-8a88-43b9-8a59-3c9c027f71a3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063138 Aug 04 04:40:20.493858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 90/175] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:20.691842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b03156b0-028c-4199-8a96-9b24e1fada64 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:20.692563 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b03156b0-028c-4199-8a96-9b24e1fada64 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:20.700095 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b03156b0-028c-4199-8a96-9b24e1fada64 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:20.700539 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b03156b0-028c-4199-8a96-9b24e1fada64 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:20.701590 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b03156b0-028c-4199-8a96-9b24e1fada64 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:20.702054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b03156b0-028c-4199-8a96-9b24e1fada64 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:20.843476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-71fd9219-7851-4502-9f21-68d347f5a7dc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:20.844189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-71fd9219-7851-4502-9f21-68d347f5a7dc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:20.852240 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b03156b0-028c-4199-8a96-9b24e1fada64 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:20.856614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-71fd9219-7851-4502-9f21-68d347f5a7dc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:20.857068 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-71fd9219-7851-4502-9f21-68d347f5a7dc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:20.857874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-71fd9219-7851-4502-9f21-68d347f5a7dc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:20.858323 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-71fd9219-7851-4502-9f21-68d347f5a7dc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:20.861042 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b03156b0-028c-4199-8a96-9b24e1fada64 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1314 microversion: 2.1 time: 0.177664 Aug 04 04:40:20.861661 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 86/176] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:20 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:21.013269 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-71fd9219-7851-4502-9f21-68d347f5a7dc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:21.015800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:21.023238 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-71fd9219-7851-4502-9f21-68d347f5a7dc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1322 microversion: 2.1 time: 0.185816 Aug 04 04:40:21.023827 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 91/177] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:20 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:21.884356 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3ed47d41-4940-4079-b853-cdbe5a82847c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:21.886983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3ed47d41-4940-4079-b853-cdbe5a82847c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:21.892766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3ed47d41-4940-4079-b853-cdbe5a82847c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:21.893286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3ed47d41-4940-4079-b853-cdbe5a82847c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:21.894176 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3ed47d41-4940-4079-b853-cdbe5a82847c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:21.894610 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3ed47d41-4940-4079-b853-cdbe5a82847c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:22.035945 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3ed47d41-4940-4079-b853-cdbe5a82847c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:22.058162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3ed47d41-4940-4079-b853-cdbe5a82847c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1314 microversion: 2.1 time: 0.164638 Aug 04 04:40:22.058162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 87/178] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:21 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:22.058368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-71a7bf27-fc9a-48d2-8263-6892e85541fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:22.058368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-71a7bf27-fc9a-48d2-8263-6892e85541fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:22.058368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-71a7bf27-fc9a-48d2-8263-6892e85541fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:22.058368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-71a7bf27-fc9a-48d2-8263-6892e85541fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:22.059103 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-71a7bf27-fc9a-48d2-8263-6892e85541fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:22.059103 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-71a7bf27-fc9a-48d2-8263-6892e85541fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:22.195084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-71a7bf27-fc9a-48d2-8263-6892e85541fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:22.202892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-71a7bf27-fc9a-48d2-8263-6892e85541fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1322 microversion: 2.1 time: 0.162512 Aug 04 04:40:22.203464 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 92/179] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:22 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:23.070670 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-72394db5-da80-4ef3-b01f-13e7bb3c7281 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:23.071992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-72394db5-da80-4ef3-b01f-13e7bb3c7281 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:23.079273 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:23.081533 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72394db5-da80-4ef3-b01f-13e7bb3c7281 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:23.082525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72394db5-da80-4ef3-b01f-13e7bb3c7281 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:23.083386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72394db5-da80-4ef3-b01f-13e7bb3c7281 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:23.083925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72394db5-da80-4ef3-b01f-13e7bb3c7281 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:23.225788 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a9c8c20a-6641-4666-ac98-d8ecd979ced6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:23.227065 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a9c8c20a-6641-4666-ac98-d8ecd979ced6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:23.232737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-72394db5-da80-4ef3-b01f-13e7bb3c7281 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:23.235263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a9c8c20a-6641-4666-ac98-d8ecd979ced6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:23.235708 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a9c8c20a-6641-4666-ac98-d8ecd979ced6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:23.236491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a9c8c20a-6641-4666-ac98-d8ecd979ced6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:23.237167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a9c8c20a-6641-4666-ac98-d8ecd979ced6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:23.242177 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-72394db5-da80-4ef3-b01f-13e7bb3c7281 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1314 microversion: 2.1 time: 0.176466 Aug 04 04:40:23.243054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 88/180] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:23 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:23.388668 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a9c8c20a-6641-4666-ac98-d8ecd979ced6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:23.396630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a9c8c20a-6641-4666-ac98-d8ecd979ced6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1322 microversion: 2.1 time: 0.175964 Aug 04 04:40:23.401655 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 93/181] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:23 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:23.664346 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-53f1a72e-1c75-4145-bef5-5bfc726abb48 req-41f5e9f1-8ae0-4634-8e20-7eace901afa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d94d001-2e5d-414e-912f-3e6d0a7ae1a8", "tag": "24b6a132-9134-4cf2-a1cc-b0b93a4d5634"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:23.677067 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-53f1a72e-1c75-4145-bef5-5bfc726abb48 req-41f5e9f1-8ae0-4634-8e20-7eace901afa4 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:23.677522 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-53f1a72e-1c75-4145-bef5-5bfc726abb48 req-41f5e9f1-8ae0-4634-8e20-7eace901afa4 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:23.693871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-53f1a72e-1c75-4145-bef5-5bfc726abb48 req-41f5e9f1-8ae0-4634-8e20-7eace901afa4 service nova] Creating event network-changed:24b6a132-9134-4cf2-a1cc-b0b93a4d5634 for instance 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 on hv-cinder-85127 Aug 04 04:40:23.700040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-53f1a72e-1c75-4145-bef5-5bfc726abb48 req-41f5e9f1-8ae0-4634-8e20-7eace901afa4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040032 Aug 04 04:40:23.700728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 89/182] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:24.265835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-419a9758-fa88-4ff4-9165-9edf481216ad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:24.267638 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-419a9758-fa88-4ff4-9165-9edf481216ad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:24.279817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-419a9758-fa88-4ff4-9165-9edf481216ad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:24.280777 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-419a9758-fa88-4ff4-9165-9edf481216ad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:24.297909 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-419a9758-fa88-4ff4-9165-9edf481216ad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:24.302254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-419a9758-fa88-4ff4-9165-9edf481216ad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:24.420869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e8a7f50d-0469-40c3-99f8-99221ee6d27d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:24.420869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e8a7f50d-0469-40c3-99f8-99221ee6d27d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:24.427887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8a7f50d-0469-40c3-99f8-99221ee6d27d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:24.428367 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8a7f50d-0469-40c3-99f8-99221ee6d27d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:24.429120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8a7f50d-0469-40c3-99f8-99221ee6d27d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:24.429575 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8a7f50d-0469-40c3-99f8-99221ee6d27d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:24.434405 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:24.597143 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-419a9758-fa88-4ff4-9165-9edf481216ad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:24.611933 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-419a9758-fa88-4ff4-9165-9edf481216ad tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1498 microversion: 2.1 time: 0.350674 Aug 04 04:40:24.612511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 94/183] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:24 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1498 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:24.674896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e8a7f50d-0469-40c3-99f8-99221ee6d27d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:24.685298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e8a7f50d-0469-40c3-99f8-99221ee6d27d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1322 microversion: 2.1 time: 0.270099 Aug 04 04:40:24.686011 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 90/184] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:24 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:25.706394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b01d90e8-9d35-43ba-8be3-dd8e0e0a505e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:25.707009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b01d90e8-9d35-43ba-8be3-dd8e0e0a505e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:25.717562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b01d90e8-9d35-43ba-8be3-dd8e0e0a505e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:25.718336 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b01d90e8-9d35-43ba-8be3-dd8e0e0a505e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:25.719062 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b01d90e8-9d35-43ba-8be3-dd8e0e0a505e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:25.719619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b01d90e8-9d35-43ba-8be3-dd8e0e0a505e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:25.876492 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b01d90e8-9d35-43ba-8be3-dd8e0e0a505e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:25.885470 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b01d90e8-9d35-43ba-8be3-dd8e0e0a505e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1322 microversion: 2.1 time: 0.182877 Aug 04 04:40:25.886084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 95/185] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:25 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:26.907718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7a6e1947-2b83-4806-8114-eb0b643aabb8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:26.908230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7a6e1947-2b83-4806-8114-eb0b643aabb8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:26.910600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=4 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:26.911306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=12 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:26.917481 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7a6e1947-2b83-4806-8114-eb0b643aabb8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:26.917957 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7a6e1947-2b83-4806-8114-eb0b643aabb8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:26.918992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7a6e1947-2b83-4806-8114-eb0b643aabb8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:26.919430 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7a6e1947-2b83-4806-8114-eb0b643aabb8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:27.084015 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7a6e1947-2b83-4806-8114-eb0b643aabb8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:27.092188 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7a6e1947-2b83-4806-8114-eb0b643aabb8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1322 microversion: 2.1 time: 0.188319 Aug 04 04:40:27.092758 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 91/186] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:26 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:27.835407 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a82cc4e2-86a4-4b6f-8f91-54f5bfafd91c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:27.836062 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a82cc4e2-86a4-4b6f-8f91-54f5bfafd91c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:27.840144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=4 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:27.840976 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:27.844914 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a82cc4e2-86a4-4b6f-8f91-54f5bfafd91c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:27.845276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a82cc4e2-86a4-4b6f-8f91-54f5bfafd91c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:27.846231 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a82cc4e2-86a4-4b6f-8f91-54f5bfafd91c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:27.846716 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a82cc4e2-86a4-4b6f-8f91-54f5bfafd91c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:27.876695 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a82cc4e2-86a4-4b6f-8f91-54f5bfafd91c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Going to try to terminate instance {{(pid=134884) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:40:27.976767 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a82cc4e2-86a4-4b6f-8f91-54f5bfafd91c tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 204 len: 0 microversion: 2.1 time: 0.145172 Aug 04 04:40:27.977306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 96/187] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:40:27 2022] DELETE /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:40:27.986164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-45485557-1916-49c4-9bc8-fefcdedfd239 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:27.986790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-45485557-1916-49c4-9bc8-fefcdedfd239 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:27.994432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-45485557-1916-49c4-9bc8-fefcdedfd239 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:27.995198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-45485557-1916-49c4-9bc8-fefcdedfd239 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:27.996171 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-45485557-1916-49c4-9bc8-fefcdedfd239 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:27.996629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-45485557-1916-49c4-9bc8-fefcdedfd239 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:28.118792 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-85c60e37-aab4-4144-ab2f-c30a62a9a030 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:28.121519 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-85c60e37-aab4-4144-ab2f-c30a62a9a030 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:28.133576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-85c60e37-aab4-4144-ab2f-c30a62a9a030 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:28.134381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-85c60e37-aab4-4144-ab2f-c30a62a9a030 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:28.138619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-85c60e37-aab4-4144-ab2f-c30a62a9a030 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:28.138880 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-85c60e37-aab4-4144-ab2f-c30a62a9a030 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:28.190286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-45485557-1916-49c4-9bc8-fefcdedfd239 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:28.202091 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-45485557-1916-49c4-9bc8-fefcdedfd239 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1504 microversion: 2.1 time: 0.219658 Aug 04 04:40:28.202883 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 92/188] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:27 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:28.367278 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-85c60e37-aab4-4144-ab2f-c30a62a9a030 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:28.375597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-85c60e37-aab4-4144-ab2f-c30a62a9a030 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1322 microversion: 2.1 time: 0.265110 Aug 04 04:40:28.376176 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 97/189] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:28 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:29.224282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f2af76fe-a3b7-4550-ae56-009084213718 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:29.224896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f2af76fe-a3b7-4550-ae56-009084213718 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:29.233125 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f2af76fe-a3b7-4550-ae56-009084213718 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:29.233609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f2af76fe-a3b7-4550-ae56-009084213718 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:29.235015 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f2af76fe-a3b7-4550-ae56-009084213718 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:29.235462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f2af76fe-a3b7-4550-ae56-009084213718 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:29.397579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f2af76fe-a3b7-4550-ae56-009084213718 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:29.397832 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-86de4176-c347-4fab-ab5a-4cdcffaf1da7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:29.398674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-86de4176-c347-4fab-ab5a-4cdcffaf1da7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:29.406527 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f2af76fe-a3b7-4550-ae56-009084213718 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1504 microversion: 2.1 time: 0.185973 Aug 04 04:40:29.407112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 93/190] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:29 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:29.411858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-86de4176-c347-4fab-ab5a-4cdcffaf1da7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:29.411858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-86de4176-c347-4fab-ab5a-4cdcffaf1da7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:29.412158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-86de4176-c347-4fab-ab5a-4cdcffaf1da7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:29.412781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-86de4176-c347-4fab-ab5a-4cdcffaf1da7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:29.549336 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-86de4176-c347-4fab-ab5a-4cdcffaf1da7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:29.557579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-86de4176-c347-4fab-ab5a-4cdcffaf1da7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1322 microversion: 2.1 time: 0.163620 Aug 04 04:40:29.558227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 98/191] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:29 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:30.428346 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-94fb4391-ddc8-4b15-9c72-6028c822c46e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:30.428965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-94fb4391-ddc8-4b15-9c72-6028c822c46e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:30.436555 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-94fb4391-ddc8-4b15-9c72-6028c822c46e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:30.437007 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-94fb4391-ddc8-4b15-9c72-6028c822c46e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:30.437817 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-94fb4391-ddc8-4b15-9c72-6028c822c46e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:30.438264 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-94fb4391-ddc8-4b15-9c72-6028c822c46e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:30.576026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-94fb4391-ddc8-4b15-9c72-6028c822c46e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:30.578590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b37eac7e-a191-40d1-8cd8-f2299ee9f430 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:30.579197 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b37eac7e-a191-40d1-8cd8-f2299ee9f430 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:30.584015 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-94fb4391-ddc8-4b15-9c72-6028c822c46e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1504 microversion: 2.1 time: 0.159345 Aug 04 04:40:30.584598 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 94/192] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:30 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:30.585512 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b37eac7e-a191-40d1-8cd8-f2299ee9f430 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:30.585992 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b37eac7e-a191-40d1-8cd8-f2299ee9f430 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:30.586759 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b37eac7e-a191-40d1-8cd8-f2299ee9f430 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:30.587190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b37eac7e-a191-40d1-8cd8-f2299ee9f430 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:30.722366 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b37eac7e-a191-40d1-8cd8-f2299ee9f430 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:30.731147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b37eac7e-a191-40d1-8cd8-f2299ee9f430 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1322 microversion: 2.1 time: 0.156243 Aug 04 04:40:30.731720 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 99/193] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:30 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:31.606576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9df487e2-63be-457c-84b5-2465d8fc4581 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:31.607181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9df487e2-63be-457c-84b5-2465d8fc4581 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:31.614077 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9df487e2-63be-457c-84b5-2465d8fc4581 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:31.614530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9df487e2-63be-457c-84b5-2465d8fc4581 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:31.615457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9df487e2-63be-457c-84b5-2465d8fc4581 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:31.615896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9df487e2-63be-457c-84b5-2465d8fc4581 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:31.752618 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f3ec52e7-4d5c-4f51-a7a8-15476f4bd83a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:31.753297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f3ec52e7-4d5c-4f51-a7a8-15476f4bd83a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:31.760284 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f3ec52e7-4d5c-4f51-a7a8-15476f4bd83a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:31.760741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f3ec52e7-4d5c-4f51-a7a8-15476f4bd83a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:31.761578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f3ec52e7-4d5c-4f51-a7a8-15476f4bd83a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:31.761982 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f3ec52e7-4d5c-4f51-a7a8-15476f4bd83a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:31.771920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9df487e2-63be-457c-84b5-2465d8fc4581 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:31.780553 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9df487e2-63be-457c-84b5-2465d8fc4581 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1504 microversion: 2.1 time: 0.178432 Aug 04 04:40:31.781351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 95/194] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:31 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:31.908660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f3ec52e7-4d5c-4f51-a7a8-15476f4bd83a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:31.916541 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f3ec52e7-4d5c-4f51-a7a8-15476f4bd83a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1322 microversion: 2.1 time: 0.167881 Aug 04 04:40:31.917115 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 100/195] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:31 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:32.802296 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f6ba0655-185d-47c3-95d4-ba1b2632e673 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:32.802953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f6ba0655-185d-47c3-95d4-ba1b2632e673 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:32.810758 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6ba0655-185d-47c3-95d4-ba1b2632e673 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:32.811216 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6ba0655-185d-47c3-95d4-ba1b2632e673 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:32.812174 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6ba0655-185d-47c3-95d4-ba1b2632e673 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:32.812789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6ba0655-185d-47c3-95d4-ba1b2632e673 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:32.938482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-276d02c7-9906-47c9-be88-aca560f29df6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:32.939170 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-276d02c7-9906-47c9-be88-aca560f29df6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:32.951885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-276d02c7-9906-47c9-be88-aca560f29df6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:32.951885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-276d02c7-9906-47c9-be88-aca560f29df6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:32.952276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-276d02c7-9906-47c9-be88-aca560f29df6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:32.952711 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-276d02c7-9906-47c9-be88-aca560f29df6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:32.973579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f6ba0655-185d-47c3-95d4-ba1b2632e673 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:32.985611 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f6ba0655-185d-47c3-95d4-ba1b2632e673 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1504 microversion: 2.1 time: 0.187096 Aug 04 04:40:32.998444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 96/196] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:32 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:33.122015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-276d02c7-9906-47c9-be88-aca560f29df6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:33.131547 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-276d02c7-9906-47c9-be88-aca560f29df6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1322 microversion: 2.1 time: 0.197022 Aug 04 04:40:33.132148 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 101/197] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:32 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:33.436428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-4369c53d-cc22-4cff-94bb-ee54febca0d2 req-e18b387a-70be-4d8a-a93c-3119f69bd02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d94d001-2e5d-414e-912f-3e6d0a7ae1a8", "name": "network-vif-plugged", "status": "completed", "tag": "24b6a132-9134-4cf2-a1cc-b0b93a4d5634"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:33.468886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-4369c53d-cc22-4cff-94bb-ee54febca0d2 req-e18b387a-70be-4d8a-a93c-3119f69bd02e service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:33.479685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-4369c53d-cc22-4cff-94bb-ee54febca0d2 req-e18b387a-70be-4d8a-a93c-3119f69bd02e service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:33.494714 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-4369c53d-cc22-4cff-94bb-ee54febca0d2 req-e18b387a-70be-4d8a-a93c-3119f69bd02e service nova] Creating event network-vif-plugged:24b6a132-9134-4cf2-a1cc-b0b93a4d5634 for instance 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 on hv-cinder-85127 Aug 04 04:40:33.528150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-4369c53d-cc22-4cff-94bb-ee54febca0d2 req-e18b387a-70be-4d8a-a93c-3119f69bd02e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080736 Aug 04 04:40:33.529694 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 97/198] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:33.996574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-718890cb-4f40-4826-9aa7-5443391b65ff req-7ea41e0b-8a25-467c-8124-6df10afa55d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc1a461-2936-44e5-b56f-2e94b0946d63", "name": "network-vif-deleted", "tag": "8bfec917-6543-4aeb-9b73-d30bfeddeaee"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:34.017563 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-633efedb-4d0f-44d5-b700-2a32abde0b58 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:34.023361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-633efedb-4d0f-44d5-b700-2a32abde0b58 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:34.027029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-718890cb-4f40-4826-9aa7-5443391b65ff req-7ea41e0b-8a25-467c-8124-6df10afa55d3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:34.036200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-718890cb-4f40-4826-9aa7-5443391b65ff req-7ea41e0b-8a25-467c-8124-6df10afa55d3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:34.054030 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-633efedb-4d0f-44d5-b700-2a32abde0b58 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:34.054238 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-718890cb-4f40-4826-9aa7-5443391b65ff req-7ea41e0b-8a25-467c-8124-6df10afa55d3 service nova] Creating event network-vif-deleted:8bfec917-6543-4aeb-9b73-d30bfeddeaee for instance 4cc1a461-2936-44e5-b56f-2e94b0946d63 on hv-cinder-85127 Aug 04 04:40:34.059899 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-633efedb-4d0f-44d5-b700-2a32abde0b58 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:34.060915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-718890cb-4f40-4826-9aa7-5443391b65ff req-7ea41e0b-8a25-467c-8124-6df10afa55d3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076550 Aug 04 04:40:34.061654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 102/199] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:34.065621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-633efedb-4d0f-44d5-b700-2a32abde0b58 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:34.066242 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-633efedb-4d0f-44d5-b700-2a32abde0b58 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:34.139737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-633efedb-4d0f-44d5-b700-2a32abde0b58 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:34.148017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-633efedb-4d0f-44d5-b700-2a32abde0b58 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1462 microversion: 2.1 time: 0.134934 Aug 04 04:40:34.148674 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 98/200] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:34 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1462 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:34.155675 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5dc6b8eb-4736-4117-b2d0-3c0dae62fc9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:34.156719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5dc6b8eb-4736-4117-b2d0-3c0dae62fc9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:34.163580 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5dc6b8eb-4736-4117-b2d0-3c0dae62fc9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:34.164289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5dc6b8eb-4736-4117-b2d0-3c0dae62fc9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:34.165125 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5dc6b8eb-4736-4117-b2d0-3c0dae62fc9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:34.165879 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5dc6b8eb-4736-4117-b2d0-3c0dae62fc9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:34.374903 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5dc6b8eb-4736-4117-b2d0-3c0dae62fc9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:34.383911 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5dc6b8eb-4736-4117-b2d0-3c0dae62fc9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1322 microversion: 2.1 time: 0.232987 Aug 04 04:40:34.385274 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 103/201] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:34 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:35.171212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-78100b91-263c-467e-91c2-79a3ea5f3477 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:35.171826 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-78100b91-263c-467e-91c2-79a3ea5f3477 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:35.180881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78100b91-263c-467e-91c2-79a3ea5f3477 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:35.181532 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78100b91-263c-467e-91c2-79a3ea5f3477 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:35.182810 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78100b91-263c-467e-91c2-79a3ea5f3477 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:35.183576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78100b91-263c-467e-91c2-79a3ea5f3477 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:35.223156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78100b91-263c-467e-91c2-79a3ea5f3477 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:35.223615 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78100b91-263c-467e-91c2-79a3ea5f3477 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:35.224099 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-78100b91-263c-467e-91c2-79a3ea5f3477 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lazy-loading 'fault' on Instance uuid 4cc1a461-2936-44e5-b56f-2e94b0946d63 {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:40:35.303702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-78100b91-263c-467e-91c2-79a3ea5f3477 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:35.317099 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-78100b91-263c-467e-91c2-79a3ea5f3477 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 200 len: 1304 microversion: 2.1 time: 0.149747 Aug 04 04:40:35.319098 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 99/202] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:35 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 1304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:35.406900 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-64ead814-0131-4617-bc94-e9339240d9da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:35.407568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-64ead814-0131-4617-bc94-e9339240d9da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:35.417352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-64ead814-0131-4617-bc94-e9339240d9da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:35.417858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-64ead814-0131-4617-bc94-e9339240d9da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:35.418907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-64ead814-0131-4617-bc94-e9339240d9da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:35.419346 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-64ead814-0131-4617-bc94-e9339240d9da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:35.553946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-3c0f2e62-897f-488c-aab3-cb94220ec660 req-8d4ec053-7cfa-49f5-95ad-b1b1e17df8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e490bd-0671-4049-b64c-74e8dfe5bfb1", "name": "network-vif-plugged", "status": "completed", "tag": "40ec849e-d21e-47ee-aa1e-70a0ce528fe8"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:35.567335 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-3c0f2e62-897f-488c-aab3-cb94220ec660 req-8d4ec053-7cfa-49f5-95ad-b1b1e17df8d7 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:35.568241 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-3c0f2e62-897f-488c-aab3-cb94220ec660 req-8d4ec053-7cfa-49f5-95ad-b1b1e17df8d7 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:35.607843 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-3c0f2e62-897f-488c-aab3-cb94220ec660 req-8d4ec053-7cfa-49f5-95ad-b1b1e17df8d7 service nova] Creating event network-vif-plugged:40ec849e-d21e-47ee-aa1e-70a0ce528fe8 for instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 on hv-cinder-85127 Aug 04 04:40:35.616860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-3c0f2e62-897f-488c-aab3-cb94220ec660 req-8d4ec053-7cfa-49f5-95ad-b1b1e17df8d7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068343 Aug 04 04:40:35.633635 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 100/203] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:35.745072 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-64ead814-0131-4617-bc94-e9339240d9da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:35.760799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-64ead814-0131-4617-bc94-e9339240d9da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1322 microversion: 2.1 time: 0.358699 Aug 04 04:40:35.775570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 104/204] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:35 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:36.343065 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ddd8a7a2-f972-4636-ac79-5888b3f6364e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:36.344382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ddd8a7a2-f972-4636-ac79-5888b3f6364e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: 4cc1a461-2936-44e5-b56f-2e94b0946d63] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:36.352869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ddd8a7a2-f972-4636-ac79-5888b3f6364e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:36.353397 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ddd8a7a2-f972-4636-ac79-5888b3f6364e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:36.354310 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ddd8a7a2-f972-4636-ac79-5888b3f6364e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:36.354759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ddd8a7a2-f972-4636-ac79-5888b3f6364e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:36.369927 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-ddd8a7a2-f972-4636-ac79-5888b3f6364e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] HTTP exception thrown: Instance 4cc1a461-2936-44e5-b56f-2e94b0946d63 could not be found. Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ddd8a7a2-f972-4636-ac79-5888b3f6364e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Request method failure captured: Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 HTTP/1.1 Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi602gpeNx4SldXIjLO8qVVLMTfL-yit4CZUooL-_LSZ0nrXGNjZF1dhg4sNMiODes8eHWZRxYRIEB-wktVbrZb20i5THWSkggQr-yKqBadKGZyc0YX6V0tqHKYzHkAMAnICPWtONvkPQpAKSTYHDJ7jYu3873F5QA24buzWxoM7F0Vrs Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 23ec86581683456b8c52c649eed292e7 Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-VolumesActionsTest-604895222 Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 04:40:36.371685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 04:40:36.373164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/23ec86581683456b8c52c649eed292e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/23ec86581683456b8c52c649eed292e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_23ec86581683456b8c52c649eed292e7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/23ec86581683456b8c52c649eed292e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:40:36.373164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-VolumesActionsTest-604895222 Aug 04 04:40:36.373164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 23ec86581683456b8c52c649eed292e7 Aug 04 04:40:36.373164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-VolumesActionsTest-604895222 Aug 04 04:40:36.373164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-VolumesActionsTest-604895222-project Aug 04 04:40:36.373164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 04:40:36.373164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 04:40:36.373164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 1b23dd1311554910a19399aa74df9e4c Aug 04 04:40:36.373164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-VolumesActionsTest-604895222-project Aug 04 04:40:36.373164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 04:40:36.373164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance 4cc1a461-2936-44e5-b56f-2e94b0946d63 could not be found. Aug 04 04:40:36.373164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': '4cc1a461-2936-44e5-b56f-2e94b0946d63'} Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc1a461-2936-44e5-b56f-2e94b0946d63 could not be found. Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:36.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc1a461-2936-44e5-b56f-2e94b0946d63 could not be found. Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc1a461-2936-44e5-b56f-2e94b0946d63 could not be found. Aug 04 04:40:36.375457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:40:36.377842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ddd8a7a2-f972-4636-ac79-5888b3f6364e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Returning 404 to user: Instance 4cc1a461-2936-44e5-b56f-2e94b0946d63 could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:36.378770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ddd8a7a2-f972-4636-ac79-5888b3f6364e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63" status: 404 len: 111 microversion: 2.1 time: 0.041934 Aug 04 04:40:36.379346 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 101/205] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:36 2022] GET /compute/v2.1/servers/4cc1a461-2936-44e5-b56f-2e94b0946d63 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:40:36.543938 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1781298793", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "networks": [{"uuid": "87c3a83a-edef-4e74-924c-63cb4e317fa7"}]}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:36.614622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.network.neutron [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] validate_networks() for [('87c3a83a-edef-4e74-924c-63cb4e317fa7', None, None, None, None, None)] {{(pid=134884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:40:36.783574 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-846a8778-87c8-4d5a-b94a-925d3ee76eaa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:36.784336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-846a8778-87c8-4d5a-b94a-925d3ee76eaa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:36.790953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-846a8778-87c8-4d5a-b94a-925d3ee76eaa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:36.791400 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-846a8778-87c8-4d5a-b94a-925d3ee76eaa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:36.792380 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-846a8778-87c8-4d5a-b94a-925d3ee76eaa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:36.792822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-846a8778-87c8-4d5a-b94a-925d3ee76eaa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.092333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-846a8778-87c8-4d5a-b94a-925d3ee76eaa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:37.102540 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-846a8778-87c8-4d5a-b94a-925d3ee76eaa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1517 microversion: 2.1 time: 0.323294 Aug 04 04:40:37.114748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 102/206] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:36 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1517 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:37.126977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8a0925dc-b938-48f8-be76-68c6f75f7621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:37.129856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8a0925dc-b938-48f8-be76-68c6f75f7621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:37.138751 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a0925dc-b938-48f8-be76-68c6f75f7621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.139794 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a0925dc-b938-48f8-be76-68c6f75f7621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.141455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a0925dc-b938-48f8-be76-68c6f75f7621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.142227 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a0925dc-b938-48f8-be76-68c6f75f7621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.187992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-8a0925dc-b938-48f8-be76-68c6f75f7621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lazy-loading 'flavor' on Instance uuid 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:40:37.202808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Flavor limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:40:37.203304 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Image limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:40:37.203840 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Flavor pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:40:37.204167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Image pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:40:37.204922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:40:37.226173 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.227288 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.229235 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.230301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.279485 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Getting quotas for project 23ec86581683456b8c52c649eed292e7. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:37.285842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Getting quotas for user 1b23dd1311554910a19399aa74df9e4c and project 23ec86581683456b8c52c649eed292e7. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:37.298301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Going to run 1 instances... {{(pid=134884) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:40:37.300560 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:40:37.358668 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ac17fe35-a232-44fc-bf61-15eefc338993 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820150 Aug 04 04:40:37.369952 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 105/207] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:40:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:40:37.371132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9447c9bc-5d1a-4cb2-894a-d53c4aad7b1c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:37.371997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9447c9bc-5d1a-4cb2-894a-d53c4aad7b1c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:37.382055 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9447c9bc-5d1a-4cb2-894a-d53c4aad7b1c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.382890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9447c9bc-5d1a-4cb2-894a-d53c4aad7b1c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.383996 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9447c9bc-5d1a-4cb2-894a-d53c4aad7b1c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.384821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9447c9bc-5d1a-4cb2-894a-d53c4aad7b1c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.395545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8a0925dc-b938-48f8-be76-68c6f75f7621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "POST /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8/action" status: 200 len: 32 microversion: 2.1 time: 0.273813 Aug 04 04:40:37.396959 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 103/208] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:40:37 2022] POST /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8/action => generated 32 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 04:40:37.405468 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4f6fa50d-c208-493c-9b57-f14a48a657c4 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:37.406761 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4f6fa50d-c208-493c-9b57-f14a48a657c4 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:37.486416 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9447c9bc-5d1a-4cb2-894a-d53c4aad7b1c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/ips" status: 200 len: 143 microversion: 2.1 time: 0.117660 Aug 04 04:40:37.488001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 106/209] 10.222.0.47 () {58 vars in 1248 bytes} [Thu Aug 4 04:40:37 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/ips => generated 143 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:37.506597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-42f41a91-5828-4df1-a83d-bfa8e6052489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:37.510297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-42f41a91-5828-4df1-a83d-bfa8e6052489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:37.534642 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4f6fa50d-c208-493c-9b57-f14a48a657c4 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:37.534792 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-42f41a91-5828-4df1-a83d-bfa8e6052489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.535110 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-42f41a91-5828-4df1-a83d-bfa8e6052489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.536195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-42f41a91-5828-4df1-a83d-bfa8e6052489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:37.536838 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-42f41a91-5828-4df1-a83d-bfa8e6052489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:37.820946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4f6fa50d-c208-493c-9b57-f14a48a657c4 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1214 microversion: 2.1 time: 0.422592 Aug 04 04:40:37.822787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 104/210] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:37 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1214 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:37.830268 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-42f41a91-5828-4df1-a83d-bfa8e6052489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:37.843020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-42f41a91-5828-4df1-a83d-bfa8e6052489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.350669 Aug 04 04:40:37.845467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 107/211] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:37 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:38.339835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1b8b98dc-daf3-4cde-88ce-805b502a8ac2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:38.340490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1b8b98dc-daf3-4cde-88ce-805b502a8ac2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:38.354021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1b8b98dc-daf3-4cde-88ce-805b502a8ac2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:38.354938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1b8b98dc-daf3-4cde-88ce-805b502a8ac2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:38.356470 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1b8b98dc-daf3-4cde-88ce-805b502a8ac2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:38.358478 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1b8b98dc-daf3-4cde-88ce-805b502a8ac2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:38.397124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1b8b98dc-daf3-4cde-88ce-805b502a8ac2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/ips" status: 200 len: 149 microversion: 2.1 time: 0.061836 Aug 04 04:40:38.407260 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 105/212] 10.222.0.47 () {58 vars in 1248 bytes} [Thu Aug 4 04:40:38 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/ips => generated 149 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:38.846890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b1797697-8bd6-4df9-9ead-4a1e3ad18dc1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:38.848179 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b1797697-8bd6-4df9-9ead-4a1e3ad18dc1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:38.861054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1797697-8bd6-4df9-9ead-4a1e3ad18dc1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:38.861897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1797697-8bd6-4df9-9ead-4a1e3ad18dc1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:38.863227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1797697-8bd6-4df9-9ead-4a1e3ad18dc1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:38.864860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1797697-8bd6-4df9-9ead-4a1e3ad18dc1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:38.866623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e8c0a13a-afc6-49b6-adc9-af2922070e89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:38.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e8c0a13a-afc6-49b6-adc9-af2922070e89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:38.882644 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8c0a13a-afc6-49b6-adc9-af2922070e89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:38.887141 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8c0a13a-afc6-49b6-adc9-af2922070e89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:38.889526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8c0a13a-afc6-49b6-adc9-af2922070e89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:38.891007 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8c0a13a-afc6-49b6-adc9-af2922070e89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:38.909314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:39.216959 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b1797697-8bd6-4df9-9ead-4a1e3ad18dc1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:39.230287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b1797697-8bd6-4df9-9ead-4a1e3ad18dc1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1266 microversion: 2.1 time: 0.387472 Aug 04 04:40:39.231496 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 108/213] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:38 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:39.280593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e8c0a13a-afc6-49b6-adc9-af2922070e89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:39.289096 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e8c0a13a-afc6-49b6-adc9-af2922070e89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.426586 Aug 04 04:40:39.295514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 106/214] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:38 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:39.917835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-37a3c923-544d-4414-b434-c010dcc6a20c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f43986d4-c50f-4c20-a9c5-8945a91e48b6"}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:39.922145 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-37a3c923-544d-4414-b434-c010dcc6a20c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:39.932900 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-37a3c923-544d-4414-b434-c010dcc6a20c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:39.934003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-37a3c923-544d-4414-b434-c010dcc6a20c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:39.936500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-37a3c923-544d-4414-b434-c010dcc6a20c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:39.937682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-37a3c923-544d-4414-b434-c010dcc6a20c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:40.261473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7735c92f-5128-482c-8904-1bd59a796848 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:40.262801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7735c92f-5128-482c-8904-1bd59a796848 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:40.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7735c92f-5128-482c-8904-1bd59a796848 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:40.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7735c92f-5128-482c-8904-1bd59a796848 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:40.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7735c92f-5128-482c-8904-1bd59a796848 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:40.291410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7735c92f-5128-482c-8904-1bd59a796848 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:40.532191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-37a3c923-544d-4414-b434-c010dcc6a20c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "POST /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.617925 Aug 04 04:40:40.540977 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 109/215] 10.222.0.47 () {60 vars in 1323 bytes} [Thu Aug 4 04:40:39 2022] POST /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/os-volume_attachments => generated 194 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:40.546181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e3a7b986-7f5b-41f2-abc0-997d198aff73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:40.550137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e3a7b986-7f5b-41f2-abc0-997d198aff73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:40.572858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e3a7b986-7f5b-41f2-abc0-997d198aff73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:40.577732 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e3a7b986-7f5b-41f2-abc0-997d198aff73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:40.578720 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e3a7b986-7f5b-41f2-abc0-997d198aff73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:40.579537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e3a7b986-7f5b-41f2-abc0-997d198aff73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:40.993063 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7735c92f-5128-482c-8904-1bd59a796848 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:40.997228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:41.000684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e3a7b986-7f5b-41f2-abc0-997d198aff73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:41.012378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e3a7b986-7f5b-41f2-abc0-997d198aff73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.473833 Aug 04 04:40:41.012992 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 110/216] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:40 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:41.016240 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7735c92f-5128-482c-8904-1bd59a796848 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1314 microversion: 2.1 time: 0.765581 Aug 04 04:40:41.017754 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 107/217] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:40 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:41.072039 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7584f5c0-5b16-4b2d-b834-72c163088197 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0960b040-d517-43ab-bf33-9ab1e6c05fef"}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:41.078102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7584f5c0-5b16-4b2d-b834-72c163088197 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:41.099241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7584f5c0-5b16-4b2d-b834-72c163088197 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:41.099978 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7584f5c0-5b16-4b2d-b834-72c163088197 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:41.101100 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7584f5c0-5b16-4b2d-b834-72c163088197 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:41.101732 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7584f5c0-5b16-4b2d-b834-72c163088197 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:41.709436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-1c59bf26-9fb5-4a5b-af27-f604b4d84e87 req-deb5c60a-fd6c-47b1-a644-40b2bf1fcfdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f63bcb5d-3625-47c0-9421-cf950da0b22d", "tag": "b0e1dea9-3a66-4791-b424-42ef32f56879"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:41.755494 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-1c59bf26-9fb5-4a5b-af27-f604b4d84e87 req-deb5c60a-fd6c-47b1-a644-40b2bf1fcfdf service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:41.757634 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-1c59bf26-9fb5-4a5b-af27-f604b4d84e87 req-deb5c60a-fd6c-47b1-a644-40b2bf1fcfdf service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:41.783043 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7584f5c0-5b16-4b2d-b834-72c163088197 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "POST /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.764563 Aug 04 04:40:41.786746 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 111/218] 10.222.0.47 () {60 vars in 1323 bytes} [Thu Aug 4 04:40:41 2022] POST /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/os-volume_attachments => generated 194 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:40:41.823018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-1c59bf26-9fb5-4a5b-af27-f604b4d84e87 req-deb5c60a-fd6c-47b1-a644-40b2bf1fcfdf service nova] Creating event network-changed:b0e1dea9-3a66-4791-b424-42ef32f56879 for instance f63bcb5d-3625-47c0-9421-cf950da0b22d on hv-cinder-85127 Aug 04 04:40:41.842667 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-1c59bf26-9fb5-4a5b-af27-f604b4d84e87 req-deb5c60a-fd6c-47b1-a644-40b2bf1fcfdf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147321 Aug 04 04:40:41.843369 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 108/219] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:40:42.048398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-45ba9bfa-7eec-4ad0-bfbd-26f773ef3485 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:42.049942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-45ba9bfa-7eec-4ad0-bfbd-26f773ef3485 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:42.050164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-36e8bbd9-61b7-41f9-86da-dc8be0d35936 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:42.051457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-36e8bbd9-61b7-41f9-86da-dc8be0d35936 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:42.076417 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-36e8bbd9-61b7-41f9-86da-dc8be0d35936 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:42.076879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-36e8bbd9-61b7-41f9-86da-dc8be0d35936 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:42.077695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-36e8bbd9-61b7-41f9-86da-dc8be0d35936 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:42.078145 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-36e8bbd9-61b7-41f9-86da-dc8be0d35936 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:42.083411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-45ba9bfa-7eec-4ad0-bfbd-26f773ef3485 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:42.084113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-45ba9bfa-7eec-4ad0-bfbd-26f773ef3485 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:42.085059 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-45ba9bfa-7eec-4ad0-bfbd-26f773ef3485 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:42.085675 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-45ba9bfa-7eec-4ad0-bfbd-26f773ef3485 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:42.568304 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-36e8bbd9-61b7-41f9-86da-dc8be0d35936 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:42.577811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-36e8bbd9-61b7-41f9-86da-dc8be0d35936 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1314 microversion: 2.1 time: 0.538096 Aug 04 04:40:42.595941 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-45ba9bfa-7eec-4ad0-bfbd-26f773ef3485 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:42.604772 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 109/220] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:42 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:42.607029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-45ba9bfa-7eec-4ad0-bfbd-26f773ef3485 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.575523 Aug 04 04:40:42.608128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 112/221] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:42 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:43.610133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8700cc08-e4db-4be4-92f9-d0eb6309eac1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:43.610884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8700cc08-e4db-4be4-92f9-d0eb6309eac1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:43.620842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8700cc08-e4db-4be4-92f9-d0eb6309eac1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:43.622049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8700cc08-e4db-4be4-92f9-d0eb6309eac1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:43.630713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e06b0b50-f913-40c8-94eb-8129556a4809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:43.632217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e06b0b50-f913-40c8-94eb-8129556a4809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:43.637713 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8700cc08-e4db-4be4-92f9-d0eb6309eac1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:43.639635 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8700cc08-e4db-4be4-92f9-d0eb6309eac1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:43.649560 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e06b0b50-f913-40c8-94eb-8129556a4809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:43.650313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e06b0b50-f913-40c8-94eb-8129556a4809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:43.653358 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e06b0b50-f913-40c8-94eb-8129556a4809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:43.654264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e06b0b50-f913-40c8-94eb-8129556a4809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:43.905664 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8700cc08-e4db-4be4-92f9-d0eb6309eac1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:43.914698 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8700cc08-e4db-4be4-92f9-d0eb6309eac1 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1314 microversion: 2.1 time: 0.315167 Aug 04 04:40:43.920794 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 110/222] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:43 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:43.941750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e06b0b50-f913-40c8-94eb-8129556a4809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:43.952252 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e06b0b50-f913-40c8-94eb-8129556a4809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.327641 Aug 04 04:40:43.955755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 113/223] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:43 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:44.941898 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-33634a29-530b-4dde-9564-1e522f1a620d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:44.944625 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-33634a29-530b-4dde-9564-1e522f1a620d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:44.954899 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-33634a29-530b-4dde-9564-1e522f1a620d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:44.955550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-33634a29-530b-4dde-9564-1e522f1a620d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:44.956368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-33634a29-530b-4dde-9564-1e522f1a620d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:44.956816 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-33634a29-530b-4dde-9564-1e522f1a620d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:44.979891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-46e6b63d-f87e-49a7-ae15-a80652d9361b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:44.980564 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-46e6b63d-f87e-49a7-ae15-a80652d9361b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:44.987290 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46e6b63d-f87e-49a7-ae15-a80652d9361b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:44.988233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46e6b63d-f87e-49a7-ae15-a80652d9361b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:44.989690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46e6b63d-f87e-49a7-ae15-a80652d9361b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:44.990832 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46e6b63d-f87e-49a7-ae15-a80652d9361b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:45.346083 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-46e6b63d-f87e-49a7-ae15-a80652d9361b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:45.348863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-33634a29-530b-4dde-9564-1e522f1a620d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:45.363569 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-33634a29-530b-4dde-9564-1e522f1a620d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1314 microversion: 2.1 time: 0.425517 Aug 04 04:40:45.364654 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 111/224] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:44 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:45.365517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-46e6b63d-f87e-49a7-ae15-a80652d9361b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.388929 Aug 04 04:40:45.366148 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 114/225] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:44 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:46.387540 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5e29b613-c12a-49a7-a00e-e9e724ca1ff5 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:46.388149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5e29b613-c12a-49a7-a00e-e9e724ca1ff5 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:46.388868 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8738032d-30b1-44d9-a7a1-b3edf711708f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:46.389799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8738032d-30b1-44d9-a7a1-b3edf711708f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:46.399521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5e29b613-c12a-49a7-a00e-e9e724ca1ff5 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:46.400088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5e29b613-c12a-49a7-a00e-e9e724ca1ff5 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:46.400868 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5e29b613-c12a-49a7-a00e-e9e724ca1ff5 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:46.403322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8738032d-30b1-44d9-a7a1-b3edf711708f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:46.403614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8738032d-30b1-44d9-a7a1-b3edf711708f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:46.404027 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5e29b613-c12a-49a7-a00e-e9e724ca1ff5 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:46.404761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8738032d-30b1-44d9-a7a1-b3edf711708f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:46.406399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8738032d-30b1-44d9-a7a1-b3edf711708f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:46.684973 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5e29b613-c12a-49a7-a00e-e9e724ca1ff5 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:46.698855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5e29b613-c12a-49a7-a00e-e9e724ca1ff5 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1314 microversion: 2.1 time: 0.315981 Aug 04 04:40:46.699437 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8738032d-30b1-44d9-a7a1-b3edf711708f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:46.709702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 112/226] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:46 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:46.713036 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8738032d-30b1-44d9-a7a1-b3edf711708f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.329309 Aug 04 04:40:46.713654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 115/227] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:46 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:47.195549 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-730597bf-bec0-44a5-aa2c-99b662c559a5 req-0a7e7079-f83f-414b-a237-c72e241df3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63bcb5d-3625-47c0-9421-cf950da0b22d", "name": "network-vif-plugged", "status": "completed", "tag": "b0e1dea9-3a66-4791-b424-42ef32f56879"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:47.218991 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-730597bf-bec0-44a5-aa2c-99b662c559a5 req-0a7e7079-f83f-414b-a237-c72e241df3a4 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.219349 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-730597bf-bec0-44a5-aa2c-99b662c559a5 req-0a7e7079-f83f-414b-a237-c72e241df3a4 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:47.287466 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-730597bf-bec0-44a5-aa2c-99b662c559a5 req-0a7e7079-f83f-414b-a237-c72e241df3a4 service nova] Creating event network-vif-plugged:b0e1dea9-3a66-4791-b424-42ef32f56879 for instance f63bcb5d-3625-47c0-9421-cf950da0b22d on hv-cinder-85127 Aug 04 04:40:47.299354 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-730597bf-bec0-44a5-aa2c-99b662c559a5 req-0a7e7079-f83f-414b-a237-c72e241df3a4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116423 Aug 04 04:40:47.302032 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 113/228] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:40:47.723191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d0e45870-9bf4-453d-95d5-ddca791a2e3d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:47.724489 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d0e45870-9bf4-453d-95d5-ddca791a2e3d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:47.736920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6d80bf70-f4a9-42ad-8018-b793f1c760a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:47.750515 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:47.752005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6d80bf70-f4a9-42ad-8018-b793f1c760a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:47.758343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=6 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:47.766189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d0e45870-9bf4-453d-95d5-ddca791a2e3d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.766440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6d80bf70-f4a9-42ad-8018-b793f1c760a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.767250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6d80bf70-f4a9-42ad-8018-b793f1c760a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:47.768278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6d80bf70-f4a9-42ad-8018-b793f1c760a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.768932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6d80bf70-f4a9-42ad-8018-b793f1c760a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:47.772108 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d0e45870-9bf4-453d-95d5-ddca791a2e3d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:47.774092 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d0e45870-9bf4-453d-95d5-ddca791a2e3d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:47.779213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d0e45870-9bf4-453d-95d5-ddca791a2e3d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:47.820790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:48.399903 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6d80bf70-f4a9-42ad-8018-b793f1c760a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:48.419202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6d80bf70-f4a9-42ad-8018-b793f1c760a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.685520 Aug 04 04:40:48.434600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 114/229] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:47 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:48.449790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4e51b646-7455-4ce5-9bf6-4cb50517c679 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:48.468801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e51b646-7455-4ce5-9bf6-4cb50517c679 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:48.471046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e51b646-7455-4ce5-9bf6-4cb50517c679 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:48.521860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d0e45870-9bf4-453d-95d5-ddca791a2e3d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:48.538539 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d0e45870-9bf4-453d-95d5-ddca791a2e3d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1314 microversion: 2.1 time: 0.818325 Aug 04 04:40:48.539151 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 116/230] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:47 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:48.628620 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4e51b646-7455-4ce5-9bf6-4cb50517c679 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Going to try to stop instance {{(pid=134883) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 04:40:48.712813 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4e51b646-7455-4ce5-9bf6-4cb50517c679 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "POST /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/action" status: 202 len: 0 microversion: 2.1 time: 0.275639 Aug 04 04:40:48.723204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-28cbb86f-19c2-4697-81a6-05dbf36c7c63 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:48.724557 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-28cbb86f-19c2-4697-81a6-05dbf36c7c63 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:48.726312 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 115/231] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:40:48 2022] POST /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:40:48.764783 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-28cbb86f-19c2-4697-81a6-05dbf36c7c63 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:48.765235 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-28cbb86f-19c2-4697-81a6-05dbf36c7c63 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:48.766054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-28cbb86f-19c2-4697-81a6-05dbf36c7c63 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:48.766490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-28cbb86f-19c2-4697-81a6-05dbf36c7c63 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:49.104500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-28cbb86f-19c2-4697-81a6-05dbf36c7c63 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:49.113648 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-28cbb86f-19c2-4697-81a6-05dbf36c7c63 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1720 microversion: 2.1 time: 0.395431 Aug 04 04:40:49.114837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 117/232] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:48 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1720 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:49.462665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-491e30e8-d8a9-43cd-9d11-46504a586f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:49.463495 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-491e30e8-d8a9-43cd-9d11-46504a586f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:49.502873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-491e30e8-d8a9-43cd-9d11-46504a586f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:49.503315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-491e30e8-d8a9-43cd-9d11-46504a586f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:49.504346 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-491e30e8-d8a9-43cd-9d11-46504a586f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:49.504550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-491e30e8-d8a9-43cd-9d11-46504a586f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:49.561438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-92c31c79-8c35-4012-8d3f-0d836e86b7c7 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:49.562110 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-92c31c79-8c35-4012-8d3f-0d836e86b7c7 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:49.604530 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-92c31c79-8c35-4012-8d3f-0d836e86b7c7 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:49.604986 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-92c31c79-8c35-4012-8d3f-0d836e86b7c7 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:49.638121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-92c31c79-8c35-4012-8d3f-0d836e86b7c7 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:49.638632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-92c31c79-8c35-4012-8d3f-0d836e86b7c7 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:49.907067 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-491e30e8-d8a9-43cd-9d11-46504a586f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:49.920803 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-491e30e8-d8a9-43cd-9d11-46504a586f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.465363 Aug 04 04:40:49.923183 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 116/233] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:49 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:50.062385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-92c31c79-8c35-4012-8d3f-0d836e86b7c7 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:50.072595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-92c31c79-8c35-4012-8d3f-0d836e86b7c7 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1314 microversion: 2.1 time: 0.515999 Aug 04 04:40:50.076603 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 118/234] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:49 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:50.144594 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-89858781-5bad-455a-9d9a-9a013552bce3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:50.145515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-89858781-5bad-455a-9d9a-9a013552bce3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:50.169443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89858781-5bad-455a-9d9a-9a013552bce3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:50.170046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89858781-5bad-455a-9d9a-9a013552bce3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:50.170893 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89858781-5bad-455a-9d9a-9a013552bce3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:50.171551 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89858781-5bad-455a-9d9a-9a013552bce3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:50.416242 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-89858781-5bad-455a-9d9a-9a013552bce3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:50.425986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-89858781-5bad-455a-9d9a-9a013552bce3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1720 microversion: 2.1 time: 0.290573 Aug 04 04:40:50.427182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 117/235] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:50 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1720 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:50.954710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f19c7a6a-a4e9-4988-8c59-73a4e478cfad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:50.957340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f19c7a6a-a4e9-4988-8c59-73a4e478cfad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:50.974892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f19c7a6a-a4e9-4988-8c59-73a4e478cfad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:50.976806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f19c7a6a-a4e9-4988-8c59-73a4e478cfad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:50.978526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f19c7a6a-a4e9-4988-8c59-73a4e478cfad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:50.979499 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f19c7a6a-a4e9-4988-8c59-73a4e478cfad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:51.099640 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ded182f8-3a33-418b-9021-4a85cdbbd865 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:51.101123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ded182f8-3a33-418b-9021-4a85cdbbd865 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:51.113022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ded182f8-3a33-418b-9021-4a85cdbbd865 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:51.120537 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ded182f8-3a33-418b-9021-4a85cdbbd865 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:51.121748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ded182f8-3a33-418b-9021-4a85cdbbd865 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:51.122370 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ded182f8-3a33-418b-9021-4a85cdbbd865 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:51.467184 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f19c7a6a-a4e9-4988-8c59-73a4e478cfad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:51.480731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f19c7a6a-a4e9-4988-8c59-73a4e478cfad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.535217 Aug 04 04:40:51.482677 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 119/236] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:50 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:51.495148 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7fcb41ed-684d-416c-b9a6-60a6d94f253f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:51.497977 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7fcb41ed-684d-416c-b9a6-60a6d94f253f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:51.516878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7fcb41ed-684d-416c-b9a6-60a6d94f253f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:51.520493 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7fcb41ed-684d-416c-b9a6-60a6d94f253f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:51.521924 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7fcb41ed-684d-416c-b9a6-60a6d94f253f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:51.522765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7fcb41ed-684d-416c-b9a6-60a6d94f253f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:51.606562 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ded182f8-3a33-418b-9021-4a85cdbbd865 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:51.616363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ded182f8-3a33-418b-9021-4a85cdbbd865 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1498 microversion: 2.1 time: 0.520954 Aug 04 04:40:51.616958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 118/237] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:51 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1498 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:51.760674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7fcb41ed-684d-416c-b9a6-60a6d94f253f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:51.782932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7fcb41ed-684d-416c-b9a6-60a6d94f253f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1720 microversion: 2.1 time: 0.292163 Aug 04 04:40:51.799056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 120/238] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:51 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1720 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:52.396570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f14399e3-c80d-41c5-a650-d84b1107fd02 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:52.397164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f14399e3-c80d-41c5-a650-d84b1107fd02 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:52.408628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f14399e3-c80d-41c5-a650-d84b1107fd02 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:52.409518 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f14399e3-c80d-41c5-a650-d84b1107fd02 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:52.410728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f14399e3-c80d-41c5-a650-d84b1107fd02 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:52.411413 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f14399e3-c80d-41c5-a650-d84b1107fd02 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:52.473442 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f14399e3-c80d-41c5-a650-d84b1107fd02 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Going to try to terminate instance {{(pid=134883) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:40:52.510078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0fbaa17e-2c50-4625-8c9c-ac636e9b0f41 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:52.510719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0fbaa17e-2c50-4625-8c9c-ac636e9b0f41 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:52.517999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0fbaa17e-2c50-4625-8c9c-ac636e9b0f41 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:52.528627 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0fbaa17e-2c50-4625-8c9c-ac636e9b0f41 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:52.530689 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0fbaa17e-2c50-4625-8c9c-ac636e9b0f41 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:52.531419 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0fbaa17e-2c50-4625-8c9c-ac636e9b0f41 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:52.698813 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f14399e3-c80d-41c5-a650-d84b1107fd02 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 204 len: 0 microversion: 2.1 time: 0.307550 Aug 04 04:40:52.701342 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 119/239] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:40:52 2022] DELETE /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:40:52.722341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1d501b96-908c-4364-9252-bfdf71af827e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:52.723120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1d501b96-908c-4364-9252-bfdf71af827e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:52.749102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d501b96-908c-4364-9252-bfdf71af827e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:52.752655 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d501b96-908c-4364-9252-bfdf71af827e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:52.755730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d501b96-908c-4364-9252-bfdf71af827e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:52.756205 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d501b96-908c-4364-9252-bfdf71af827e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:53.004933 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0fbaa17e-2c50-4625-8c9c-ac636e9b0f41 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:53.016823 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0fbaa17e-2c50-4625-8c9c-ac636e9b0f41 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.515852 Aug 04 04:40:53.025423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 121/240] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:52 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:40:53.042135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3654aa15-a506-4e65-878c-98dc2e268f5f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:53.042481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3654aa15-a506-4e65-878c-98dc2e268f5f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:53.058002 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3654aa15-a506-4e65-878c-98dc2e268f5f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:53.058771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3654aa15-a506-4e65-878c-98dc2e268f5f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:53.065988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3654aa15-a506-4e65-878c-98dc2e268f5f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:53.066679 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3654aa15-a506-4e65-878c-98dc2e268f5f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:53.072640 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1d501b96-908c-4364-9252-bfdf71af827e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:53.081764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1d501b96-908c-4364-9252-bfdf71af827e tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1504 microversion: 2.1 time: 0.372933 Aug 04 04:40:53.096131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 120/241] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:52 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:53.108204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:53.396542 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3654aa15-a506-4e65-878c-98dc2e268f5f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:53.408492 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3654aa15-a506-4e65-878c-98dc2e268f5f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1720 microversion: 2.1 time: 0.377376 Aug 04 04:40:53.423831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 122/242] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:53 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1720 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:54.053039 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c7cc6d82-0d59-4d15-9171-74375afba0ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:54.055900 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c7cc6d82-0d59-4d15-9171-74375afba0ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:54.061343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:54.066496 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7cc6d82-0d59-4d15-9171-74375afba0ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:54.067274 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7cc6d82-0d59-4d15-9171-74375afba0ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:54.068227 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7cc6d82-0d59-4d15-9171-74375afba0ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:54.068839 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7cc6d82-0d59-4d15-9171-74375afba0ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:54.109938 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9473921c-8b56-430a-a38f-0f0c935536bb tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:54.111230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9473921c-8b56-430a-a38f-0f0c935536bb tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:54.125388 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9473921c-8b56-430a-a38f-0f0c935536bb tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:54.135688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9473921c-8b56-430a-a38f-0f0c935536bb tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:54.136628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9473921c-8b56-430a-a38f-0f0c935536bb tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:54.137150 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9473921c-8b56-430a-a38f-0f0c935536bb tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:54.410097 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c7cc6d82-0d59-4d15-9171-74375afba0ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:54.422521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c7cc6d82-0d59-4d15-9171-74375afba0ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.377345 Aug 04 04:40:54.429968 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 121/243] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:54 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:54.441828 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8fbd531e-5594-4186-b9f6-8c682100faa6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:54.441828 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8fbd531e-5594-4186-b9f6-8c682100faa6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:54.451060 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8fbd531e-5594-4186-b9f6-8c682100faa6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:54.451440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8fbd531e-5594-4186-b9f6-8c682100faa6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:54.454892 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8fbd531e-5594-4186-b9f6-8c682100faa6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:54.455406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8fbd531e-5594-4186-b9f6-8c682100faa6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:54.575368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9473921c-8b56-430a-a38f-0f0c935536bb tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:54.592319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9473921c-8b56-430a-a38f-0f0c935536bb tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1504 microversion: 2.1 time: 0.492478 Aug 04 04:40:54.604203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 123/244] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:54 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1504 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:54.799907 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8fbd531e-5594-4186-b9f6-8c682100faa6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:54.813175 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8fbd531e-5594-4186-b9f6-8c682100faa6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1720 microversion: 2.1 time: 0.381060 Aug 04 04:40:54.816677 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 122/245] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:54 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1720 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:55.457933 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-29eb2a2e-02ad-4411-b6c2-2842adc5e8e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:55.461046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-29eb2a2e-02ad-4411-b6c2-2842adc5e8e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:55.481702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29eb2a2e-02ad-4411-b6c2-2842adc5e8e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:55.482466 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29eb2a2e-02ad-4411-b6c2-2842adc5e8e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:55.485634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29eb2a2e-02ad-4411-b6c2-2842adc5e8e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:55.486202 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29eb2a2e-02ad-4411-b6c2-2842adc5e8e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:55.609170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-377e872a-2efa-4804-985e-3e1fcee8334b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Action: 'create', calling method: .version_select at 0x7fc942460e50>, body: {"keypair": {"name": "tempest-keypair-1610084148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGG7YkXlCE5bhxGsmMyT86GEBDNCjWoXZFdquM6f3arlPybg0kEFOBiWzOs8NsN55Hy4qjXM72ns2aIw2qbErd+5ZV9K8pyGPndsaB6hX7fcU/bkH4LRWSHTQoU8JJxxg=="}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:55.630412 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-377e872a-2efa-4804-985e-3e1fcee8334b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for project 9124d19d48f44fe2a904a715e5db1223. Resources: {'key_pairs'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:40:55.637846 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-377e872a-2efa-4804-985e-3e1fcee8334b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for user 49a7ce9a27734dc0a187d1b217206785 and project 9124d19d48f44fe2a904a715e5db1223. Resources: {'key_pairs'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:40:55.678052 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-377e872a-2efa-4804-985e-3e1fcee8334b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.076234 Aug 04 04:40:55.688737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 123/246] 10.222.0.47 () {60 vars in 1159 bytes} [Thu Aug 4 04:40:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:40:55.694296 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cb069b16-c5fd-4136-8370-91b11822ad0d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:55.695150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cb069b16-c5fd-4136-8370-91b11822ad0d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:55.705831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb069b16-c5fd-4136-8370-91b11822ad0d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:55.706415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb069b16-c5fd-4136-8370-91b11822ad0d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:55.707352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb069b16-c5fd-4136-8370-91b11822ad0d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:55.707959 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb069b16-c5fd-4136-8370-91b11822ad0d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:55.738085 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:55.888692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-29eb2a2e-02ad-4411-b6c2-2842adc5e8e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:55.900435 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-29eb2a2e-02ad-4411-b6c2-2842adc5e8e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.445882 Aug 04 04:40:55.914205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 124/247] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:55 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:55.928217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d7d06e98-30eb-4d5a-846d-5b9a3aece1a2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:55.929768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d7d06e98-30eb-4d5a-846d-5b9a3aece1a2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:55.959296 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7d06e98-30eb-4d5a-846d-5b9a3aece1a2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:55.963026 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7d06e98-30eb-4d5a-846d-5b9a3aece1a2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:55.964761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7d06e98-30eb-4d5a-846d-5b9a3aece1a2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:55.965847 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7d06e98-30eb-4d5a-846d-5b9a3aece1a2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:56.050582 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-cb069b16-c5fd-4136-8370-91b11822ad0d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:56.065623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cb069b16-c5fd-4136-8370-91b11822ad0d tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1504 microversion: 2.1 time: 0.375202 Aug 04 04:40:56.071684 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 124/248] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:55 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:56.312892 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-005be074-e5b1-43a6-af2b-5c2031f2f429 req-8dfc6c84-c6b8-4a27-908b-dd899ff0198c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63bcb5d-3625-47c0-9421-cf950da0b22d", "name": "network-vif-deleted", "tag": "b0e1dea9-3a66-4791-b424-42ef32f56879"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:40:56.313204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d7d06e98-30eb-4d5a-846d-5b9a3aece1a2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:56.325343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d7d06e98-30eb-4d5a-846d-5b9a3aece1a2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1720 microversion: 2.1 time: 0.409233 Aug 04 04:40:56.328360 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-005be074-e5b1-43a6-af2b-5c2031f2f429 req-8dfc6c84-c6b8-4a27-908b-dd899ff0198c service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:56.329303 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-005be074-e5b1-43a6-af2b-5c2031f2f429 req-8dfc6c84-c6b8-4a27-908b-dd899ff0198c service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:56.341661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 125/249] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:55 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1720 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:56.368646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-005be074-e5b1-43a6-af2b-5c2031f2f429 req-8dfc6c84-c6b8-4a27-908b-dd899ff0198c service nova] Creating event network-vif-deleted:b0e1dea9-3a66-4791-b424-42ef32f56879 for instance f63bcb5d-3625-47c0-9421-cf950da0b22d on hv-cinder-85127 Aug 04 04:40:56.383254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-005be074-e5b1-43a6-af2b-5c2031f2f429 req-8dfc6c84-c6b8-4a27-908b-dd899ff0198c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076257 Aug 04 04:40:56.384159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 125/250] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:40:56.924478 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b112b9e9-8901-4fba-aba8-c6cbcfdd9f2c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:56.925366 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b112b9e9-8901-4fba-aba8-c6cbcfdd9f2c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:56.937599 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b112b9e9-8901-4fba-aba8-c6cbcfdd9f2c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:56.938074 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b112b9e9-8901-4fba-aba8-c6cbcfdd9f2c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:56.939085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b112b9e9-8901-4fba-aba8-c6cbcfdd9f2c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:56.946325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b112b9e9-8901-4fba-aba8-c6cbcfdd9f2c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:57.107037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-236544b5-c2ec-40f7-a706-cfb7a638da19 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:57.109051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-236544b5-c2ec-40f7-a706-cfb7a638da19 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:57.126775 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-236544b5-c2ec-40f7-a706-cfb7a638da19 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:57.127235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-236544b5-c2ec-40f7-a706-cfb7a638da19 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:57.128734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-236544b5-c2ec-40f7-a706-cfb7a638da19 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:57.130046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-236544b5-c2ec-40f7-a706-cfb7a638da19 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:57.215103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-236544b5-c2ec-40f7-a706-cfb7a638da19 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:57.215848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-236544b5-c2ec-40f7-a706-cfb7a638da19 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:57.216747 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-236544b5-c2ec-40f7-a706-cfb7a638da19 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lazy-loading 'fault' on Instance uuid f63bcb5d-3625-47c0-9421-cf950da0b22d {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:40:57.302093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-236544b5-c2ec-40f7-a706-cfb7a638da19 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b23dd1311554910a19399aa74df9e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ec86581683456b8c52c649eed292e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:57.312947 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-236544b5-c2ec-40f7-a706-cfb7a638da19 tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 200 len: 1304 microversion: 2.1 time: 0.221374 Aug 04 04:40:57.313950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 126/251] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:57 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 1304 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:57.352936 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-709cd024-095d-4ec7-b367-11266267fbeb tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:57.353580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-709cd024-095d-4ec7-b367-11266267fbeb tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:57.369528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-709cd024-095d-4ec7-b367-11266267fbeb tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:57.370378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-709cd024-095d-4ec7-b367-11266267fbeb tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:57.372011 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-709cd024-095d-4ec7-b367-11266267fbeb tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:57.372998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-709cd024-095d-4ec7-b367-11266267fbeb tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:57.476393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b112b9e9-8901-4fba-aba8-c6cbcfdd9f2c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:57.485322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b112b9e9-8901-4fba-aba8-c6cbcfdd9f2c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.566357 Aug 04 04:40:57.503353 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 126/252] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:56 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:57.747703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-709cd024-095d-4ec7-b367-11266267fbeb tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:57.764815 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-709cd024-095d-4ec7-b367-11266267fbeb tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1720 microversion: 2.1 time: 0.411448 Aug 04 04:40:57.766006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 127/253] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:57 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1720 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:58.349092 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-46c0064a-c658-4ae7-a406-e2879c7e50cf tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:58.355685 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-46c0064a-c658-4ae7-a406-e2879c7e50cf tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] [instance: f63bcb5d-3625-47c0-9421-cf950da0b22d] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:58.359105 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:58.375960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46c0064a-c658-4ae7-a406-e2879c7e50cf tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:58.376447 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46c0064a-c658-4ae7-a406-e2879c7e50cf tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:58.377362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46c0064a-c658-4ae7-a406-e2879c7e50cf tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:58.382906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46c0064a-c658-4ae7-a406-e2879c7e50cf tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:58.416291 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-46c0064a-c658-4ae7-a406-e2879c7e50cf tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] HTTP exception thrown: Instance f63bcb5d-3625-47c0-9421-cf950da0b22d could not be found. Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-46c0064a-c658-4ae7-a406-e2879c7e50cf tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Request method failure captured: Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d HTTP/1.1 Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi602gpeNx4SldXIjLO8qVVLMTfL-yit4CZUooL-_LSZ0nrXGNjZF1dhg4sNMiODes8eHWZRxYRIEB-wktVbrZb20i5THWSkggQr-yKqBadKGZyc0YX6V0tqHKYzHkAMAnICPWtONvkPQpAKSTYHDJ7jYu3873F5QA24buzWxoM7F0Vrs Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 23ec86581683456b8c52c649eed292e7 Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-VolumesActionsTest-604895222 Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:40:58.418674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:40:58.420117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/23ec86581683456b8c52c649eed292e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/23ec86581683456b8c52c649eed292e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_23ec86581683456b8c52c649eed292e7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/23ec86581683456b8c52c649eed292e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:40:58.420117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-VolumesActionsTest-604895222 Aug 04 04:40:58.420117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 23ec86581683456b8c52c649eed292e7 Aug 04 04:40:58.420117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-VolumesActionsTest-604895222 Aug 04 04:40:58.420117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-VolumesActionsTest-604895222-project Aug 04 04:40:58.420117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:40:58.420117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:40:58.420117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 1b23dd1311554910a19399aa74df9e4c Aug 04 04:40:58.420117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-VolumesActionsTest-604895222-project Aug 04 04:40:58.420117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 04:40:58.420117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance f63bcb5d-3625-47c0-9421-cf950da0b22d could not be found. Aug 04 04:40:58.420117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'f63bcb5d-3625-47c0-9421-cf950da0b22d'} Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f63bcb5d-3625-47c0-9421-cf950da0b22d could not be found. Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:40:58.421604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f63bcb5d-3625-47c0-9421-cf950da0b22d could not be found. Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f63bcb5d-3625-47c0-9421-cf950da0b22d could not be found. Aug 04 04:40:58.424690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:40:58.432341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-46c0064a-c658-4ae7-a406-e2879c7e50cf tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] Returning 404 to user: Instance f63bcb5d-3625-47c0-9421-cf950da0b22d could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:40:58.433463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-46c0064a-c658-4ae7-a406-e2879c7e50cf tempest-VolumesActionsTest-604895222 tempest-VolumesActionsTest-604895222-project] 10.222.0.47 "GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d" status: 404 len: 111 microversion: 2.1 time: 0.100749 Aug 04 04:40:58.434565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 127/254] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:58 2022] GET /compute/v2.1/servers/f63bcb5d-3625-47c0-9421-cf950da0b22d => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:40:58.521517 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2ca2f845-1061-4e0f-9524-ef847fd5eacc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:58.522905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2ca2f845-1061-4e0f-9524-ef847fd5eacc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:58.547311 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ca2f845-1061-4e0f-9524-ef847fd5eacc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:58.547656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ca2f845-1061-4e0f-9524-ef847fd5eacc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:58.548446 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ca2f845-1061-4e0f-9524-ef847fd5eacc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:58.548729 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ca2f845-1061-4e0f-9524-ef847fd5eacc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:58.788172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ec4d8af0-76fc-4bb8-93b8-8ec61c7a32b5 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:40:58.794278 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ec4d8af0-76fc-4bb8-93b8-8ec61c7a32b5 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:40:58.815185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ec4d8af0-76fc-4bb8-93b8-8ec61c7a32b5 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:58.816010 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ec4d8af0-76fc-4bb8-93b8-8ec61c7a32b5 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:58.817959 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ec4d8af0-76fc-4bb8-93b8-8ec61c7a32b5 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:40:58.819186 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ec4d8af0-76fc-4bb8-93b8-8ec61c7a32b5 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:40:59.022261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2ca2f845-1061-4e0f-9524-ef847fd5eacc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:59.036955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2ca2f845-1061-4e0f-9524-ef847fd5eacc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.529783 Aug 04 04:40:59.037864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 128/255] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:58 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:59.256273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ec4d8af0-76fc-4bb8-93b8-8ec61c7a32b5 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:40:59.276906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ec4d8af0-76fc-4bb8-93b8-8ec61c7a32b5 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1720 microversion: 2.1 time: 0.493003 Aug 04 04:40:59.277856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 128/256] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:40:58 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1720 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:40:59.443623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2129394737", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67ecd182-cac3-46ef-97d0-ee767463d615"}], "security_groups": [{"name": "tempest-securitygroup--716970359"}], "key_name": "tempest-keypair-1610084148", "user_data": "}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:00.064396 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-29809214-b5de-4061-afd1-d7537ef6a52b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:00.066307 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-29809214-b5de-4061-afd1-d7537ef6a52b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:00.084173 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29809214-b5de-4061-afd1-d7537ef6a52b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:00.085027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29809214-b5de-4061-afd1-d7537ef6a52b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:00.092854 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29809214-b5de-4061-afd1-d7537ef6a52b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:00.093797 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29809214-b5de-4061-afd1-d7537ef6a52b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:00.538728 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-29809214-b5de-4061-afd1-d7537ef6a52b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:00.549086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-29809214-b5de-4061-afd1-d7537ef6a52b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.490726 Aug 04 04:41:00.553394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 129/257] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:00 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:00.561630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d3e02f17-caa1-4ee2-aaf2-cd116fbf4d0e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:00.562966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d3e02f17-caa1-4ee2-aaf2-cd116fbf4d0e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:00.569998 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3e02f17-caa1-4ee2-aaf2-cd116fbf4d0e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:00.570846 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3e02f17-caa1-4ee2-aaf2-cd116fbf4d0e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:00.571636 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3e02f17-caa1-4ee2-aaf2-cd116fbf4d0e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:00.572076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3e02f17-caa1-4ee2-aaf2-cd116fbf4d0e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:00.770460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d3e02f17-caa1-4ee2-aaf2-cd116fbf4d0e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:00.785009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d3e02f17-caa1-4ee2-aaf2-cd116fbf4d0e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1720 microversion: 2.1 time: 0.224650 Aug 04 04:41:00.803166 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 130/258] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:00 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1720 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:01.574619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0b037c6b-5d7b-4454-b3fb-20c8038c5f32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:01.581491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0b037c6b-5d7b-4454-b3fb-20c8038c5f32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:01.605463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b037c6b-5d7b-4454-b3fb-20c8038c5f32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:01.606972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b037c6b-5d7b-4454-b3fb-20c8038c5f32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:01.609885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b037c6b-5d7b-4454-b3fb-20c8038c5f32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:01.610359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b037c6b-5d7b-4454-b3fb-20c8038c5f32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:01.889067 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0b037c6b-5d7b-4454-b3fb-20c8038c5f32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:01.900406 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0b037c6b-5d7b-4454-b3fb-20c8038c5f32 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.332568 Aug 04 04:41:01.901661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 131/259] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:01 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:01.907441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b24afb97-4145-4bb3-9815-425b0d6ff7b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:01.908844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b24afb97-4145-4bb3-9815-425b0d6ff7b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:01.926273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b24afb97-4145-4bb3-9815-425b0d6ff7b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:01.927219 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b24afb97-4145-4bb3-9815-425b0d6ff7b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:01.928692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b24afb97-4145-4bb3-9815-425b0d6ff7b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:01.930692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b24afb97-4145-4bb3-9815-425b0d6ff7b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:02.141911 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] validate_networks() for [('67ecd182-cac3-46ef-97d0-ee767463d615', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:41:02.282063 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b24afb97-4145-4bb3-9815-425b0d6ff7b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:02.292922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b24afb97-4145-4bb3-9815-425b0d6ff7b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1720 microversion: 2.1 time: 0.389842 Aug 04 04:41:02.294314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 132/260] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:01 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1720 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:02.715203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:41:02.716145 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:41:02.716793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:41:02.717217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:41:02.717661 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:41:02.729587 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:02.730192 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:02.731221 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:02.731759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:02.752654 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for project 9124d19d48f44fe2a904a715e5db1223. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:02.759339 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for user 49a7ce9a27734dc0a187d1b217206785 and project 9124d19d48f44fe2a904a715e5db1223. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:02.772428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:41:02.775124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:41:02.844398 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8f00f827-6d69-48d3-9a67-59e042b62c0c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.405644 Aug 04 04:41:02.851530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 129/261] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:40:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 3407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:41:02.868215 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-35522f68-ee07-41ac-8b94-82d071e3700f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:02.869200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-35522f68-ee07-41ac-8b94-82d071e3700f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:02.923902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-93d6f551-5a83-43f1-b49c-38478a905e24 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:02.925075 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-93d6f551-5a83-43f1-b49c-38478a905e24 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:02.934331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93d6f551-5a83-43f1-b49c-38478a905e24 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:02.935373 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93d6f551-5a83-43f1-b49c-38478a905e24 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:02.936377 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93d6f551-5a83-43f1-b49c-38478a905e24 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:02.937012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93d6f551-5a83-43f1-b49c-38478a905e24 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:02.955848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-35522f68-ee07-41ac-8b94-82d071e3700f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:02.967526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-35522f68-ee07-41ac-8b94-82d071e3700f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1242 microversion: 2.1 time: 0.112693 Aug 04 04:41:02.980999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 133/262] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:02 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:03.125117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-93d6f551-5a83-43f1-b49c-38478a905e24 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:03.138799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-93d6f551-5a83-43f1-b49c-38478a905e24 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.219015 Aug 04 04:41:03.139282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 130/263] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:02 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:03.321045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-84db771c-89c2-4e02-99ed-b1dddff8e735 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:03.322171 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-84db771c-89c2-4e02-99ed-b1dddff8e735 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:03.344062 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84db771c-89c2-4e02-99ed-b1dddff8e735 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:03.345061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84db771c-89c2-4e02-99ed-b1dddff8e735 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:03.346949 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84db771c-89c2-4e02-99ed-b1dddff8e735 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:03.347615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84db771c-89c2-4e02-99ed-b1dddff8e735 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:03.604269 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-84db771c-89c2-4e02-99ed-b1dddff8e735 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:03.614970 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-84db771c-89c2-4e02-99ed-b1dddff8e735 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1720 microversion: 2.1 time: 0.299427 Aug 04 04:41:03.615778 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 134/264] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:03 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1720 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:03.989395 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f4578196-ed21-4293-9127-88dce1555bbf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:03.990028 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f4578196-ed21-4293-9127-88dce1555bbf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:03.998908 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f4578196-ed21-4293-9127-88dce1555bbf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:03.999360 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f4578196-ed21-4293-9127-88dce1555bbf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:04.000469 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f4578196-ed21-4293-9127-88dce1555bbf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:04.000885 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f4578196-ed21-4293-9127-88dce1555bbf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:04.081465 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f4578196-ed21-4293-9127-88dce1555bbf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:04.095029 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f4578196-ed21-4293-9127-88dce1555bbf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1246 microversion: 2.1 time: 0.109166 Aug 04 04:41:04.095940 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 131/265] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:03 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1246 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:04.162210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fc5d180e-b3df-400e-b385-ce7c40e61bd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:04.162961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fc5d180e-b3df-400e-b385-ce7c40e61bd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:04.177369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc5d180e-b3df-400e-b385-ce7c40e61bd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:04.177854 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc5d180e-b3df-400e-b385-ce7c40e61bd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:04.178647 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc5d180e-b3df-400e-b385-ce7c40e61bd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:04.179083 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc5d180e-b3df-400e-b385-ce7c40e61bd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:04.366233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fc5d180e-b3df-400e-b385-ce7c40e61bd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:04.375607 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fc5d180e-b3df-400e-b385-ce7c40e61bd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.218554 Aug 04 04:41:04.376597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 135/266] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:04 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:04.638554 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-26699139-25d9-4d29-88e9-e5b1556b7bfe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:04.640842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-26699139-25d9-4d29-88e9-e5b1556b7bfe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:04.648787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26699139-25d9-4d29-88e9-e5b1556b7bfe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:04.649659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26699139-25d9-4d29-88e9-e5b1556b7bfe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:04.651036 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26699139-25d9-4d29-88e9-e5b1556b7bfe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:04.651722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26699139-25d9-4d29-88e9-e5b1556b7bfe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:04.833841 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-26699139-25d9-4d29-88e9-e5b1556b7bfe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:04.845253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-26699139-25d9-4d29-88e9-e5b1556b7bfe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1720 microversion: 2.1 time: 0.210440 Aug 04 04:41:04.846094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 132/267] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:04 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:05.121917 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5a39e84a-e163-4bad-9aba-da3d49cd94f4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:05.122548 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5a39e84a-e163-4bad-9aba-da3d49cd94f4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:05.129690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a39e84a-e163-4bad-9aba-da3d49cd94f4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:05.130147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a39e84a-e163-4bad-9aba-da3d49cd94f4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:05.130981 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a39e84a-e163-4bad-9aba-da3d49cd94f4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:05.131425 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a39e84a-e163-4bad-9aba-da3d49cd94f4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:05.241310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5a39e84a-e163-4bad-9aba-da3d49cd94f4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:05.252438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5a39e84a-e163-4bad-9aba-da3d49cd94f4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1238 microversion: 2.1 time: 0.134273 Aug 04 04:41:05.253240 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 136/268] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:05 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1238 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:05.396545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f500fbd2-a2a9-426f-b200-c47b3fec4549 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:05.397100 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f500fbd2-a2a9-426f-b200-c47b3fec4549 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:05.408089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f500fbd2-a2a9-426f-b200-c47b3fec4549 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:05.408961 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f500fbd2-a2a9-426f-b200-c47b3fec4549 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:05.409889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f500fbd2-a2a9-426f-b200-c47b3fec4549 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:05.410617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f500fbd2-a2a9-426f-b200-c47b3fec4549 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:05.587395 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f500fbd2-a2a9-426f-b200-c47b3fec4549 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:05.595962 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f500fbd2-a2a9-426f-b200-c47b3fec4549 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.203332 Aug 04 04:41:05.596980 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 133/269] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:05 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:05.871312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7d516988-ee9e-4777-957f-986b60eb834d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:05.872231 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7d516988-ee9e-4777-957f-986b60eb834d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:05.881781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d516988-ee9e-4777-957f-986b60eb834d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:05.883271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d516988-ee9e-4777-957f-986b60eb834d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:05.884806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d516988-ee9e-4777-957f-986b60eb834d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:05.886162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d516988-ee9e-4777-957f-986b60eb834d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:06.135763 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7d516988-ee9e-4777-957f-986b60eb834d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:06.149333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7d516988-ee9e-4777-957f-986b60eb834d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1697 microversion: 2.1 time: 0.282482 Aug 04 04:41:06.162598 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 137/270] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:05 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1697 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:06.190264 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b26dc33a-7077-4798-a1b5-e9cafa295ec3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:06.208132 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b26dc33a-7077-4798-a1b5-e9cafa295ec3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:06.209452 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b26dc33a-7077-4798-a1b5-e9cafa295ec3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:06.245270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b26dc33a-7077-4798-a1b5-e9cafa295ec3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Going to try to start instance {{(pid=134883) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 04:41:06.302958 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-17c71516-a50b-4fe5-8773-f1caca1df34b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:06.303712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-17c71516-a50b-4fe5-8773-f1caca1df34b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:06.323552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-17c71516-a50b-4fe5-8773-f1caca1df34b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:06.324382 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-17c71516-a50b-4fe5-8773-f1caca1df34b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:06.325477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-17c71516-a50b-4fe5-8773-f1caca1df34b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:06.326217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-17c71516-a50b-4fe5-8773-f1caca1df34b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:06.442649 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b26dc33a-7077-4798-a1b5-e9cafa295ec3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "POST /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/action" status: 202 len: 0 microversion: 2.1 time: 0.256159 Aug 04 04:41:06.447357 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 134/271] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:41:06 2022] POST /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:06.459598 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-282d10c1-04ae-48a6-99e7-aaa0ddf19106 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:06.461504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-282d10c1-04ae-48a6-99e7-aaa0ddf19106 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:06.475861 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-282d10c1-04ae-48a6-99e7-aaa0ddf19106 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:06.478352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-282d10c1-04ae-48a6-99e7-aaa0ddf19106 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:06.479547 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-282d10c1-04ae-48a6-99e7-aaa0ddf19106 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:06.481573 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-282d10c1-04ae-48a6-99e7-aaa0ddf19106 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:06.547715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-17c71516-a50b-4fe5-8773-f1caca1df34b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:06.562001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-17c71516-a50b-4fe5-8773-f1caca1df34b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1300 microversion: 2.1 time: 0.264239 Aug 04 04:41:06.576122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 138/272] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:06 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1300 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:06.618279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-201e2b26-ffb2-4fd6-8ef9-6bc5ba020d4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:06.619777 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-201e2b26-ffb2-4fd6-8ef9-6bc5ba020d4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:06.646976 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-201e2b26-ffb2-4fd6-8ef9-6bc5ba020d4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:06.651906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-201e2b26-ffb2-4fd6-8ef9-6bc5ba020d4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:06.655001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-201e2b26-ffb2-4fd6-8ef9-6bc5ba020d4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:06.674411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-201e2b26-ffb2-4fd6-8ef9-6bc5ba020d4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:06.759253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-282d10c1-04ae-48a6-99e7-aaa0ddf19106 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:06.778770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-282d10c1-04ae-48a6-99e7-aaa0ddf19106 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1706 microversion: 2.1 time: 0.327196 Aug 04 04:41:06.779807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 135/273] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:06 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1706 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:07.009945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-201e2b26-ffb2-4fd6-8ef9-6bc5ba020d4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:07.022842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-201e2b26-ffb2-4fd6-8ef9-6bc5ba020d4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.405699 Aug 04 04:41:07.025031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 139/274] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:06 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:07.502054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-31e51dac-647b-4abf-8de9-c1f37f6e4386 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Action: 'create', calling method: .version_select at 0x7fc9423fd9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-3372200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI31uYK6gO1Q5W2qXUksylv4o2ABLKL5xBz6T7AqL8EMZRih3hxm2BLs64+rtTCZ9TocL8wM/57kNUwoe76tNBgRgyjxlEvZQajf2sZojUMep74lVHcXx0Z1OPG/Zemheg=="}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:07.538079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-31e51dac-647b-4abf-8de9-c1f37f6e4386 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Getting quotas for project bd7fc43776684ea99eb660966ed97695. Resources: {'key_pairs'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:07.545503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-31e51dac-647b-4abf-8de9-c1f37f6e4386 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Getting quotas for user 2949f24248034487ada1e11bc9a9e4d7 and project bd7fc43776684ea99eb660966ed97695. Resources: {'key_pairs'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:07.584210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ea00d5e4-3897-4ad0-b016-8abaf3580728 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:07.585840 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ea00d5e4-3897-4ad0-b016-8abaf3580728 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:07.596152 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-31e51dac-647b-4abf-8de9-c1f37f6e4386 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.098845 Aug 04 04:41:07.609303 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 136/275] 10.222.0.47 () {60 vars in 1159 bytes} [Thu Aug 4 04:41:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:07.610696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ea00d5e4-3897-4ad0-b016-8abaf3580728 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.611387 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ea00d5e4-3897-4ad0-b016-8abaf3580728 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.612190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ea00d5e4-3897-4ad0-b016-8abaf3580728 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.612629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ea00d5e4-3897-4ad0-b016-8abaf3580728 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.802879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-24619920-0daf-46d4-bfc7-b7d691a4fbb6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:07.803791 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-24619920-0daf-46d4-bfc7-b7d691a4fbb6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:07.823371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24619920-0daf-46d4-bfc7-b7d691a4fbb6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.829097 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24619920-0daf-46d4-bfc7-b7d691a4fbb6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.830271 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24619920-0daf-46d4-bfc7-b7d691a4fbb6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:07.834323 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24619920-0daf-46d4-bfc7-b7d691a4fbb6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:07.861924 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ea00d5e4-3897-4ad0-b016-8abaf3580728 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:07.864666 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:07.879813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ea00d5e4-3897-4ad0-b016-8abaf3580728 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1367 microversion: 2.1 time: 0.299439 Aug 04 04:41:07.880684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 140/276] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:07 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:07.895018 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1829323724", "imageRef": "aee4af14-6fdd-46a2-9358-1e25d49a820d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-3372200", "networks": [{"uuid": "fa0390e0-7c3d-4120-a241-7f12f71c9cda"}]}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:08.053298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.network.neutron [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] validate_networks() for [('fa0390e0-7c3d-4120-a241-7f12f71c9cda', None, None, None, None, None)] {{(pid=134884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:41:08.232806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-24619920-0daf-46d4-bfc7-b7d691a4fbb6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:08.243632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-24619920-0daf-46d4-bfc7-b7d691a4fbb6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1706 microversion: 2.1 time: 0.442271 Aug 04 04:41:08.245853 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 137/277] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:07 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1706 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:08.255754 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-43230b06-0b6b-43f2-a31b-56950843f5f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:08.256409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-43230b06-0b6b-43f2-a31b-56950843f5f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:08.272757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-43230b06-0b6b-43f2-a31b-56950843f5f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.273745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-43230b06-0b6b-43f2-a31b-56950843f5f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.283182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-43230b06-0b6b-43f2-a31b-56950843f5f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.283656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-43230b06-0b6b-43f2-a31b-56950843f5f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.645622 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-43230b06-0b6b-43f2-a31b-56950843f5f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:08.661218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-43230b06-0b6b-43f2-a31b-56950843f5f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.414174 Aug 04 04:41:08.662148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 138/278] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:08 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:08.802119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Flavor limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:41:08.802561 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Image limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:41:08.802861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Flavor pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:41:08.803463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Image pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:41:08.803879 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:41:08.815040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.815713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.816921 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.817447 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.839444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Getting quotas for project bd7fc43776684ea99eb660966ed97695. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:08.845499 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Getting quotas for user 2949f24248034487ada1e11bc9a9e4d7 and project bd7fc43776684ea99eb660966ed97695. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:08.883274 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Going to run 1 instances... {{(pid=134884) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:41:08.887116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aee4af14-6fdd-46a2-9358-1e25d49a820d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:41:08.902966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5caa298b-e1aa-4252-97dc-c6597056b3bd tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:08.903607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5caa298b-e1aa-4252-97dc-c6597056b3bd tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:08.916124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5caa298b-e1aa-4252-97dc-c6597056b3bd tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.916474 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5caa298b-e1aa-4252-97dc-c6597056b3bd tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.917277 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5caa298b-e1aa-4252-97dc-c6597056b3bd tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:08.918010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5caa298b-e1aa-4252-97dc-c6597056b3bd tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:08.990441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-20c7745e-9ba2-42e7-8570-8e4037aa4447 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108493 Aug 04 04:41:08.997886 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 141/279] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:41:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:41:09.006619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3ccba84b-564c-4fa6-95af-193f122d5c55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.007889 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3ccba84b-564c-4fa6-95af-193f122d5c55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:09.079277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3ccba84b-564c-4fa6-95af-193f122d5c55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:09.093926 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3ccba84b-564c-4fa6-95af-193f122d5c55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1256 microversion: 2.1 time: 0.091913 Aug 04 04:41:09.107347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 142/280] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1256 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:09.165829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5caa298b-e1aa-4252-97dc-c6597056b3bd tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:09.175045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5caa298b-e1aa-4252-97dc-c6597056b3bd tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1367 microversion: 2.1 time: 0.277115 Aug 04 04:41:09.188665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 139/281] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:08 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:09.274063 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fcf6606f-d811-480c-b94f-d638bcbc572c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.275478 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fcf6606f-d811-480c-b94f-d638bcbc572c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:09.285993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-7a0ec98c-7691-4b11-b986-27ddcfa7a3c2 req-d53a2ee3-ba65-4617-946f-a16932597187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609de40c-089d-4edb-bb3e-9d66b12890a6", "tag": "36029921-51e1-49fb-8e5b-472199d8098b"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:09.297852 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fcf6606f-d811-480c-b94f-d638bcbc572c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.298548 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fcf6606f-d811-480c-b94f-d638bcbc572c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.301608 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fcf6606f-d811-480c-b94f-d638bcbc572c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.305276 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-7a0ec98c-7691-4b11-b986-27ddcfa7a3c2 req-d53a2ee3-ba65-4617-946f-a16932597187 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.305773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fcf6606f-d811-480c-b94f-d638bcbc572c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.312449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-7a0ec98c-7691-4b11-b986-27ddcfa7a3c2 req-d53a2ee3-ba65-4617-946f-a16932597187 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.335439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-7a0ec98c-7691-4b11-b986-27ddcfa7a3c2 req-d53a2ee3-ba65-4617-946f-a16932597187 service nova] Creating event network-changed:36029921-51e1-49fb-8e5b-472199d8098b for instance 609de40c-089d-4edb-bb3e-9d66b12890a6 on hv-cinder-85127 Aug 04 04:41:09.341017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-7a0ec98c-7691-4b11-b986-27ddcfa7a3c2 req-d53a2ee3-ba65-4617-946f-a16932597187 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059077 Aug 04 04:41:09.342221 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 140/282] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:09.510838 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fcf6606f-d811-480c-b94f-d638bcbc572c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:09.530950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fcf6606f-d811-480c-b94f-d638bcbc572c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1706 microversion: 2.1 time: 0.267584 Aug 04 04:41:09.533651 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 143/283] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:09 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1706 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:09.686233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b7905daa-ac08-4d95-9471-27886fbf86c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:09.687044 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b7905daa-ac08-4d95-9471-27886fbf86c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:09.702101 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7905daa-ac08-4d95-9471-27886fbf86c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.702558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7905daa-ac08-4d95-9471-27886fbf86c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.703529 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7905daa-ac08-4d95-9471-27886fbf86c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:09.703994 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7905daa-ac08-4d95-9471-27886fbf86c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:09.884984 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b7905daa-ac08-4d95-9471-27886fbf86c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:09.893760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b7905daa-ac08-4d95-9471-27886fbf86c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.214012 Aug 04 04:41:09.894770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 141/284] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:09 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:10.123508 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5706366f-10df-4160-9720-6e42d6150f22 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:10.128091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5706366f-10df-4160-9720-6e42d6150f22 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:10.160405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5706366f-10df-4160-9720-6e42d6150f22 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:10.160855 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5706366f-10df-4160-9720-6e42d6150f22 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:10.162270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5706366f-10df-4160-9720-6e42d6150f22 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:10.162917 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5706366f-10df-4160-9720-6e42d6150f22 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:10.206998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c8c5315a-235a-4891-8cbe-5f1b0d41d5cf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:10.207951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c8c5315a-235a-4891-8cbe-5f1b0d41d5cf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:10.231793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8c5315a-235a-4891-8cbe-5f1b0d41d5cf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:10.232247 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8c5315a-235a-4891-8cbe-5f1b0d41d5cf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:10.238867 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8c5315a-235a-4891-8cbe-5f1b0d41d5cf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:10.245801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8c5315a-235a-4891-8cbe-5f1b0d41d5cf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:10.333432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:10.435086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5706366f-10df-4160-9720-6e42d6150f22 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:10.446665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5706366f-10df-4160-9720-6e42d6150f22 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1260 microversion: 2.1 time: 0.333830 Aug 04 04:41:10.465872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 144/285] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1260 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:10.556334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-46c8f73b-5a1c-43e1-8574-86bec727da31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:10.557907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-46c8f73b-5a1c-43e1-8574-86bec727da31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:10.573699 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46c8f73b-5a1c-43e1-8574-86bec727da31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:10.582568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46c8f73b-5a1c-43e1-8574-86bec727da31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:10.584417 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46c8f73b-5a1c-43e1-8574-86bec727da31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:10.586513 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46c8f73b-5a1c-43e1-8574-86bec727da31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:10.609869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c8c5315a-235a-4891-8cbe-5f1b0d41d5cf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:10.638668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c8c5315a-235a-4891-8cbe-5f1b0d41d5cf tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1367 microversion: 2.1 time: 0.434924 Aug 04 04:41:10.651115 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 142/286] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:10 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1367 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:10.890986 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-46c8f73b-5a1c-43e1-8574-86bec727da31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:10.913043 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-46c8f73b-5a1c-43e1-8574-86bec727da31 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1710 microversion: 2.1 time: 0.361762 Aug 04 04:41:10.930939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 145/287] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:10 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1710 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:10.938581 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7476c0ea-27dc-4b7a-a9a1-db2634a39a0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:10.940371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7476c0ea-27dc-4b7a-a9a1-db2634a39a0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:10.956075 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7476c0ea-27dc-4b7a-a9a1-db2634a39a0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:10.958481 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7476c0ea-27dc-4b7a-a9a1-db2634a39a0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:10.962934 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7476c0ea-27dc-4b7a-a9a1-db2634a39a0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:10.967750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7476c0ea-27dc-4b7a-a9a1-db2634a39a0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:11.226943 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7476c0ea-27dc-4b7a-a9a1-db2634a39a0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:11.237151 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7476c0ea-27dc-4b7a-a9a1-db2634a39a0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.324533 Aug 04 04:41:11.239000 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 143/288] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:10 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:11.478172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-60e8814e-5f32-410a-8a16-627cf5c6e594 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:11.479973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-60e8814e-5f32-410a-8a16-627cf5c6e594 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:11.495602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-60e8814e-5f32-410a-8a16-627cf5c6e594 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:11.496761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-60e8814e-5f32-410a-8a16-627cf5c6e594 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:11.498631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-60e8814e-5f32-410a-8a16-627cf5c6e594 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:11.499665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-60e8814e-5f32-410a-8a16-627cf5c6e594 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:11.633393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-60e8814e-5f32-410a-8a16-627cf5c6e594 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:11.650599 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-60e8814e-5f32-410a-8a16-627cf5c6e594 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1308 microversion: 2.1 time: 0.178879 Aug 04 04:41:11.651359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 146/289] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:11 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:11.666478 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7ab2f1ac-1465-4d4e-ac23-6f4cce84f068 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:11.668130 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7ab2f1ac-1465-4d4e-ac23-6f4cce84f068 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:11.682352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ab2f1ac-1465-4d4e-ac23-6f4cce84f068 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:11.683426 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ab2f1ac-1465-4d4e-ac23-6f4cce84f068 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:11.683855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ab2f1ac-1465-4d4e-ac23-6f4cce84f068 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:11.684371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ab2f1ac-1465-4d4e-ac23-6f4cce84f068 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:11.866125 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7ab2f1ac-1465-4d4e-ac23-6f4cce84f068 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:11.877520 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7ab2f1ac-1465-4d4e-ac23-6f4cce84f068 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1367 microversion: 2.1 time: 0.216214 Aug 04 04:41:11.878117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 144/290] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:11 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:12.272012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ae672deb-bebe-4d45-b180-e014bc173372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:12.273881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ae672deb-bebe-4d45-b180-e014bc173372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:12.281861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ae672deb-bebe-4d45-b180-e014bc173372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:12.282592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ae672deb-bebe-4d45-b180-e014bc173372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:12.283783 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ae672deb-bebe-4d45-b180-e014bc173372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:12.284378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ae672deb-bebe-4d45-b180-e014bc173372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:12.458900 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ae672deb-bebe-4d45-b180-e014bc173372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:12.475200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ae672deb-bebe-4d45-b180-e014bc173372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1523 microversion: 2.1 time: 0.219308 Aug 04 04:41:12.476950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 147/291] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:12 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:12.678258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d5bb77fa-d2cb-4e77-89e8-c7438f72227d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:12.680687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d5bb77fa-d2cb-4e77-89e8-c7438f72227d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:12.691875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5bb77fa-d2cb-4e77-89e8-c7438f72227d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:12.694254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5bb77fa-d2cb-4e77-89e8-c7438f72227d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:12.701079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5bb77fa-d2cb-4e77-89e8-c7438f72227d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:12.702603 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5bb77fa-d2cb-4e77-89e8-c7438f72227d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:12.751489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:12.813315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d5bb77fa-d2cb-4e77-89e8-c7438f72227d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:12.826209 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d5bb77fa-d2cb-4e77-89e8-c7438f72227d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1314 microversion: 2.1 time: 0.151943 Aug 04 04:41:12.827601 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 145/292] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:12 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:12.899917 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-39fc678d-0298-4ec1-9c12-54b21d0bf4df tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:12.900658 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-39fc678d-0298-4ec1-9c12-54b21d0bf4df tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:12.911934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39fc678d-0298-4ec1-9c12-54b21d0bf4df tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:12.912398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39fc678d-0298-4ec1-9c12-54b21d0bf4df tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:12.913193 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39fc678d-0298-4ec1-9c12-54b21d0bf4df tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:12.917042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39fc678d-0298-4ec1-9c12-54b21d0bf4df tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:13.232592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-39fc678d-0298-4ec1-9c12-54b21d0bf4df tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:13.251356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-39fc678d-0298-4ec1-9c12-54b21d0bf4df tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1367 microversion: 2.1 time: 0.355942 Aug 04 04:41:13.253782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 148/293] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:12 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:13.506650 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4ff58fc6-5534-4729-bfaf-e747c5d74ce9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:13.511086 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4ff58fc6-5534-4729-bfaf-e747c5d74ce9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:13.523083 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4ff58fc6-5534-4729-bfaf-e747c5d74ce9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:13.524819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4ff58fc6-5534-4729-bfaf-e747c5d74ce9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:13.528280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4ff58fc6-5534-4729-bfaf-e747c5d74ce9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:13.529008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4ff58fc6-5534-4729-bfaf-e747c5d74ce9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:13.837698 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4ff58fc6-5534-4729-bfaf-e747c5d74ce9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:13.848578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dc80b81d-1b4d-45a1-ae31-de4c0d2a6943 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:13.849370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dc80b81d-1b4d-45a1-ae31-de4c0d2a6943 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:13.857118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4ff58fc6-5534-4729-bfaf-e747c5d74ce9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1503 microversion: 2.1 time: 0.361964 Aug 04 04:41:13.858652 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dc80b81d-1b4d-45a1-ae31-de4c0d2a6943 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:13.861375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 146/294] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:13 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1503 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:13.877218 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dc80b81d-1b4d-45a1-ae31-de4c0d2a6943 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:13.884432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dc80b81d-1b4d-45a1-ae31-de4c0d2a6943 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:13.886194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dc80b81d-1b4d-45a1-ae31-de4c0d2a6943 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:13.888714 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-48ba8e66-b024-42bc-b61c-d8e4080e1b86 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:13.889709 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-48ba8e66-b024-42bc-b61c-d8e4080e1b86 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:13.906532 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48ba8e66-b024-42bc-b61c-d8e4080e1b86 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:13.908059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48ba8e66-b024-42bc-b61c-d8e4080e1b86 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:13.909326 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48ba8e66-b024-42bc-b61c-d8e4080e1b86 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:13.910287 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48ba8e66-b024-42bc-b61c-d8e4080e1b86 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:14.454603 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-dc80b81d-1b4d-45a1-ae31-de4c0d2a6943 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:14.465774 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dc80b81d-1b4d-45a1-ae31-de4c0d2a6943 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.621112 Aug 04 04:41:14.484721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 149/295] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:13 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:14.487269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-48ba8e66-b024-42bc-b61c-d8e4080e1b86 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:14.489688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4d192cfb-d3f5-45c3-9118-def9a9922b8d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:14.490318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4d192cfb-d3f5-45c3-9118-def9a9922b8d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:14.497295 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4d192cfb-d3f5-45c3-9118-def9a9922b8d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:14.498081 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4d192cfb-d3f5-45c3-9118-def9a9922b8d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:14.499056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4d192cfb-d3f5-45c3-9118-def9a9922b8d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:14.499662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4d192cfb-d3f5-45c3-9118-def9a9922b8d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:14.510309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-48ba8e66-b024-42bc-b61c-d8e4080e1b86 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1515 microversion: 2.1 time: 0.630959 Aug 04 04:41:14.512599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 147/296] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:13 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1515 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:14.884367 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4d192cfb-d3f5-45c3-9118-def9a9922b8d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:14.904183 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4d192cfb-d3f5-45c3-9118-def9a9922b8d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1367 microversion: 2.1 time: 0.418182 Aug 04 04:41:14.907404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 150/297] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:14 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1367 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:15.490676 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-75f34e08-6300-45f4-ac3d-f713adfea1f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:15.493365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-75f34e08-6300-45f4-ac3d-f713adfea1f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:15.511388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-75f34e08-6300-45f4-ac3d-f713adfea1f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:15.514422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-75f34e08-6300-45f4-ac3d-f713adfea1f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:15.523728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-75f34e08-6300-45f4-ac3d-f713adfea1f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:15.524282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-75f34e08-6300-45f4-ac3d-f713adfea1f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:15.928021 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d1e0159c-ed93-49c1-a776-19a54abc359f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:15.928628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d1e0159c-ed93-49c1-a776-19a54abc359f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:15.937722 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d1e0159c-ed93-49c1-a776-19a54abc359f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:15.938135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d1e0159c-ed93-49c1-a776-19a54abc359f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:15.938926 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d1e0159c-ed93-49c1-a776-19a54abc359f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:15.939371 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d1e0159c-ed93-49c1-a776-19a54abc359f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:16.279845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-75f34e08-6300-45f4-ac3d-f713adfea1f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:16.307771 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-75f34e08-6300-45f4-ac3d-f713adfea1f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.823254 Aug 04 04:41:16.311028 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 148/298] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:15 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:16.318363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-a9c83b57-845d-4146-9cfd-994ec57973b1 req-7f03aa21-190b-43d4-a086-fadb1fe1626a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1762cb-4b08-41db-8302-59f56c67370a", "tag": "e652ee96-0575-4a05-ad13-04b1d7dbc6e7"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:16.365960 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-a9c83b57-845d-4146-9cfd-994ec57973b1 req-7f03aa21-190b-43d4-a086-fadb1fe1626a service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:16.367434 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-a9c83b57-845d-4146-9cfd-994ec57973b1 req-7f03aa21-190b-43d4-a086-fadb1fe1626a service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:16.422006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-a9c83b57-845d-4146-9cfd-994ec57973b1 req-7f03aa21-190b-43d4-a086-fadb1fe1626a service nova] Creating event network-changed:e652ee96-0575-4a05-ad13-04b1d7dbc6e7 for instance af1762cb-4b08-41db-8302-59f56c67370a on hv-cinder-85127 Aug 04 04:41:16.448803 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-a9c83b57-845d-4146-9cfd-994ec57973b1 req-7f03aa21-190b-43d4-a086-fadb1fe1626a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135636 Aug 04 04:41:16.453218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 149/299] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:16.461995 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-13dd2589-5878-489b-a165-bda3a4d47a9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:16.466665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-13dd2589-5878-489b-a165-bda3a4d47a9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:16.486110 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13dd2589-5878-489b-a165-bda3a4d47a9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:16.489776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13dd2589-5878-489b-a165-bda3a4d47a9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:16.491020 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13dd2589-5878-489b-a165-bda3a4d47a9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:16.492235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13dd2589-5878-489b-a165-bda3a4d47a9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:16.517073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d1e0159c-ed93-49c1-a776-19a54abc359f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:16.525187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d1e0159c-ed93-49c1-a776-19a54abc359f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1367 microversion: 2.1 time: 0.600277 Aug 04 04:41:16.536160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 151/300] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:15 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1367 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:16.560030 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-13dd2589-5878-489b-a165-bda3a4d47a9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lazy-loading 'flavor' on Instance uuid 66e490bd-0671-4049-b64c-74e8dfe5bfb1 {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:41:16.753598 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-13dd2589-5878-489b-a165-bda3a4d47a9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "POST /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1/action" status: 200 len: 32 microversion: 2.1 time: 0.297945 Aug 04 04:41:16.763874 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 150/301] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:41:16 2022] POST /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1/action => generated 32 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:41:16.770067 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f57e9145-1219-426e-ac30-85b02a10242a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:16.770937 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f57e9145-1219-426e-ac30-85b02a10242a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:16.780922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f57e9145-1219-426e-ac30-85b02a10242a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:16.783352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f57e9145-1219-426e-ac30-85b02a10242a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:16.787645 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f57e9145-1219-426e-ac30-85b02a10242a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:16.791045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f57e9145-1219-426e-ac30-85b02a10242a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:17.106190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f57e9145-1219-426e-ac30-85b02a10242a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:17.114846 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f57e9145-1219-426e-ac30-85b02a10242a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.350022 Aug 04 04:41:17.118477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 152/302] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:16 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:17.343299 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3a6c151d-b307-4a11-83c9-b8911e6a3ddd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:17.344513 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3a6c151d-b307-4a11-83c9-b8911e6a3ddd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:17.365647 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3a6c151d-b307-4a11-83c9-b8911e6a3ddd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:17.368432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3a6c151d-b307-4a11-83c9-b8911e6a3ddd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:17.371250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3a6c151d-b307-4a11-83c9-b8911e6a3ddd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:17.374353 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3a6c151d-b307-4a11-83c9-b8911e6a3ddd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:17.559429 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=14 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:17.574001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6ce923e6-62c9-44c7-87fe-45429d5ee48c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:17.575193 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6ce923e6-62c9-44c7-87fe-45429d5ee48c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:17.586383 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6ce923e6-62c9-44c7-87fe-45429d5ee48c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:17.587268 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6ce923e6-62c9-44c7-87fe-45429d5ee48c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:17.588394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6ce923e6-62c9-44c7-87fe-45429d5ee48c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:17.590402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6ce923e6-62c9-44c7-87fe-45429d5ee48c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:17.999147 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3a6c151d-b307-4a11-83c9-b8911e6a3ddd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:18.008072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3a6c151d-b307-4a11-83c9-b8911e6a3ddd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.670634 Aug 04 04:41:18.012275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 151/303] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:17 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:18.077509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6ce923e6-62c9-44c7-87fe-45429d5ee48c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:18.086755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6ce923e6-62c9-44c7-87fe-45429d5ee48c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1367 microversion: 2.1 time: 0.529295 Aug 04 04:41:18.102017 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 153/304] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:17 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1367 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:18.142781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-88e343f1-b1ae-4456-9b3a-f7020900a205 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:18.143423 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-88e343f1-b1ae-4456-9b3a-f7020900a205 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:18.153374 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:18.159862 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-88e343f1-b1ae-4456-9b3a-f7020900a205 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:18.160337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-88e343f1-b1ae-4456-9b3a-f7020900a205 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:18.169921 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-88e343f1-b1ae-4456-9b3a-f7020900a205 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:18.173460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-88e343f1-b1ae-4456-9b3a-f7020900a205 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:18.624550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-88e343f1-b1ae-4456-9b3a-f7020900a205 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:18.636539 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-88e343f1-b1ae-4456-9b3a-f7020900a205 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.499488 Aug 04 04:41:18.637667 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 152/305] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:18 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:19.046978 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cb9e82cd-3e5f-4a21-af5a-ebec4b2dee37 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:19.048038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cb9e82cd-3e5f-4a21-af5a-ebec4b2dee37 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:19.057650 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:19.062303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb9e82cd-3e5f-4a21-af5a-ebec4b2dee37 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:19.063328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb9e82cd-3e5f-4a21-af5a-ebec4b2dee37 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:19.064702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb9e82cd-3e5f-4a21-af5a-ebec4b2dee37 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:19.065451 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb9e82cd-3e5f-4a21-af5a-ebec4b2dee37 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:19.114213 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ad79e0ec-33e7-4f05-9730-301759f7c646 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:19.115863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ad79e0ec-33e7-4f05-9730-301759f7c646 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:19.139302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=10 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:19.149965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad79e0ec-33e7-4f05-9730-301759f7c646 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:19.153212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad79e0ec-33e7-4f05-9730-301759f7c646 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:19.154843 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad79e0ec-33e7-4f05-9730-301759f7c646 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:19.155936 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad79e0ec-33e7-4f05-9730-301759f7c646 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:19.597584 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-cb9e82cd-3e5f-4a21-af5a-ebec4b2dee37 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:19.615115 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cb9e82cd-3e5f-4a21-af5a-ebec4b2dee37 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.580027 Aug 04 04:41:19.616016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 154/306] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:19 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:19.657976 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ad79e0ec-33e7-4f05-9730-301759f7c646 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:19.677508 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-beac2248-c85f-434d-b7b0-135ad4bc4866 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:19.682038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-beac2248-c85f-434d-b7b0-135ad4bc4866 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:19.682434 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ad79e0ec-33e7-4f05-9730-301759f7c646 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1367 microversion: 2.1 time: 0.574151 Aug 04 04:41:19.689756 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 153/307] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:19 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1367 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:19.692498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-beac2248-c85f-434d-b7b0-135ad4bc4866 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:19.693140 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-beac2248-c85f-434d-b7b0-135ad4bc4866 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:19.695022 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-beac2248-c85f-434d-b7b0-135ad4bc4866 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:19.696111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-beac2248-c85f-434d-b7b0-135ad4bc4866 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:19.984273 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-54e75dce-86c5-407a-a144-88f33e8b4880 req-2218114b-568d-4a51-8ce7-5b77e82603b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609de40c-089d-4edb-bb3e-9d66b12890a6", "name": "network-vif-plugged", "status": "completed", "tag": "36029921-51e1-49fb-8e5b-472199d8098b"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:20.045007 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-54e75dce-86c5-407a-a144-88f33e8b4880 req-2218114b-568d-4a51-8ce7-5b77e82603b8 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:20.045456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-54e75dce-86c5-407a-a144-88f33e8b4880 req-2218114b-568d-4a51-8ce7-5b77e82603b8 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:20.107593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-54e75dce-86c5-407a-a144-88f33e8b4880 req-2218114b-568d-4a51-8ce7-5b77e82603b8 service nova] Creating event network-vif-plugged:36029921-51e1-49fb-8e5b-472199d8098b for instance 609de40c-089d-4edb-bb3e-9d66b12890a6 on hv-cinder-85127 Aug 04 04:41:20.120487 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-beac2248-c85f-434d-b7b0-135ad4bc4866 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:20.139814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-54e75dce-86c5-407a-a144-88f33e8b4880 req-2218114b-568d-4a51-8ce7-5b77e82603b8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165754 Aug 04 04:41:20.140846 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 154/308] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:20.148751 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-beac2248-c85f-434d-b7b0-135ad4bc4866 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.488615 Aug 04 04:41:20.149538 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 155/309] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:19 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:20.639708 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dbe43f1e-734b-4d3b-a9ad-84913632f12f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:20.640460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dbe43f1e-734b-4d3b-a9ad-84913632f12f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:20.658089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dbe43f1e-734b-4d3b-a9ad-84913632f12f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:20.659140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dbe43f1e-734b-4d3b-a9ad-84913632f12f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:20.662753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dbe43f1e-734b-4d3b-a9ad-84913632f12f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:20.664682 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dbe43f1e-734b-4d3b-a9ad-84913632f12f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:20.713106 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e784ef96-7e90-4b7f-93c9-15f2cf9cf7f8 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:20.713785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e784ef96-7e90-4b7f-93c9-15f2cf9cf7f8 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:20.729952 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e784ef96-7e90-4b7f-93c9-15f2cf9cf7f8 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:20.732123 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e784ef96-7e90-4b7f-93c9-15f2cf9cf7f8 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:20.734011 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e784ef96-7e90-4b7f-93c9-15f2cf9cf7f8 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:20.735035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e784ef96-7e90-4b7f-93c9-15f2cf9cf7f8 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:21.056538 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e784ef96-7e90-4b7f-93c9-15f2cf9cf7f8 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:21.076125 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e784ef96-7e90-4b7f-93c9-15f2cf9cf7f8 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1367 microversion: 2.1 time: 0.368326 Aug 04 04:41:21.090275 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 156/310] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:20 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:21.123952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dbe43f1e-734b-4d3b-a9ad-84913632f12f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:21.144329 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dbe43f1e-734b-4d3b-a9ad-84913632f12f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.510657 Aug 04 04:41:21.146613 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 155/311] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:20 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:21.175771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8a089d8d-9163-4b9b-a29b-c5805c77f21a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:21.176652 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8a089d8d-9163-4b9b-a29b-c5805c77f21a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:21.194113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a089d8d-9163-4b9b-a29b-c5805c77f21a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:21.196403 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a089d8d-9163-4b9b-a29b-c5805c77f21a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:21.197797 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a089d8d-9163-4b9b-a29b-c5805c77f21a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:21.201612 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a089d8d-9163-4b9b-a29b-c5805c77f21a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:21.475072 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8a089d8d-9163-4b9b-a29b-c5805c77f21a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:21.486185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8a089d8d-9163-4b9b-a29b-c5805c77f21a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.314695 Aug 04 04:41:21.487648 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 157/312] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:21 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:22.100215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f21abe9d-d7c5-4a7d-b6f1-4c178f44f211 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:22.101040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f21abe9d-d7c5-4a7d-b6f1-4c178f44f211 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:22.119789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f21abe9d-d7c5-4a7d-b6f1-4c178f44f211 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:22.120546 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f21abe9d-d7c5-4a7d-b6f1-4c178f44f211 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:22.137239 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f21abe9d-d7c5-4a7d-b6f1-4c178f44f211 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:22.141016 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f21abe9d-d7c5-4a7d-b6f1-4c178f44f211 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:22.173755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dbdd091d-e31a-4dfb-9b44-7778d806d871 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:22.174358 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dbdd091d-e31a-4dfb-9b44-7778d806d871 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:22.185158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dbdd091d-e31a-4dfb-9b44-7778d806d871 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:22.186357 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dbdd091d-e31a-4dfb-9b44-7778d806d871 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:22.187320 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dbdd091d-e31a-4dfb-9b44-7778d806d871 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:22.187912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dbdd091d-e31a-4dfb-9b44-7778d806d871 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:22.568089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-dbdd091d-e31a-4dfb-9b44-7778d806d871 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:22.578364 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dbdd091d-e31a-4dfb-9b44-7778d806d871 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.409181 Aug 04 04:41:22.584500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 158/313] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:22 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:22.596814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2b1917ab-9bf4-4f80-b35a-c747457d41b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:22.597921 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2b1917ab-9bf4-4f80-b35a-c747457d41b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:22.618973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b1917ab-9bf4-4f80-b35a-c747457d41b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:22.620224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b1917ab-9bf4-4f80-b35a-c747457d41b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:22.623206 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b1917ab-9bf4-4f80-b35a-c747457d41b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:22.628445 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f21abe9d-d7c5-4a7d-b6f1-4c178f44f211 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:22.634047 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b1917ab-9bf4-4f80-b35a-c747457d41b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:22.643316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f21abe9d-d7c5-4a7d-b6f1-4c178f44f211 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1367 microversion: 2.1 time: 0.544689 Aug 04 04:41:22.644365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 156/314] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:22 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1367 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:22.670438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:22.875551 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2b1917ab-9bf4-4f80-b35a-c747457d41b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:22.888776 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2b1917ab-9bf4-4f80-b35a-c747457d41b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.301371 Aug 04 04:41:22.889764 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 159/315] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:22 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:23.611849 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8781af0f-1b44-419c-bc21-8b27b2ba36d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:23.613953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8781af0f-1b44-419c-bc21-8b27b2ba36d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:23.623722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8781af0f-1b44-419c-bc21-8b27b2ba36d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:23.625220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8781af0f-1b44-419c-bc21-8b27b2ba36d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:23.626764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8781af0f-1b44-419c-bc21-8b27b2ba36d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:23.627826 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8781af0f-1b44-419c-bc21-8b27b2ba36d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:23.670633 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-df47f750-4c37-4c25-be94-79d3fadb978d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:23.671977 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-df47f750-4c37-4c25-be94-79d3fadb978d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:23.686753 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-df47f750-4c37-4c25-be94-79d3fadb978d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:23.687953 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-df47f750-4c37-4c25-be94-79d3fadb978d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:23.690394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-df47f750-4c37-4c25-be94-79d3fadb978d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:23.690710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-df47f750-4c37-4c25-be94-79d3fadb978d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:24.024445 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-df47f750-4c37-4c25-be94-79d3fadb978d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:24.033825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8781af0f-1b44-419c-bc21-8b27b2ba36d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:24.043013 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8781af0f-1b44-419c-bc21-8b27b2ba36d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.437536 Aug 04 04:41:24.046549 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-df47f750-4c37-4c25-be94-79d3fadb978d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1557 microversion: 2.1 time: 0.382440 Aug 04 04:41:24.047795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 157/316] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:23 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:24.050113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 160/317] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:23 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1557 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:24.054130 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ca22e5f3-4ff4-418e-92a1-f01c06dfd394 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:24.055243 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ca22e5f3-4ff4-418e-92a1-f01c06dfd394 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:24.062369 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca22e5f3-4ff4-418e-92a1-f01c06dfd394 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:24.063201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca22e5f3-4ff4-418e-92a1-f01c06dfd394 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:24.064259 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca22e5f3-4ff4-418e-92a1-f01c06dfd394 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:24.064951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca22e5f3-4ff4-418e-92a1-f01c06dfd394 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:24.091254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-478d85f1-ba1f-4a63-8b87-0dcd380ac41b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:24.092850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-478d85f1-ba1f-4a63-8b87-0dcd380ac41b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:24.102314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-478d85f1-ba1f-4a63-8b87-0dcd380ac41b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:24.102885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-478d85f1-ba1f-4a63-8b87-0dcd380ac41b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:24.103860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-478d85f1-ba1f-4a63-8b87-0dcd380ac41b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:24.104353 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-478d85f1-ba1f-4a63-8b87-0dcd380ac41b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:24.115764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:24.250621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-478d85f1-ba1f-4a63-8b87-0dcd380ac41b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163720 Aug 04 04:41:24.251585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 161/318] 10.222.0.47 () {58 vars in 1275 bytes} [Thu Aug 4 04:41:24 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:24.369804 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ca22e5f3-4ff4-418e-92a1-f01c06dfd394 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:24.379046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ca22e5f3-4ff4-418e-92a1-f01c06dfd394 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.329671 Aug 04 04:41:24.380083 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 158/319] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:24 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:25.091691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a678f295-524e-4b06-a704-3183646ba53f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:25.092996 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a678f295-524e-4b06-a704-3183646ba53f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:25.109048 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a678f295-524e-4b06-a704-3183646ba53f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:25.113634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a678f295-524e-4b06-a704-3183646ba53f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:25.115221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a678f295-524e-4b06-a704-3183646ba53f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:25.116401 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a678f295-524e-4b06-a704-3183646ba53f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:25.403406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c366458c-7cfa-49e7-8597-5ab336dc1383 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:25.404182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c366458c-7cfa-49e7-8597-5ab336dc1383 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:25.419826 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c366458c-7cfa-49e7-8597-5ab336dc1383 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:25.421957 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c366458c-7cfa-49e7-8597-5ab336dc1383 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:25.422902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c366458c-7cfa-49e7-8597-5ab336dc1383 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:25.424405 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c366458c-7cfa-49e7-8597-5ab336dc1383 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:25.473893 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a678f295-524e-4b06-a704-3183646ba53f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:25.487868 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a678f295-524e-4b06-a704-3183646ba53f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.401758 Aug 04 04:41:25.489041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 162/320] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:25 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:25.699395 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c366458c-7cfa-49e7-8597-5ab336dc1383 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:25.722066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c366458c-7cfa-49e7-8597-5ab336dc1383 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.322750 Aug 04 04:41:25.724236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 159/321] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:25 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:26.456466 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-09b3018f-51e6-4256-a197-a5fb5e0f8c93 req-c8d62712-adc3-4ca5-b107-68a521054637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609de40c-089d-4edb-bb3e-9d66b12890a6", "tag": "36029921-51e1-49fb-8e5b-472199d8098b"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:26.472728 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-09b3018f-51e6-4256-a197-a5fb5e0f8c93 req-c8d62712-adc3-4ca5-b107-68a521054637 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:26.473621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-09b3018f-51e6-4256-a197-a5fb5e0f8c93 req-c8d62712-adc3-4ca5-b107-68a521054637 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:26.491349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-09b3018f-51e6-4256-a197-a5fb5e0f8c93 req-c8d62712-adc3-4ca5-b107-68a521054637 service nova] Creating event network-changed:36029921-51e1-49fb-8e5b-472199d8098b for instance 609de40c-089d-4edb-bb3e-9d66b12890a6 on hv-cinder-85127 Aug 04 04:41:26.512821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0b9f8c01-59fe-49eb-90a2-2a22530f1f6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:26.514212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0b9f8c01-59fe-49eb-90a2-2a22530f1f6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:26.517889 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-09b3018f-51e6-4256-a197-a5fb5e0f8c93 req-c8d62712-adc3-4ca5-b107-68a521054637 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068052 Aug 04 04:41:26.527086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 163/322] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:41:26.540777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0b9f8c01-59fe-49eb-90a2-2a22530f1f6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:26.541236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0b9f8c01-59fe-49eb-90a2-2a22530f1f6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:26.542079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0b9f8c01-59fe-49eb-90a2-2a22530f1f6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:26.543009 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0b9f8c01-59fe-49eb-90a2-2a22530f1f6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:26.748477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-34429356-78ee-4523-9dcb-83a358f485ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:26.749521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-34429356-78ee-4523-9dcb-83a358f485ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:26.766210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-34429356-78ee-4523-9dcb-83a358f485ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:26.774735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-34429356-78ee-4523-9dcb-83a358f485ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:26.782287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-34429356-78ee-4523-9dcb-83a358f485ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:26.783662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-34429356-78ee-4523-9dcb-83a358f485ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:27.123757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0b9f8c01-59fe-49eb-90a2-2a22530f1f6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:27.154790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0b9f8c01-59fe-49eb-90a2-2a22530f1f6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.644953 Aug 04 04:41:27.158234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 160/323] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:26 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:27.385224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-34429356-78ee-4523-9dcb-83a358f485ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:27.401746 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-34429356-78ee-4523-9dcb-83a358f485ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.657585 Aug 04 04:41:27.402353 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 164/324] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:26 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:28.186234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1315c9ac-a4c2-4ee3-bfa2-c931a572a445 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:28.186868 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1315c9ac-a4c2-4ee3-bfa2-c931a572a445 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:28.213388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1315c9ac-a4c2-4ee3-bfa2-c931a572a445 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:28.221702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1315c9ac-a4c2-4ee3-bfa2-c931a572a445 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:28.223105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1315c9ac-a4c2-4ee3-bfa2-c931a572a445 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:28.223779 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1315c9ac-a4c2-4ee3-bfa2-c931a572a445 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:28.427365 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-33fc7470-d269-4254-a919-3fc0e1c81c26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:28.428743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-33fc7470-d269-4254-a919-3fc0e1c81c26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:28.432284 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:28.451341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-33fc7470-d269-4254-a919-3fc0e1c81c26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:28.456741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-33fc7470-d269-4254-a919-3fc0e1c81c26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:28.459113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-33fc7470-d269-4254-a919-3fc0e1c81c26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:28.467867 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-33fc7470-d269-4254-a919-3fc0e1c81c26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:28.538337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1315c9ac-a4c2-4ee3-bfa2-c931a572a445 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:28.563776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1315c9ac-a4c2-4ee3-bfa2-c931a572a445 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.381810 Aug 04 04:41:28.564765 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 161/325] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:28 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:28.805507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-33fc7470-d269-4254-a919-3fc0e1c81c26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:28.816748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-33fc7470-d269-4254-a919-3fc0e1c81c26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.393414 Aug 04 04:41:28.817317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 165/326] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:28 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:29.617046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4af31356-2c12-453c-8855-946bbecbf5da tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:29.618510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4af31356-2c12-453c-8855-946bbecbf5da tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:29.634802 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4af31356-2c12-453c-8855-946bbecbf5da tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:29.637301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4af31356-2c12-453c-8855-946bbecbf5da tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:29.639145 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4af31356-2c12-453c-8855-946bbecbf5da tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:29.639830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4af31356-2c12-453c-8855-946bbecbf5da tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:29.841293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b7957047-5ccd-4d86-a5a8-0b712e347f5e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:29.843579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4af31356-2c12-453c-8855-946bbecbf5da tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:29.844315 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b7957047-5ccd-4d86-a5a8-0b712e347f5e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:29.856944 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4af31356-2c12-453c-8855-946bbecbf5da tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.268003 Aug 04 04:41:29.858256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 162/327] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:29 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:29.863010 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7957047-5ccd-4d86-a5a8-0b712e347f5e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:29.863131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7957047-5ccd-4d86-a5a8-0b712e347f5e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:29.870096 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7957047-5ccd-4d86-a5a8-0b712e347f5e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:29.870869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7957047-5ccd-4d86-a5a8-0b712e347f5e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:30.120663 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b7957047-5ccd-4d86-a5a8-0b712e347f5e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:30.128807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b7957047-5ccd-4d86-a5a8-0b712e347f5e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.292569 Aug 04 04:41:30.129296 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 166/328] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:29 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:30.878431 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-877c53f7-0b2f-4be5-9968-ac811e48c4ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:30.879182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-877c53f7-0b2f-4be5-9968-ac811e48c4ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:30.886818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-877c53f7-0b2f-4be5-9968-ac811e48c4ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:30.887274 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-877c53f7-0b2f-4be5-9968-ac811e48c4ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:30.888055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-877c53f7-0b2f-4be5-9968-ac811e48c4ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:30.888503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-877c53f7-0b2f-4be5-9968-ac811e48c4ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:31.045917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-877c53f7-0b2f-4be5-9968-ac811e48c4ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:31.055882 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-877c53f7-0b2f-4be5-9968-ac811e48c4ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.181177 Aug 04 04:41:31.057937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 163/329] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:30 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:31.152458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f4965a7c-caa8-46c1-a9f1-c48ee6a16dcb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:31.153135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f4965a7c-caa8-46c1-a9f1-c48ee6a16dcb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:31.161348 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4965a7c-caa8-46c1-a9f1-c48ee6a16dcb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:31.161825 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4965a7c-caa8-46c1-a9f1-c48ee6a16dcb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:31.164895 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4965a7c-caa8-46c1-a9f1-c48ee6a16dcb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:31.164895 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4965a7c-caa8-46c1-a9f1-c48ee6a16dcb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:31.370002 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f4965a7c-caa8-46c1-a9f1-c48ee6a16dcb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:31.378285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f4965a7c-caa8-46c1-a9f1-c48ee6a16dcb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.231303 Aug 04 04:41:31.380109 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 167/330] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:31 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:32.077658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e392cdab-456d-427c-bb99-beee8de48368 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:32.078393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e392cdab-456d-427c-bb99-beee8de48368 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:32.086417 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e392cdab-456d-427c-bb99-beee8de48368 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:32.087070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e392cdab-456d-427c-bb99-beee8de48368 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:32.087851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e392cdab-456d-427c-bb99-beee8de48368 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:32.088288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e392cdab-456d-427c-bb99-beee8de48368 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:32.230244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e392cdab-456d-427c-bb99-beee8de48368 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:32.237727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e392cdab-456d-427c-bb99-beee8de48368 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.164159 Aug 04 04:41:32.238449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 164/331] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:32 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:32.401779 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ad76aca3-5563-4a88-b680-5d587d0ff114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:32.402395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ad76aca3-5563-4a88-b680-5d587d0ff114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:32.408455 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ad76aca3-5563-4a88-b680-5d587d0ff114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:32.408903 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ad76aca3-5563-4a88-b680-5d587d0ff114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:32.409695 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ad76aca3-5563-4a88-b680-5d587d0ff114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:32.410130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ad76aca3-5563-4a88-b680-5d587d0ff114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:32.550040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ad76aca3-5563-4a88-b680-5d587d0ff114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:32.557615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ad76aca3-5563-4a88-b680-5d587d0ff114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.160955 Aug 04 04:41:32.558172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 168/332] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:32 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:33.259356 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-accd76d2-305f-488b-8a3b-9b603aa25e38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:33.260037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-accd76d2-305f-488b-8a3b-9b603aa25e38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:33.268943 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-accd76d2-305f-488b-8a3b-9b603aa25e38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:33.268943 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-accd76d2-305f-488b-8a3b-9b603aa25e38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:33.268943 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-accd76d2-305f-488b-8a3b-9b603aa25e38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:33.269223 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-accd76d2-305f-488b-8a3b-9b603aa25e38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:33.502297 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-accd76d2-305f-488b-8a3b-9b603aa25e38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:33.512719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-accd76d2-305f-488b-8a3b-9b603aa25e38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.257777 Aug 04 04:41:33.514201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 165/333] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:33 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:33.578451 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e1ffda5d-9417-4b63-80fd-0cd12d45444a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:33.579342 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e1ffda5d-9417-4b63-80fd-0cd12d45444a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:33.587191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e1ffda5d-9417-4b63-80fd-0cd12d45444a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:33.587767 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e1ffda5d-9417-4b63-80fd-0cd12d45444a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:33.589481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e1ffda5d-9417-4b63-80fd-0cd12d45444a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:33.590032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e1ffda5d-9417-4b63-80fd-0cd12d45444a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:33.748558 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e1ffda5d-9417-4b63-80fd-0cd12d45444a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:33.756976 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e1ffda5d-9417-4b63-80fd-0cd12d45444a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.181874 Aug 04 04:41:33.758010 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 169/334] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:33 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:34.537684 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f6fd7324-2c55-45d3-a4f0-173cd92b7ab9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:34.538322 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f6fd7324-2c55-45d3-a4f0-173cd92b7ab9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:34.544862 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6fd7324-2c55-45d3-a4f0-173cd92b7ab9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:34.545308 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6fd7324-2c55-45d3-a4f0-173cd92b7ab9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:34.546115 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6fd7324-2c55-45d3-a4f0-173cd92b7ab9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:34.546548 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6fd7324-2c55-45d3-a4f0-173cd92b7ab9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:34.692977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f6fd7324-2c55-45d3-a4f0-173cd92b7ab9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:34.701170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f6fd7324-2c55-45d3-a4f0-173cd92b7ab9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.167762 Aug 04 04:41:34.701779 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 166/335] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:34 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:34.777929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-35f7f54f-7a01-4754-a029-6970acc60198 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:34.778694 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-35f7f54f-7a01-4754-a029-6970acc60198 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:34.785146 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-35f7f54f-7a01-4754-a029-6970acc60198 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:34.785713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-35f7f54f-7a01-4754-a029-6970acc60198 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:34.786495 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-35f7f54f-7a01-4754-a029-6970acc60198 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:34.786934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-35f7f54f-7a01-4754-a029-6970acc60198 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:34.932215 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-35f7f54f-7a01-4754-a029-6970acc60198 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:34.940205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-35f7f54f-7a01-4754-a029-6970acc60198 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.166269 Aug 04 04:41:34.946325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 170/336] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:34 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:35.681215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-f08a5179-aad1-49cd-bffe-43f8cf056985 req-0507536c-d080-47f6-9ff0-c5a060dac20b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1762cb-4b08-41db-8302-59f56c67370a", "name": "network-vif-plugged", "status": "completed", "tag": "e652ee96-0575-4a05-ad13-04b1d7dbc6e7"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:35.698370 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-f08a5179-aad1-49cd-bffe-43f8cf056985 req-0507536c-d080-47f6-9ff0-c5a060dac20b service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:35.698940 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-f08a5179-aad1-49cd-bffe-43f8cf056985 req-0507536c-d080-47f6-9ff0-c5a060dac20b service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:35.720547 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-f08a5179-aad1-49cd-bffe-43f8cf056985 req-0507536c-d080-47f6-9ff0-c5a060dac20b service nova] Creating event network-vif-plugged:e652ee96-0575-4a05-ad13-04b1d7dbc6e7 for instance af1762cb-4b08-41db-8302-59f56c67370a on hv-cinder-85127 Aug 04 04:41:35.726646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b7a82f47-2528-4120-9d49-533e81c645c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:35.727446 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-f08a5179-aad1-49cd-bffe-43f8cf056985 req-0507536c-d080-47f6-9ff0-c5a060dac20b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049803 Aug 04 04:41:35.728554 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 167/337] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:35.729176 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b7a82f47-2528-4120-9d49-533e81c645c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:35.737946 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7a82f47-2528-4120-9d49-533e81c645c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:35.738643 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7a82f47-2528-4120-9d49-533e81c645c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:35.739788 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7a82f47-2528-4120-9d49-533e81c645c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:35.740957 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7a82f47-2528-4120-9d49-533e81c645c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:35.925212 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b7a82f47-2528-4120-9d49-533e81c645c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:35.933628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b7a82f47-2528-4120-9d49-533e81c645c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.215394 Aug 04 04:41:35.935125 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 171/338] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:35 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:35.967491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7338b755-b0c8-4bc6-ba06-d6801e229121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:35.968523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7338b755-b0c8-4bc6-ba06-d6801e229121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:35.977624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7338b755-b0c8-4bc6-ba06-d6801e229121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:35.978559 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7338b755-b0c8-4bc6-ba06-d6801e229121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:35.979661 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7338b755-b0c8-4bc6-ba06-d6801e229121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:35.980271 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7338b755-b0c8-4bc6-ba06-d6801e229121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:36.167619 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7338b755-b0c8-4bc6-ba06-d6801e229121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:36.175961 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7338b755-b0c8-4bc6-ba06-d6801e229121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.213087 Aug 04 04:41:36.176528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 168/339] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:35 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:36.956536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-52706751-17d6-4c8f-9c3b-b09306460973 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:36.957160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-52706751-17d6-4c8f-9c3b-b09306460973 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:36.963908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-52706751-17d6-4c8f-9c3b-b09306460973 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:36.964379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-52706751-17d6-4c8f-9c3b-b09306460973 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:36.965145 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-52706751-17d6-4c8f-9c3b-b09306460973 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:36.965605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-52706751-17d6-4c8f-9c3b-b09306460973 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:37.106203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-52706751-17d6-4c8f-9c3b-b09306460973 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:37.114575 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-52706751-17d6-4c8f-9c3b-b09306460973 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.161881 Aug 04 04:41:37.115155 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 172/340] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:36 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:37.198772 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c9620d34-dd77-4568-a79e-452a2768685a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:37.199387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c9620d34-dd77-4568-a79e-452a2768685a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:37.205975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9620d34-dd77-4568-a79e-452a2768685a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:37.206476 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9620d34-dd77-4568-a79e-452a2768685a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:37.207382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9620d34-dd77-4568-a79e-452a2768685a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:37.207969 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9620d34-dd77-4568-a79e-452a2768685a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:37.362720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c9620d34-dd77-4568-a79e-452a2768685a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:37.365966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1915842770", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "networks": [{"uuid": "353cdb9e-e4df-4c4f-9217-20285fd79507"}]}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:37.376263 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c9620d34-dd77-4568-a79e-452a2768685a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.181331 Aug 04 04:41:37.377129 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 169/341] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:37 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:37.426667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.network.neutron [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] validate_networks() for [('353cdb9e-e4df-4c4f-9217-20285fd79507', None, None, None, None, None)] {{(pid=134884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:41:37.785119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Flavor limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:41:37.785564 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Image limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:41:37.786033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Flavor pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:41:37.786439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Image pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:41:37.786847 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:41:37.796102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:37.796540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:37.797327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:37.797791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:37.815664 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Getting quotas for project 58d8f4b47019401ab6e953bbbbd801fd. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:41:37.820127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Getting quotas for user d604afd3c4234473ac1f2fcff2501743 and project 58d8f4b47019401ab6e953bbbbd801fd. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:41:37.831744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Going to run 1 instances... {{(pid=134884) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:41:37.834636 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:41:37.883097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-22d7e76d-9f8c-4696-84d5-653246441ec8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521433 Aug 04 04:41:37.883761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 173/342] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:41:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:41:37.894670 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c66eaf64-3f0b-41fc-8790-022eb387f26b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:37.895282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c66eaf64-3f0b-41fc-8790-022eb387f26b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:37.951404 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c66eaf64-3f0b-41fc-8790-022eb387f26b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:37.958051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c66eaf64-3f0b-41fc-8790-022eb387f26b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1219 microversion: 2.1 time: 0.067196 Aug 04 04:41:37.958621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 170/343] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:37 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:38.137207 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bb4bc76f-9c98-4956-8b4b-15fd2ad64347 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:38.137673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bb4bc76f-9c98-4956-8b4b-15fd2ad64347 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:38.144499 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bb4bc76f-9c98-4956-8b4b-15fd2ad64347 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:38.145008 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bb4bc76f-9c98-4956-8b4b-15fd2ad64347 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:38.145837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bb4bc76f-9c98-4956-8b4b-15fd2ad64347 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:38.146279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bb4bc76f-9c98-4956-8b4b-15fd2ad64347 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:38.329837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bb4bc76f-9c98-4956-8b4b-15fd2ad64347 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:38.338788 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bb4bc76f-9c98-4956-8b4b-15fd2ad64347 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1356 microversion: 2.1 time: 0.206308 Aug 04 04:41:38.339356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 174/344] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:38 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1356 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:38.398477 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d7fb96af-fa1e-46d9-bdd0-bb2b9a5d032a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:38.399460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d7fb96af-fa1e-46d9-bdd0-bb2b9a5d032a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:38.409029 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d7fb96af-fa1e-46d9-bdd0-bb2b9a5d032a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:38.410365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d7fb96af-fa1e-46d9-bdd0-bb2b9a5d032a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:38.411473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d7fb96af-fa1e-46d9-bdd0-bb2b9a5d032a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:38.412170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d7fb96af-fa1e-46d9-bdd0-bb2b9a5d032a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:38.555356 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d7fb96af-fa1e-46d9-bdd0-bb2b9a5d032a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:38.563175 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d7fb96af-fa1e-46d9-bdd0-bb2b9a5d032a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.170037 Aug 04 04:41:38.563785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 171/345] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:38 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:38.979505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-24b05bcc-b87f-4a0c-977d-480d0e9156bf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:38.980122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-24b05bcc-b87f-4a0c-977d-480d0e9156bf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:38.986247 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-24b05bcc-b87f-4a0c-977d-480d0e9156bf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:38.986694 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-24b05bcc-b87f-4a0c-977d-480d0e9156bf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:38.987460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-24b05bcc-b87f-4a0c-977d-480d0e9156bf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:38.987892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-24b05bcc-b87f-4a0c-977d-480d0e9156bf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.051485 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-24b05bcc-b87f-4a0c-977d-480d0e9156bf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:39.059658 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-24b05bcc-b87f-4a0c-977d-480d0e9156bf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1271 microversion: 2.1 time: 0.084029 Aug 04 04:41:39.060346 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 175/346] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:38 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:39.360001 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-91aa3e5b-e4a1-4bc8-9cbc-8d876dd5e223 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:39.360719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-91aa3e5b-e4a1-4bc8-9cbc-8d876dd5e223 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:39.367692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91aa3e5b-e4a1-4bc8-9cbc-8d876dd5e223 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.368247 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91aa3e5b-e4a1-4bc8-9cbc-8d876dd5e223 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.369050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91aa3e5b-e4a1-4bc8-9cbc-8d876dd5e223 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.369594 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91aa3e5b-e4a1-4bc8-9cbc-8d876dd5e223 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.526914 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-91aa3e5b-e4a1-4bc8-9cbc-8d876dd5e223 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:39.534666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-91aa3e5b-e4a1-4bc8-9cbc-8d876dd5e223 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1545 microversion: 2.1 time: 0.178793 Aug 04 04:41:39.535484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 172/347] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1545 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:39.558085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fe0e9786-0cee-4861-9138-7d8ec0406a9f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:39.559756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fe0e9786-0cee-4861-9138-7d8ec0406a9f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:39.567184 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fe0e9786-0cee-4861-9138-7d8ec0406a9f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.567849 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fe0e9786-0cee-4861-9138-7d8ec0406a9f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.569298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fe0e9786-0cee-4861-9138-7d8ec0406a9f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.569860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fe0e9786-0cee-4861-9138-7d8ec0406a9f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.585115 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c9f04ade-4533-449c-8e00-6fb5661093fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:39.586076 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c9f04ade-4533-449c-8e00-6fb5661093fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:39.592744 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9f04ade-4533-449c-8e00-6fb5661093fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.593297 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9f04ade-4533-449c-8e00-6fb5661093fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.594172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9f04ade-4533-449c-8e00-6fb5661093fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.594711 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9f04ade-4533-449c-8e00-6fb5661093fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.790778 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fe0e9786-0cee-4861-9138-7d8ec0406a9f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:39.799197 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fe0e9786-0cee-4861-9138-7d8ec0406a9f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1545 microversion: 2.1 time: 0.245172 Aug 04 04:41:39.799799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 176/348] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1545 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:39.815283 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c9f04ade-4533-449c-8e00-6fb5661093fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:39.820921 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0b02af31-5c15-4e48-8ac7-6e789c416ce4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:39.824453 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c9f04ade-4533-449c-8e00-6fb5661093fe tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.243897 Aug 04 04:41:39.825094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 173/349] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:39 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:39.826705 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0b02af31-5c15-4e48-8ac7-6e789c416ce4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:39.827610 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0b02af31-5c15-4e48-8ac7-6e789c416ce4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Searching by: {'deleted': False, 'project_id': 'bd7fc43776684ea99eb660966ed97695'} {{(pid=134884) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 04:41:39.835003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b02af31-5c15-4e48-8ac7-6e789c416ce4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.835616 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b02af31-5c15-4e48-8ac7-6e789c416ce4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.836552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b02af31-5c15-4e48-8ac7-6e789c416ce4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:39.837099 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b02af31-5c15-4e48-8ac7-6e789c416ce4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:39.938308 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:39.942761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.multi_cell_list [None req-0b02af31-5c15-4e48-8ac7-6e789c416ce4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 04:41:40.058725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0b02af31-5c15-4e48-8ac7-6e789c416ce4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.241630 Aug 04 04:41:40.059332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 177/350] 10.222.0.47 () {58 vars in 1125 bytes} [Thu Aug 4 04:41:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:41:40.072840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-672780e5-521b-4947-b651-945b623cdc01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:40.073470 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-672780e5-521b-4947-b651-945b623cdc01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:40.079888 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-672780e5-521b-4947-b651-945b623cdc01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:40.080640 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-672780e5-521b-4947-b651-945b623cdc01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:40.081307 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6396c18c-dc01-4ade-a5ea-907a2636065f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:40.081826 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-672780e5-521b-4947-b651-945b623cdc01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:40.082138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6396c18c-dc01-4ade-a5ea-907a2636065f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:40.082622 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-672780e5-521b-4947-b651-945b623cdc01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:40.090884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6396c18c-dc01-4ade-a5ea-907a2636065f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:40.091470 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6396c18c-dc01-4ade-a5ea-907a2636065f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:40.092557 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6396c18c-dc01-4ade-a5ea-907a2636065f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:40.093105 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6396c18c-dc01-4ade-a5ea-907a2636065f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:40.325816 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-672780e5-521b-4947-b651-945b623cdc01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:40.334303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6396c18c-dc01-4ade-a5ea-907a2636065f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:40.335573 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-672780e5-521b-4947-b651-945b623cdc01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1545 microversion: 2.1 time: 0.265803 Aug 04 04:41:40.343958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 174/351] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:40 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1545 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:40.344298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6396c18c-dc01-4ade-a5ea-907a2636065f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1319 microversion: 2.1 time: 0.266846 Aug 04 04:41:40.344940 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 178/352] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:40 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:40.813213 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-fbb94ded-b6b5-4fab-ad99-41bee262cfe9 req-95411bdf-0513-4dc1-9c79-dddca80c254c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f6da3e-0628-438b-860b-97947b44ee7f", "tag": "e5c5de47-a2a2-4d9b-8e39-1716334e8a05"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:40.838903 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-fbb94ded-b6b5-4fab-ad99-41bee262cfe9 req-95411bdf-0513-4dc1-9c79-dddca80c254c service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:40.839767 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-fbb94ded-b6b5-4fab-ad99-41bee262cfe9 req-95411bdf-0513-4dc1-9c79-dddca80c254c service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:40.855972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ef3d91a3-d79d-4de7-8bf8-870351b27a42 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:40.858151 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ef3d91a3-d79d-4de7-8bf8-870351b27a42 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:40.866004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-fbb94ded-b6b5-4fab-ad99-41bee262cfe9 req-95411bdf-0513-4dc1-9c79-dddca80c254c service nova] Creating event network-changed:e5c5de47-a2a2-4d9b-8e39-1716334e8a05 for instance 58f6da3e-0628-438b-860b-97947b44ee7f on hv-cinder-85127 Aug 04 04:41:40.868807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef3d91a3-d79d-4de7-8bf8-870351b27a42 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:40.869866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef3d91a3-d79d-4de7-8bf8-870351b27a42 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:40.871441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef3d91a3-d79d-4de7-8bf8-870351b27a42 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:40.872103 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef3d91a3-d79d-4de7-8bf8-870351b27a42 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:40.874458 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-fbb94ded-b6b5-4fab-ad99-41bee262cfe9 req-95411bdf-0513-4dc1-9c79-dddca80c254c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065203 Aug 04 04:41:40.875596 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 175/353] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:41:41.011471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ef3d91a3-d79d-4de7-8bf8-870351b27a42 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:41.018850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ef3d91a3-d79d-4de7-8bf8-870351b27a42 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.174741 Aug 04 04:41:41.019491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 179/354] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:40 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:41.366802 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-83c90c5e-5361-4468-9b66-e3e71870fc59 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:41.367508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-83c90c5e-5361-4468-9b66-e3e71870fc59 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:41.373914 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83c90c5e-5361-4468-9b66-e3e71870fc59 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:41.374367 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83c90c5e-5361-4468-9b66-e3e71870fc59 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:41.375136 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83c90c5e-5361-4468-9b66-e3e71870fc59 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:41.375569 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83c90c5e-5361-4468-9b66-e3e71870fc59 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:41.525051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-83c90c5e-5361-4468-9b66-e3e71870fc59 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:41.534693 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-83c90c5e-5361-4468-9b66-e3e71870fc59 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1319 microversion: 2.1 time: 0.173317 Aug 04 04:41:41.535419 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 176/355] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:41 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:41.975449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5a635d46-38ef-4c4a-af88-4ba774f0aca8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "294cbad6-59c9-4cdc-abda-2a60a0e77e44"}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:41.977884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5a635d46-38ef-4c4a-af88-4ba774f0aca8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:41.984660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a635d46-38ef-4c4a-af88-4ba774f0aca8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:41.985112 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a635d46-38ef-4c4a-af88-4ba774f0aca8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:41.985918 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a635d46-38ef-4c4a-af88-4ba774f0aca8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:41.986388 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a635d46-38ef-4c4a-af88-4ba774f0aca8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:42.041280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c2100e83-9b1c-4022-b352-8917f5fc65a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:42.043036 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c2100e83-9b1c-4022-b352-8917f5fc65a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:42.050327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c2100e83-9b1c-4022-b352-8917f5fc65a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:42.050785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c2100e83-9b1c-4022-b352-8917f5fc65a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:42.051556 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c2100e83-9b1c-4022-b352-8917f5fc65a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:42.051994 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c2100e83-9b1c-4022-b352-8917f5fc65a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:42.068416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:42.195607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c2100e83-9b1c-4022-b352-8917f5fc65a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:42.203300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c2100e83-9b1c-4022-b352-8917f5fc65a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.166727 Aug 04 04:41:42.203859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 177/356] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:42 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:42.557011 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-73af6de5-1c2f-45c2-bd09-3f925a4ae71f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:42.558005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-73af6de5-1c2f-45c2-bd09-3f925a4ae71f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:42.564865 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73af6de5-1c2f-45c2-bd09-3f925a4ae71f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:42.565671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73af6de5-1c2f-45c2-bd09-3f925a4ae71f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:42.571415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73af6de5-1c2f-45c2-bd09-3f925a4ae71f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:42.571647 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73af6de5-1c2f-45c2-bd09-3f925a4ae71f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:42.728013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5a635d46-38ef-4c4a-af88-4ba774f0aca8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "POST /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.757086 Aug 04 04:41:42.734791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 180/357] 10.222.0.47 () {60 vars in 1323 bytes} [Thu Aug 4 04:41:41 2022] POST /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 194 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:42.788971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-73af6de5-1c2f-45c2-bd09-3f925a4ae71f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:42.798343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-73af6de5-1c2f-45c2-bd09-3f925a4ae71f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1319 microversion: 2.1 time: 0.246251 Aug 04 04:41:42.812066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 178/358] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:42 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:43.229193 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1f392cbc-2422-47a5-88df-23de66cbdf3e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:43.230183 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1f392cbc-2422-47a5-88df-23de66cbdf3e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:43.236923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1f392cbc-2422-47a5-88df-23de66cbdf3e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:43.237370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1f392cbc-2422-47a5-88df-23de66cbdf3e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:43.238310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1f392cbc-2422-47a5-88df-23de66cbdf3e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:43.238745 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1f392cbc-2422-47a5-88df-23de66cbdf3e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:43.382542 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1f392cbc-2422-47a5-88df-23de66cbdf3e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:43.390460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1f392cbc-2422-47a5-88df-23de66cbdf3e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.167034 Aug 04 04:41:43.391037 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 181/359] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:43 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:43.819903 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2f9e759b-9054-4709-8bbb-425a7391cbf4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:43.820503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2f9e759b-9054-4709-8bbb-425a7391cbf4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:43.827150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2f9e759b-9054-4709-8bbb-425a7391cbf4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:43.827610 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2f9e759b-9054-4709-8bbb-425a7391cbf4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:43.828385 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2f9e759b-9054-4709-8bbb-425a7391cbf4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:43.828984 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2f9e759b-9054-4709-8bbb-425a7391cbf4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:43.965567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2f9e759b-9054-4709-8bbb-425a7391cbf4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:43.973137 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2f9e759b-9054-4709-8bbb-425a7391cbf4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1319 microversion: 2.1 time: 0.157699 Aug 04 04:41:43.973674 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 179/360] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:43 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:44.413383 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9a1ec6df-61f9-49b4-9094-2300fbdd80e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:44.414024 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9a1ec6df-61f9-49b4-9094-2300fbdd80e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:44.421060 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a1ec6df-61f9-49b4-9094-2300fbdd80e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:44.421517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a1ec6df-61f9-49b4-9094-2300fbdd80e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:44.422324 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a1ec6df-61f9-49b4-9094-2300fbdd80e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:44.422792 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a1ec6df-61f9-49b4-9094-2300fbdd80e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:44.557712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9a1ec6df-61f9-49b4-9094-2300fbdd80e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:44.565766 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9a1ec6df-61f9-49b4-9094-2300fbdd80e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.156852 Aug 04 04:41:44.566328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 182/361] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:44 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:44.994386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-41782aec-df7c-43c1-b674-7a888540d402 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:44.994999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-41782aec-df7c-43c1-b674-7a888540d402 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:45.001653 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-41782aec-df7c-43c1-b674-7a888540d402 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:45.002103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-41782aec-df7c-43c1-b674-7a888540d402 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:45.002872 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-41782aec-df7c-43c1-b674-7a888540d402 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:45.003309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-41782aec-df7c-43c1-b674-7a888540d402 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:45.155254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-41782aec-df7c-43c1-b674-7a888540d402 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:45.163386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-41782aec-df7c-43c1-b674-7a888540d402 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1319 microversion: 2.1 time: 0.173176 Aug 04 04:41:45.163964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 180/362] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:44 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:45.587395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7f5e462e-4172-4396-a2f6-85f9d1ab36fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:45.588013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7f5e462e-4172-4396-a2f6-85f9d1ab36fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:45.594726 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7f5e462e-4172-4396-a2f6-85f9d1ab36fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:45.595180 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7f5e462e-4172-4396-a2f6-85f9d1ab36fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:45.595969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7f5e462e-4172-4396-a2f6-85f9d1ab36fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:45.596601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7f5e462e-4172-4396-a2f6-85f9d1ab36fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:45.761572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7f5e462e-4172-4396-a2f6-85f9d1ab36fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:45.770094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7f5e462e-4172-4396-a2f6-85f9d1ab36fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.187243 Aug 04 04:41:45.770637 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 183/363] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:45 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:46.184218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cf3a21eb-5717-4d85-a270-264f60a7d0d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:46.185469 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cf3a21eb-5717-4d85-a270-264f60a7d0d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:46.191985 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cf3a21eb-5717-4d85-a270-264f60a7d0d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:46.192434 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cf3a21eb-5717-4d85-a270-264f60a7d0d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:46.193202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cf3a21eb-5717-4d85-a270-264f60a7d0d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:46.193665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cf3a21eb-5717-4d85-a270-264f60a7d0d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:46.331628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-cf3a21eb-5717-4d85-a270-264f60a7d0d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:46.340023 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cf3a21eb-5717-4d85-a270-264f60a7d0d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1319 microversion: 2.1 time: 0.159565 Aug 04 04:41:46.340608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 181/364] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:46 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:46.792465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b007bc4e-47c9-40f6-b9c3-b18e73f05c30 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:46.793072 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b007bc4e-47c9-40f6-b9c3-b18e73f05c30 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:46.799523 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b007bc4e-47c9-40f6-b9c3-b18e73f05c30 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:46.799966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b007bc4e-47c9-40f6-b9c3-b18e73f05c30 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:46.800725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b007bc4e-47c9-40f6-b9c3-b18e73f05c30 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:46.801157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b007bc4e-47c9-40f6-b9c3-b18e73f05c30 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:46.932761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b007bc4e-47c9-40f6-b9c3-b18e73f05c30 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:46.940156 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b007bc4e-47c9-40f6-b9c3-b18e73f05c30 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.151822 Aug 04 04:41:46.940718 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 184/365] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:46 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:47.360211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d2804f82-ca46-4cba-97bc-b6bee2216310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:47.360871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d2804f82-ca46-4cba-97bc-b6bee2216310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:47.367619 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2804f82-ca46-4cba-97bc-b6bee2216310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:47.368070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2804f82-ca46-4cba-97bc-b6bee2216310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:47.368834 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2804f82-ca46-4cba-97bc-b6bee2216310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:47.369272 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2804f82-ca46-4cba-97bc-b6bee2216310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:47.511050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d2804f82-ca46-4cba-97bc-b6bee2216310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:47.520078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d2804f82-ca46-4cba-97bc-b6bee2216310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1319 microversion: 2.1 time: 0.163591 Aug 04 04:41:47.520719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 182/366] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:47 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:47.665467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-38fb430b-6666-4223-8bf3-d9adb2692576 req-cf70857f-f62f-4ecc-a4f2-5e9530228ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f6da3e-0628-438b-860b-97947b44ee7f", "name": "network-vif-plugged", "status": "completed", "tag": "e5c5de47-a2a2-4d9b-8e39-1716334e8a05"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:47.676132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-38fb430b-6666-4223-8bf3-d9adb2692576 req-cf70857f-f62f-4ecc-a4f2-5e9530228ea4 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:47.676653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-38fb430b-6666-4223-8bf3-d9adb2692576 req-cf70857f-f62f-4ecc-a4f2-5e9530228ea4 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:47.691025 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-38fb430b-6666-4223-8bf3-d9adb2692576 req-cf70857f-f62f-4ecc-a4f2-5e9530228ea4 service nova] Creating event network-vif-plugged:e5c5de47-a2a2-4d9b-8e39-1716334e8a05 for instance 58f6da3e-0628-438b-860b-97947b44ee7f on hv-cinder-85127 Aug 04 04:41:47.697352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-38fb430b-6666-4223-8bf3-d9adb2692576 req-cf70857f-f62f-4ecc-a4f2-5e9530228ea4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035862 Aug 04 04:41:47.698032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 185/367] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:47.961194 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8a67502e-5aa0-4ce4-b39e-f021c4892edc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:47.961904 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8a67502e-5aa0-4ce4-b39e-f021c4892edc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:47.963761 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:47.969656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a67502e-5aa0-4ce4-b39e-f021c4892edc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:47.970099 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a67502e-5aa0-4ce4-b39e-f021c4892edc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:47.970864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a67502e-5aa0-4ce4-b39e-f021c4892edc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:47.971462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a67502e-5aa0-4ce4-b39e-f021c4892edc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:48.113945 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8a67502e-5aa0-4ce4-b39e-f021c4892edc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:48.122577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8a67502e-5aa0-4ce4-b39e-f021c4892edc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.165470 Aug 04 04:41:48.123275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 183/368] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:47 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:48.543463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5046c429-770a-4312-89ca-7098dc4fd78c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:48.544182 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5046c429-770a-4312-89ca-7098dc4fd78c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:48.546655 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=6 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:48.552749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5046c429-770a-4312-89ca-7098dc4fd78c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:48.553192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5046c429-770a-4312-89ca-7098dc4fd78c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:48.553983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5046c429-770a-4312-89ca-7098dc4fd78c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:48.554410 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5046c429-770a-4312-89ca-7098dc4fd78c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:48.687534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5046c429-770a-4312-89ca-7098dc4fd78c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:48.695431 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5046c429-770a-4312-89ca-7098dc4fd78c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1319 microversion: 2.1 time: 0.156448 Aug 04 04:41:48.695996 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 186/369] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:48 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:49.150787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e0c78594-e16e-4043-9bc9-3d408bf52ead tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:49.151407 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e0c78594-e16e-4043-9bc9-3d408bf52ead tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:49.158445 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=66 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:49.162969 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e0c78594-e16e-4043-9bc9-3d408bf52ead tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:49.163670 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e0c78594-e16e-4043-9bc9-3d408bf52ead tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:49.164465 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e0c78594-e16e-4043-9bc9-3d408bf52ead tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:49.164897 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e0c78594-e16e-4043-9bc9-3d408bf52ead tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:49.310504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e0c78594-e16e-4043-9bc9-3d408bf52ead tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:49.318526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e0c78594-e16e-4043-9bc9-3d408bf52ead tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.172770 Aug 04 04:41:49.318780 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 184/370] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:49 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:49.716691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-aaa37ca3-a057-459c-87d4-27fd1b85f8f1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:49.717316 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-aaa37ca3-a057-459c-87d4-27fd1b85f8f1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:49.723873 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aaa37ca3-a057-459c-87d4-27fd1b85f8f1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:49.724842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aaa37ca3-a057-459c-87d4-27fd1b85f8f1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:49.725650 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aaa37ca3-a057-459c-87d4-27fd1b85f8f1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:49.726087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aaa37ca3-a057-459c-87d4-27fd1b85f8f1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:49.869448 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-aaa37ca3-a057-459c-87d4-27fd1b85f8f1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:49.871727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=4 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:49.878330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-aaa37ca3-a057-459c-87d4-27fd1b85f8f1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1319 microversion: 2.1 time: 0.165530 Aug 04 04:41:49.878896 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 187/371] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:49 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:50.339663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-365a3b3e-22b4-47ab-9ee5-e3ea4a02b7b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:50.340227 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-365a3b3e-22b4-47ab-9ee5-e3ea4a02b7b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:50.347158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-365a3b3e-22b4-47ab-9ee5-e3ea4a02b7b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:50.347615 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-365a3b3e-22b4-47ab-9ee5-e3ea4a02b7b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:50.348384 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-365a3b3e-22b4-47ab-9ee5-e3ea4a02b7b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:50.348823 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-365a3b3e-22b4-47ab-9ee5-e3ea4a02b7b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:50.485781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-365a3b3e-22b4-47ab-9ee5-e3ea4a02b7b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:50.494264 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-365a3b3e-22b4-47ab-9ee5-e3ea4a02b7b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.158863 Aug 04 04:41:50.494828 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 185/372] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:50 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:50.899805 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-280bbeca-8cb3-4c75-9958-c5c03341cf2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:50.900432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-280bbeca-8cb3-4c75-9958-c5c03341cf2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:50.907008 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-280bbeca-8cb3-4c75-9958-c5c03341cf2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:50.907459 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-280bbeca-8cb3-4c75-9958-c5c03341cf2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:50.908222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-280bbeca-8cb3-4c75-9958-c5c03341cf2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:50.908662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-280bbeca-8cb3-4c75-9958-c5c03341cf2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:51.046643 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-280bbeca-8cb3-4c75-9958-c5c03341cf2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:51.055503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-280bbeca-8cb3-4c75-9958-c5c03341cf2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1509 microversion: 2.1 time: 0.159994 Aug 04 04:41:51.056363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 188/373] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:50 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:51.519208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5b53ff47-132a-4bda-ba8c-0c403fe882cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:51.520361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5b53ff47-132a-4bda-ba8c-0c403fe882cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:51.537493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b53ff47-132a-4bda-ba8c-0c403fe882cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:51.538256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b53ff47-132a-4bda-ba8c-0c403fe882cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:51.539722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b53ff47-132a-4bda-ba8c-0c403fe882cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:51.540829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b53ff47-132a-4bda-ba8c-0c403fe882cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:51.714700 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5cd7a55a-b99e-4269-977d-66be4249b59a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:51.715328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5cd7a55a-b99e-4269-977d-66be4249b59a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:51.718566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5b53ff47-132a-4bda-ba8c-0c403fe882cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:51.721797 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5cd7a55a-b99e-4269-977d-66be4249b59a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:51.722262 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5cd7a55a-b99e-4269-977d-66be4249b59a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:51.723036 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5cd7a55a-b99e-4269-977d-66be4249b59a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:51.723480 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5cd7a55a-b99e-4269-977d-66be4249b59a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:51.727342 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5b53ff47-132a-4bda-ba8c-0c403fe882cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.214375 Aug 04 04:41:51.728302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 186/374] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:51 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:51.861016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5cd7a55a-b99e-4269-977d-66be4249b59a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:51.869755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5cd7a55a-b99e-4269-977d-66be4249b59a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1591 microversion: 2.1 time: 0.158900 Aug 04 04:41:51.870346 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 189/375] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:51 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1591 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:52.751212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8a9267a9-178d-495b-b8ef-c2845829d7e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:52.752531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8a9267a9-178d-495b-b8ef-c2845829d7e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:52.759304 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a9267a9-178d-495b-b8ef-c2845829d7e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:52.759757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a9267a9-178d-495b-b8ef-c2845829d7e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:52.760561 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a9267a9-178d-495b-b8ef-c2845829d7e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:52.761014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a9267a9-178d-495b-b8ef-c2845829d7e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:52.903722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8a9267a9-178d-495b-b8ef-c2845829d7e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:52.912365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8a9267a9-178d-495b-b8ef-c2845829d7e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.165022 Aug 04 04:41:52.912986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 187/376] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:52 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:53.724652 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-70a43045-5f1d-4f44-baf8-bca0dde9f78c req-e55aa139-958e-4052-b7bc-d0a69f40f063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1762cb-4b08-41db-8302-59f56c67370a", "tag": "e652ee96-0575-4a05-ad13-04b1d7dbc6e7"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:53.750386 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-70a43045-5f1d-4f44-baf8-bca0dde9f78c req-e55aa139-958e-4052-b7bc-d0a69f40f063 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:53.753467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-70a43045-5f1d-4f44-baf8-bca0dde9f78c req-e55aa139-958e-4052-b7bc-d0a69f40f063 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:53.766673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-70a43045-5f1d-4f44-baf8-bca0dde9f78c req-e55aa139-958e-4052-b7bc-d0a69f40f063 service nova] Creating event network-changed:e652ee96-0575-4a05-ad13-04b1d7dbc6e7 for instance af1762cb-4b08-41db-8302-59f56c67370a on hv-cinder-85127 Aug 04 04:41:53.772156 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-70a43045-5f1d-4f44-baf8-bca0dde9f78c req-e55aa139-958e-4052-b7bc-d0a69f40f063 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051355 Aug 04 04:41:53.772782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 190/377] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:41:53.935231 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4f55d97f-fcbf-4f7b-ac09-2f3f224c2712 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:53.941906 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4f55d97f-fcbf-4f7b-ac09-2f3f224c2712 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:53.951449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f55d97f-fcbf-4f7b-ac09-2f3f224c2712 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:53.951904 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f55d97f-fcbf-4f7b-ac09-2f3f224c2712 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:53.952685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f55d97f-fcbf-4f7b-ac09-2f3f224c2712 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:53.953115 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f55d97f-fcbf-4f7b-ac09-2f3f224c2712 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:54.119382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4f55d97f-fcbf-4f7b-ac09-2f3f224c2712 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:54.127618 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4f55d97f-fcbf-4f7b-ac09-2f3f224c2712 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.196580 Aug 04 04:41:54.128524 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 188/378] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:53 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:55.084059 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dfc9dae2-4a0a-422c-848a-590b11465a60 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-587143431"}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:55.084880 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dfc9dae2-4a0a-422c-848a-590b11465a60 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:55.091370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfc9dae2-4a0a-422c-848a-590b11465a60 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:55.091812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfc9dae2-4a0a-422c-848a-590b11465a60 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:55.092576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfc9dae2-4a0a-422c-848a-590b11465a60 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:55.093006 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfc9dae2-4a0a-422c-848a-590b11465a60 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:55.154911 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-642a6192-7fb1-4b36-b41f-fc79be340656 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:55.155713 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-642a6192-7fb1-4b36-b41f-fc79be340656 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:55.162993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-642a6192-7fb1-4b36-b41f-fc79be340656 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:55.163449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-642a6192-7fb1-4b36-b41f-fc79be340656 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:55.164222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-642a6192-7fb1-4b36-b41f-fc79be340656 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:55.164654 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-642a6192-7fb1-4b36-b41f-fc79be340656 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:55.278740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.network.security_group_api [None req-dfc9dae2-4a0a-422c-848a-590b11465a60 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Adding security group 829bd7b8-0f07-48b5-8ad6-57db14796fdf to port e652ee96-0575-4a05-ad13-04b1d7dbc6e7 Aug 04 04:41:55.397954 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-642a6192-7fb1-4b36-b41f-fc79be340656 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:55.412328 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-642a6192-7fb1-4b36-b41f-fc79be340656 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.262399 Aug 04 04:41:55.412833 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 189/379] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:55 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:55.664820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dfc9dae2-4a0a-422c-848a-590b11465a60 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "POST /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/action" status: 202 len: 0 microversion: 2.1 time: 0.585487 Aug 04 04:41:55.665642 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 191/380] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:41:55 2022] POST /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:41:55.674680 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9b0afa83-123d-41eb-a0e2-f3d0647d18c8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:55.675757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9b0afa83-123d-41eb-a0e2-f3d0647d18c8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:55.682215 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-7efa82c1-187a-4fc8-be79-b84a7af57fc3 req-c865bac5-6b0b-45e6-b571-8e08b7f584f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1762cb-4b08-41db-8302-59f56c67370a", "tag": "e652ee96-0575-4a05-ad13-04b1d7dbc6e7"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:55.692162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9b0afa83-123d-41eb-a0e2-f3d0647d18c8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:55.694269 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-7efa82c1-187a-4fc8-be79-b84a7af57fc3 req-c865bac5-6b0b-45e6-b571-8e08b7f584f0 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:55.694912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-7efa82c1-187a-4fc8-be79-b84a7af57fc3 req-c865bac5-6b0b-45e6-b571-8e08b7f584f0 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:55.702358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9b0afa83-123d-41eb-a0e2-f3d0647d18c8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:55.703198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9b0afa83-123d-41eb-a0e2-f3d0647d18c8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:55.705509 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9b0afa83-123d-41eb-a0e2-f3d0647d18c8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:55.713127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-7efa82c1-187a-4fc8-be79-b84a7af57fc3 req-c865bac5-6b0b-45e6-b571-8e08b7f584f0 service nova] Creating event network-changed:e652ee96-0575-4a05-ad13-04b1d7dbc6e7 for instance af1762cb-4b08-41db-8302-59f56c67370a on hv-cinder-85127 Aug 04 04:41:55.720808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-7efa82c1-187a-4fc8-be79-b84a7af57fc3 req-c865bac5-6b0b-45e6-b571-8e08b7f584f0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043701 Aug 04 04:41:55.723356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 192/381] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:41:56.056513 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9b0afa83-123d-41eb-a0e2-f3d0647d18c8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:56.071799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9b0afa83-123d-41eb-a0e2-f3d0647d18c8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1637 microversion: 2.1 time: 0.401387 Aug 04 04:41:56.072702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 190/382] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:55 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1637 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:56.439816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-84158ecc-9d4f-46c2-b3ff-b6281c32549a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:56.441796 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-84158ecc-9d4f-46c2-b3ff-b6281c32549a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:56.451598 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84158ecc-9d4f-46c2-b3ff-b6281c32549a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:56.452282 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84158ecc-9d4f-46c2-b3ff-b6281c32549a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:56.453668 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84158ecc-9d4f-46c2-b3ff-b6281c32549a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:56.454116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84158ecc-9d4f-46c2-b3ff-b6281c32549a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:56.703743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-84158ecc-9d4f-46c2-b3ff-b6281c32549a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:56.712347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-84158ecc-9d4f-46c2-b3ff-b6281c32549a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.280587 Aug 04 04:41:56.712927 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 193/383] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:56 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:57.734181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0e19bed0-6510-4bd7-a038-36e4ec73e8b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:57.738287 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0e19bed0-6510-4bd7-a038-36e4ec73e8b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:57.746550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e19bed0-6510-4bd7-a038-36e4ec73e8b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:57.747007 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e19bed0-6510-4bd7-a038-36e4ec73e8b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:57.747795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e19bed0-6510-4bd7-a038-36e4ec73e8b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:57.748260 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e19bed0-6510-4bd7-a038-36e4ec73e8b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:57.892797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0e19bed0-6510-4bd7-a038-36e4ec73e8b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:57.903871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0e19bed0-6510-4bd7-a038-36e4ec73e8b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.173789 Aug 04 04:41:57.904839 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 191/384] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:57 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:41:58.926334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1ae5dead-5bb7-49b8-bce8-b34cad6ce3bf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:58.927532 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1ae5dead-5bb7-49b8-bce8-b34cad6ce3bf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:58.930096 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:58.935858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ae5dead-5bb7-49b8-bce8-b34cad6ce3bf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:58.936308 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ae5dead-5bb7-49b8-bce8-b34cad6ce3bf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:58.937103 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ae5dead-5bb7-49b8-bce8-b34cad6ce3bf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:58.937602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ae5dead-5bb7-49b8-bce8-b34cad6ce3bf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:59.109433 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1ae5dead-5bb7-49b8-bce8-b34cad6ce3bf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:59.111930 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:59.124188 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1ae5dead-5bb7-49b8-bce8-b34cad6ce3bf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1501 microversion: 2.1 time: 0.200960 Aug 04 04:41:59.124878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 194/385] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:58 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1501 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:41:59.145886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2c97298c-1d4b-4e0a-b9e1-eddd11c3a48a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee11c006-8fe8-456e-8647-c992e3409758"}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:59.155932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2c97298c-1d4b-4e0a-b9e1-eddd11c3a48a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:59.165777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2c97298c-1d4b-4e0a-b9e1-eddd11c3a48a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:59.166815 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2c97298c-1d4b-4e0a-b9e1-eddd11c3a48a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:59.167782 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2c97298c-1d4b-4e0a-b9e1-eddd11c3a48a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:59.168222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2c97298c-1d4b-4e0a-b9e1-eddd11c3a48a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:59.194671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-2c97298c-1d4b-4e0a-b9e1-eddd11c3a48a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] HTTP exception thrown: Cannot 'attach_volume' instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 while it is in vm_state rescued Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2c97298c-1d4b-4e0a-b9e1-eddd11c3a48a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Request method failure captured: Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: POST /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1/os-volume_attachments HTTP/1.1 Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 74 Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi602uPptuqgFy02y-YzHoVclj5Hq7_LkNXMBvqUC5pmyegtWcMpw0F-pJKdartgmkAfmDd6OJ6hXCBM-pb0p815YHMVq5KwB3Coc6cqRFibtNHQXOz8y91Enyk9viUVHGfYG4BP1_AVa5Ew_ePDyW5iQqlyKdaV2k_FR1A3vcY5g3BfI Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: e43171bfd4564b0c92395767641b91ce Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1508178778 Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 04:41:59.196378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 04:41:59.198026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e43171bfd4564b0c92395767641b91ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e43171bfd4564b0c92395767641b91ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e43171bfd4564b0c92395767641b91ce", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e43171bfd4564b0c92395767641b91ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:41:59.198026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1508178778 Aug 04 04:41:59.198026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: e43171bfd4564b0c92395767641b91ce Aug 04 04:41:59.198026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1508178778 Aug 04 04:41:59.198026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-ServerRescueNegativeTestJSON-1508178778-project Aug 04 04:41:59.198026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 04:41:59.198026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 04:41:59.198026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 40a2cbbc654749199e742ae96329a1d9 Aug 04 04:41:59.198026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1508178778-project Aug 04 04:41:59.198026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Aug 04 04:41:59.198026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {"volumeAttachment": {"volumeId": "ee11c006-8fe8-456e-8647-c992e3409758"}} Aug 04 04:41:59.198026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Cannot 'attach_volume' instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 while it is in vm_state rescued Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'server_id': '66e490bd-0671-4049-b64c-74e8dfe5bfb1', 'body': {'volumeAttachment': {'volumeId': 'ee11c006-8fe8-456e-8647-c992e3409758'}}} Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:41:59.198930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 while it is in vm_state rescued Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:41:59.200424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:41:59.201966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:41:59.201966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:41:59.201966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 while it is in vm_state rescued Aug 04 04:41:59.201966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:41:59.201966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2c97298c-1d4b-4e0a-b9e1-eddd11c3a48a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Returning 409 to user: Cannot 'attach_volume' instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 while it is in vm_state rescued {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:41:59.201966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2c97298c-1d4b-4e0a-b9e1-eddd11c3a48a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "POST /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056189 Aug 04 04:41:59.201966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 192/386] 10.222.0.47 () {60 vars in 1323 bytes} [Thu Aug 4 04:41:59 2022] POST /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:41:59.207246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-649d0646-3ce4-4b1c-a5a6-0edc4c33cfd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:41:59.207854 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-649d0646-3ce4-4b1c-a5a6-0edc4c33cfd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:59.216294 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-649d0646-3ce4-4b1c-a5a6-0edc4c33cfd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:59.216868 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-649d0646-3ce4-4b1c-a5a6-0edc4c33cfd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:59.218024 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-649d0646-3ce4-4b1c-a5a6-0edc4c33cfd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:59.218468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-649d0646-3ce4-4b1c-a5a6-0edc4c33cfd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:59.316066 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-649d0646-3ce4-4b1c-a5a6-0edc4c33cfd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "POST /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1/action" status: 202 len: 0 microversion: 2.1 time: 0.112775 Aug 04 04:41:59.316705 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 195/387] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:41:59 2022] POST /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:41:59.325856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7cf9a7bb-0b0f-4361-8898-90eab94d2c05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:41:59.326628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7cf9a7bb-0b0f-4361-8898-90eab94d2c05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:41:59.333842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7cf9a7bb-0b0f-4361-8898-90eab94d2c05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:59.334361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7cf9a7bb-0b0f-4361-8898-90eab94d2c05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:59.335196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7cf9a7bb-0b0f-4361-8898-90eab94d2c05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:41:59.335631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7cf9a7bb-0b0f-4361-8898-90eab94d2c05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:41:59.535728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7cf9a7bb-0b0f-4361-8898-90eab94d2c05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:41:59.544837 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7cf9a7bb-0b0f-4361-8898-90eab94d2c05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1509 microversion: 2.1 time: 0.222887 Aug 04 04:41:59.545419 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 193/388] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:41:59 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:00.567058 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a42e3a4b-3ed9-4025-be21-4e8ef48fe4ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:00.568085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a42e3a4b-3ed9-4025-be21-4e8ef48fe4ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:00.574336 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a42e3a4b-3ed9-4025-be21-4e8ef48fe4ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:00.574786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a42e3a4b-3ed9-4025-be21-4e8ef48fe4ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:00.575550 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a42e3a4b-3ed9-4025-be21-4e8ef48fe4ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:00.575989 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a42e3a4b-3ed9-4025-be21-4e8ef48fe4ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:00.720804 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a42e3a4b-3ed9-4025-be21-4e8ef48fe4ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:00.732361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a42e3a4b-3ed9-4025-be21-4e8ef48fe4ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1509 microversion: 2.1 time: 0.170004 Aug 04 04:42:00.732938 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 196/389] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:00 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:01.754159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a41c8b06-6ddd-4eb1-8a5b-c19970fa6118 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:01.754796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a41c8b06-6ddd-4eb1-8a5b-c19970fa6118 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:01.761491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a41c8b06-6ddd-4eb1-8a5b-c19970fa6118 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:01.761904 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a41c8b06-6ddd-4eb1-8a5b-c19970fa6118 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:01.762963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a41c8b06-6ddd-4eb1-8a5b-c19970fa6118 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:01.763517 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a41c8b06-6ddd-4eb1-8a5b-c19970fa6118 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:01.778037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:01.912856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a41c8b06-6ddd-4eb1-8a5b-c19970fa6118 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:01.921364 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a41c8b06-6ddd-4eb1-8a5b-c19970fa6118 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1509 microversion: 2.1 time: 0.170917 Aug 04 04:42:01.922050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 194/390] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:01 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:02.947310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-887da354-9a28-461c-ae2d-ee8e0616ca1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:02.950312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-887da354-9a28-461c-ae2d-ee8e0616ca1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:02.957133 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-887da354-9a28-461c-ae2d-ee8e0616ca1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:02.957619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-887da354-9a28-461c-ae2d-ee8e0616ca1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:02.958514 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-887da354-9a28-461c-ae2d-ee8e0616ca1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:02.958956 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-887da354-9a28-461c-ae2d-ee8e0616ca1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:03.099581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-887da354-9a28-461c-ae2d-ee8e0616ca1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:03.107227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-887da354-9a28-461c-ae2d-ee8e0616ca1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1509 microversion: 2.1 time: 0.163716 Aug 04 04:42:03.107800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 197/391] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:02 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:04.128888 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6e0cc332-af94-4827-8372-2802ea217b84 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:04.130180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6e0cc332-af94-4827-8372-2802ea217b84 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:04.137010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6e0cc332-af94-4827-8372-2802ea217b84 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:04.137471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6e0cc332-af94-4827-8372-2802ea217b84 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:04.138280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6e0cc332-af94-4827-8372-2802ea217b84 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:04.138727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6e0cc332-af94-4827-8372-2802ea217b84 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:04.306065 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6e0cc332-af94-4827-8372-2802ea217b84 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:04.314093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6e0cc332-af94-4827-8372-2802ea217b84 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1509 microversion: 2.1 time: 0.189542 Aug 04 04:42:04.314696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 195/392] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:04 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:05.337441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f2ac4729-27cf-40c7-bb50-0cc121a0e9c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:05.338535 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f2ac4729-27cf-40c7-bb50-0cc121a0e9c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:05.345025 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f2ac4729-27cf-40c7-bb50-0cc121a0e9c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:05.345481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f2ac4729-27cf-40c7-bb50-0cc121a0e9c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:05.346271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f2ac4729-27cf-40c7-bb50-0cc121a0e9c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:05.346703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f2ac4729-27cf-40c7-bb50-0cc121a0e9c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:05.489037 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f2ac4729-27cf-40c7-bb50-0cc121a0e9c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:05.496764 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f2ac4729-27cf-40c7-bb50-0cc121a0e9c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1509 microversion: 2.1 time: 0.164377 Aug 04 04:42:05.497305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 198/393] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:05 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:06.518604 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8c550dba-37ef-4d29-ad30-66093a34d778 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:06.519223 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8c550dba-37ef-4d29-ad30-66093a34d778 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:06.526244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8c550dba-37ef-4d29-ad30-66093a34d778 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:06.526699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8c550dba-37ef-4d29-ad30-66093a34d778 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:06.527467 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8c550dba-37ef-4d29-ad30-66093a34d778 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:06.527909 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8c550dba-37ef-4d29-ad30-66093a34d778 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:06.663507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8c550dba-37ef-4d29-ad30-66093a34d778 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:06.671230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8c550dba-37ef-4d29-ad30-66093a34d778 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1515 microversion: 2.1 time: 0.156545 Aug 04 04:42:06.671880 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 196/394] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:06 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:08.030895 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-955b1572-fd95-4c7c-ac96-26ad1df0fa78 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Action: 'create', calling method: .version_select at 0x7fc942383670>, body: {"keypair": {"name": "tempest-keypair-10215279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHcqJwypVhCNuQn+sQ7c+wjTbD3CkcV4vFSbX+H1WMeS9MFuh7nOA5DQmQjYvLi8wZQK/PjT4T4DjT8nIZ41ikTxYKD6RdPIvD797hssOfkFJ6swz0AjSgBzzWrKcSwAA=="}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:08.049948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-955b1572-fd95-4c7c-ac96-26ad1df0fa78 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Getting quotas for project e43171bfd4564b0c92395767641b91ce. Resources: {'key_pairs'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:42:08.054029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-955b1572-fd95-4c7c-ac96-26ad1df0fa78 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Getting quotas for user 40a2cbbc654749199e742ae96329a1d9 and project e43171bfd4564b0c92395767641b91ce. Resources: {'key_pairs'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:42:08.081505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-955b1572-fd95-4c7c-ac96-26ad1df0fa78 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.054092 Aug 04 04:42:08.084085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 199/395] 10.222.0.47 () {60 vars in 1159 bytes} [Thu Aug 4 04:42:08 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:09.434482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1382107864", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de933171-52eb-4683-9f34-62c4f6c44c8a"}], "security_groups": [{"name": "tempest-securitygroup--1892166166"}], "key_name": "tempest-keypair-10215279", "user_data": "}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:09.546526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] validate_networks() for [('de933171-52eb-4683-9f34-62c4f6c44c8a', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:42:09.951873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:42:09.952299 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:42:09.952770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:42:09.953178 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:42:09.953636 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:42:09.963191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:09.963564 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:09.964352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:09.964783 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:09.981716 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Getting quotas for project e43171bfd4564b0c92395767641b91ce. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:42:09.985891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Getting quotas for user 40a2cbbc654749199e742ae96329a1d9 and project e43171bfd4564b0c92395767641b91ce. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:42:09.997589 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:42:09.999869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:42:10.048924 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c8aab30d-52bb-413c-999f-a571c2c52b57 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.619478 Aug 04 04:42:10.049997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 197/396] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:42:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:42:10.063211 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f27a6fa7-2f36-4556-886a-1236b78708ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:10.064071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f27a6fa7-2f36-4556-886a-1236b78708ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:10.123177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f27a6fa7-2f36-4556-886a-1236b78708ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:10.132929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f27a6fa7-2f36-4556-886a-1236b78708ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1244 microversion: 2.1 time: 0.075912 Aug 04 04:42:10.133505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 200/397] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:10 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1244 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:10.727066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5b9435b5-bf7c-4d4f-97fd-5db0f478e6b6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d376a252-f2a2-46bf-b375-31254ce16a00", "device": "/dev/sdb"}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:10.729993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5b9435b5-bf7c-4d4f-97fd-5db0f478e6b6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:10.736536 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b9435b5-bf7c-4d4f-97fd-5db0f478e6b6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:10.736990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b9435b5-bf7c-4d4f-97fd-5db0f478e6b6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:10.737783 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b9435b5-bf7c-4d4f-97fd-5db0f478e6b6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:10.738222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b9435b5-bf7c-4d4f-97fd-5db0f478e6b6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:11.154337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-10819b4e-c9cc-444d-ab60-d96301039451 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:11.155045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-10819b4e-c9cc-444d-ab60-d96301039451 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:11.163427 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-10819b4e-c9cc-444d-ab60-d96301039451 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:11.163888 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-10819b4e-c9cc-444d-ab60-d96301039451 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:11.164668 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-10819b4e-c9cc-444d-ab60-d96301039451 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:11.165110 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-10819b4e-c9cc-444d-ab60-d96301039451 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:11.284995 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5b9435b5-bf7c-4d4f-97fd-5db0f478e6b6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "POST /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.562406 Aug 04 04:42:11.289155 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-10819b4e-c9cc-444d-ab60-d96301039451 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:11.293908 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 198/398] 10.222.0.47 () {60 vars in 1323 bytes} [Thu Aug 4 04:42:10 2022] POST /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f/os-volume_attachments => generated 194 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:11.320849 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-10819b4e-c9cc-444d-ab60-d96301039451 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1304 microversion: 2.1 time: 0.159529 Aug 04 04:42:11.321425 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 201/399] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:11 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:12.345625 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ff8e1937-3a02-4169-a29a-00216b8038ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:12.346326 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ff8e1937-3a02-4169-a29a-00216b8038ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:12.353530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff8e1937-3a02-4169-a29a-00216b8038ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:12.354040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff8e1937-3a02-4169-a29a-00216b8038ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:12.354823 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff8e1937-3a02-4169-a29a-00216b8038ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:12.355268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff8e1937-3a02-4169-a29a-00216b8038ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:12.575318 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ff8e1937-3a02-4169-a29a-00216b8038ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:12.583495 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ff8e1937-3a02-4169-a29a-00216b8038ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1370 microversion: 2.1 time: 0.242683 Aug 04 04:42:12.584099 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 199/400] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:12.781895 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-d587ef2d-1086-468f-b026-fabd2777ef53 req-19d5365e-3442-4d7a-a093-6e8627a54150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7ee17d5-d905-461c-95ff-9588447cc943", "tag": "ca3160b8-9bcf-4d31-a9a6-db749330c679"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:12.792952 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-d587ef2d-1086-468f-b026-fabd2777ef53 req-19d5365e-3442-4d7a-a093-6e8627a54150 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:12.793861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-d587ef2d-1086-468f-b026-fabd2777ef53 req-19d5365e-3442-4d7a-a093-6e8627a54150 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:12.808177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-d587ef2d-1086-468f-b026-fabd2777ef53 req-19d5365e-3442-4d7a-a093-6e8627a54150 service nova] Creating event network-changed:ca3160b8-9bcf-4d31-a9a6-db749330c679 for instance a7ee17d5-d905-461c-95ff-9588447cc943 on hv-cinder-85127 Aug 04 04:42:12.813890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-d587ef2d-1086-468f-b026-fabd2777ef53 req-19d5365e-3442-4d7a-a093-6e8627a54150 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036404 Aug 04 04:42:12.814971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 202/401] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:13.607997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-85b7fe01-9266-4810-83a7-e67d2868db3f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:13.608656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-85b7fe01-9266-4810-83a7-e67d2868db3f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:13.619354 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-85b7fe01-9266-4810-83a7-e67d2868db3f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:13.619776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-85b7fe01-9266-4810-83a7-e67d2868db3f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:13.620550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-85b7fe01-9266-4810-83a7-e67d2868db3f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:13.620983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-85b7fe01-9266-4810-83a7-e67d2868db3f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:13.768763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-85b7fe01-9266-4810-83a7-e67d2868db3f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:13.776806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-85b7fe01-9266-4810-83a7-e67d2868db3f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1370 microversion: 2.1 time: 0.173665 Aug 04 04:42:13.777390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 200/402] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:13 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:14.799527 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-babc4f1e-5493-43f0-ba58-194177ebc317 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:14.800135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-babc4f1e-5493-43f0-ba58-194177ebc317 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:14.806859 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-babc4f1e-5493-43f0-ba58-194177ebc317 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:14.807313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-babc4f1e-5493-43f0-ba58-194177ebc317 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:14.808100 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-babc4f1e-5493-43f0-ba58-194177ebc317 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:14.808544 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-babc4f1e-5493-43f0-ba58-194177ebc317 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:15.048409 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-babc4f1e-5493-43f0-ba58-194177ebc317 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:15.056515 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-babc4f1e-5493-43f0-ba58-194177ebc317 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1370 microversion: 2.1 time: 0.261730 Aug 04 04:42:15.057011 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 203/403] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:14 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:16.077482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-17223d07-46dc-4ba5-af0d-57789ea289a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:16.078059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-17223d07-46dc-4ba5-af0d-57789ea289a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:16.085219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-17223d07-46dc-4ba5-af0d-57789ea289a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:16.085944 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-17223d07-46dc-4ba5-af0d-57789ea289a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:16.086720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-17223d07-46dc-4ba5-af0d-57789ea289a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:16.087151 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-17223d07-46dc-4ba5-af0d-57789ea289a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:16.243125 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-17223d07-46dc-4ba5-af0d-57789ea289a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:16.252505 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-17223d07-46dc-4ba5-af0d-57789ea289a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1370 microversion: 2.1 time: 0.178807 Aug 04 04:42:16.253090 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 201/404] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:17.275989 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2139d452-145d-433f-80bf-111802126ff0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:17.276604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2139d452-145d-433f-80bf-111802126ff0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:17.283292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2139d452-145d-433f-80bf-111802126ff0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:17.283750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2139d452-145d-433f-80bf-111802126ff0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:17.284550 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2139d452-145d-433f-80bf-111802126ff0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:17.285503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2139d452-145d-433f-80bf-111802126ff0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:17.424428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2139d452-145d-433f-80bf-111802126ff0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:17.432642 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2139d452-145d-433f-80bf-111802126ff0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1370 microversion: 2.1 time: 0.160463 Aug 04 04:42:17.433229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 204/405] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:17 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:17.909333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-f8aa678b-cfa5-4093-b225-f39765f4c444 req-3e7e013f-349b-483c-b8ef-cd3d73b8f5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7ee17d5-d905-461c-95ff-9588447cc943", "name": "network-vif-plugged", "status": "completed", "tag": "ca3160b8-9bcf-4d31-a9a6-db749330c679"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:17.921538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-f8aa678b-cfa5-4093-b225-f39765f4c444 req-3e7e013f-349b-483c-b8ef-cd3d73b8f5fd service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:17.922016 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-f8aa678b-cfa5-4093-b225-f39765f4c444 req-3e7e013f-349b-483c-b8ef-cd3d73b8f5fd service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:17.936764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-f8aa678b-cfa5-4093-b225-f39765f4c444 req-3e7e013f-349b-483c-b8ef-cd3d73b8f5fd service nova] Creating event network-vif-plugged:ca3160b8-9bcf-4d31-a9a6-db749330c679 for instance a7ee17d5-d905-461c-95ff-9588447cc943 on hv-cinder-85127 Aug 04 04:42:17.943761 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-f8aa678b-cfa5-4093-b225-f39765f4c444 req-3e7e013f-349b-483c-b8ef-cd3d73b8f5fd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037629 Aug 04 04:42:17.944129 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 202/406] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:18.453318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2d21a86b-5e42-4d5b-8f9c-4b9931efc2b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:18.453984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2d21a86b-5e42-4d5b-8f9c-4b9931efc2b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:18.462351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d21a86b-5e42-4d5b-8f9c-4b9931efc2b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:18.463158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d21a86b-5e42-4d5b-8f9c-4b9931efc2b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:18.464098 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d21a86b-5e42-4d5b-8f9c-4b9931efc2b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:18.464622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d21a86b-5e42-4d5b-8f9c-4b9931efc2b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:18.741118 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2d21a86b-5e42-4d5b-8f9c-4b9931efc2b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:18.748765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2d21a86b-5e42-4d5b-8f9c-4b9931efc2b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1370 microversion: 2.1 time: 0.299290 Aug 04 04:42:18.749336 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 205/407] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:18 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1370 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:19.019776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-303349ad-15e3-4c35-ab4f-bb9a401d2c62 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:19.020607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-303349ad-15e3-4c35-ab4f-bb9a401d2c62 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:19.027900 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-303349ad-15e3-4c35-ab4f-bb9a401d2c62 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.028905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-303349ad-15e3-4c35-ab4f-bb9a401d2c62 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.029732 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-303349ad-15e3-4c35-ab4f-bb9a401d2c62 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.030399 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-303349ad-15e3-4c35-ab4f-bb9a401d2c62 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.167724 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-303349ad-15e3-4c35-ab4f-bb9a401d2c62 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lazy-loading 'services' on Instance uuid ce02b26c-276e-4d87-9790-87a8469fac7a {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:42:19.296698 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-303349ad-15e3-4c35-ab4f-bb9a401d2c62 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/os-volume_attachments/f43986d4-c50f-4c20-a9c5-8945a91e48b6" status: 202 len: 0 microversion: 2.1 time: 0.281862 Aug 04 04:42:19.297305 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 203/408] 10.222.0.47 () {58 vars in 1416 bytes} [Thu Aug 4 04:42:19 2022] DELETE /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/os-volume_attachments/f43986d4-c50f-4c20-a9c5-8945a91e48b6 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:42:19.770347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-21491496-5144-4c2c-a37a-fa1c96a8bf3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:19.770972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-21491496-5144-4c2c-a37a-fa1c96a8bf3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:19.777665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21491496-5144-4c2c-a37a-fa1c96a8bf3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.778147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21491496-5144-4c2c-a37a-fa1c96a8bf3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.778948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21491496-5144-4c2c-a37a-fa1c96a8bf3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:19.779346 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21491496-5144-4c2c-a37a-fa1c96a8bf3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:19.938479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-21491496-5144-4c2c-a37a-fa1c96a8bf3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:19.949388 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-21491496-5144-4c2c-a37a-fa1c96a8bf3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1370 microversion: 2.1 time: 0.183433 Aug 04 04:42:19.950314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 206/409] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:20.969494 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:20.970228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=6 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:20.975164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9add5fcb-c726-428a-ab5f-65f0bc88d511 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:20.975859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9add5fcb-c726-428a-ab5f-65f0bc88d511 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:20.977805 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:20.985290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9add5fcb-c726-428a-ab5f-65f0bc88d511 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:20.985765 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9add5fcb-c726-428a-ab5f-65f0bc88d511 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:20.986538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9add5fcb-c726-428a-ab5f-65f0bc88d511 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:20.986986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9add5fcb-c726-428a-ab5f-65f0bc88d511 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:21.157863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9add5fcb-c726-428a-ab5f-65f0bc88d511 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:21.166820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9add5fcb-c726-428a-ab5f-65f0bc88d511 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1370 microversion: 2.1 time: 0.198016 Aug 04 04:42:21.167421 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 204/410] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:22.187569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-be039aa9-6afe-4a84-b68b-0c50434de760 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:22.188190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-be039aa9-6afe-4a84-b68b-0c50434de760 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:22.190173 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=6 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:22.196969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-be039aa9-6afe-4a84-b68b-0c50434de760 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:22.197424 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-be039aa9-6afe-4a84-b68b-0c50434de760 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:22.198234 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-be039aa9-6afe-4a84-b68b-0c50434de760 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:22.198680 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-be039aa9-6afe-4a84-b68b-0c50434de760 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:22.334701 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-be039aa9-6afe-4a84-b68b-0c50434de760 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:22.342205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-be039aa9-6afe-4a84-b68b-0c50434de760 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1370 microversion: 2.1 time: 0.158575 Aug 04 04:42:22.342774 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 207/411] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:22 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:23.369868 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f9e50a07-6e7c-498a-8fb2-655c435d93c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:23.370488 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f9e50a07-6e7c-498a-8fb2-655c435d93c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:23.382827 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9e50a07-6e7c-498a-8fb2-655c435d93c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.383279 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9e50a07-6e7c-498a-8fb2-655c435d93c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:23.384049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9e50a07-6e7c-498a-8fb2-655c435d93c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.384480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9e50a07-6e7c-498a-8fb2-655c435d93c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:23.546589 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f9e50a07-6e7c-498a-8fb2-655c435d93c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:23.557401 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f9e50a07-6e7c-498a-8fb2-655c435d93c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1565 microversion: 2.1 time: 0.199035 Aug 04 04:42:23.558024 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 205/412] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:23 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1565 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:23.579584 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8e0d2d15-fe49-48fa-92e2-cbd5e7eeaa71 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:23.580814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8e0d2d15-fe49-48fa-92e2-cbd5e7eeaa71 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:23.589117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8e0d2d15-fe49-48fa-92e2-cbd5e7eeaa71 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.589960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8e0d2d15-fe49-48fa-92e2-cbd5e7eeaa71 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:23.591017 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8e0d2d15-fe49-48fa-92e2-cbd5e7eeaa71 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:23.591742 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8e0d2d15-fe49-48fa-92e2-cbd5e7eeaa71 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:23.695666 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8e0d2d15-fe49-48fa-92e2-cbd5e7eeaa71 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120048 Aug 04 04:42:23.696255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 208/413] 10.222.0.47 () {58 vars in 1275 bytes} [Thu Aug 4 04:42:23 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:24.705306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-3c69f53f-1bd3-45b7-8f33-350e3b9b1dc3 req-641ab6a1-8fd1-4efc-8e32-f86a06749df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7ee17d5-d905-461c-95ff-9588447cc943", "tag": "ca3160b8-9bcf-4d31-a9a6-db749330c679"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:24.716408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-3c69f53f-1bd3-45b7-8f33-350e3b9b1dc3 req-641ab6a1-8fd1-4efc-8e32-f86a06749df4 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:24.716874 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-3c69f53f-1bd3-45b7-8f33-350e3b9b1dc3 req-641ab6a1-8fd1-4efc-8e32-f86a06749df4 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:24.736913 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-3c69f53f-1bd3-45b7-8f33-350e3b9b1dc3 req-641ab6a1-8fd1-4efc-8e32-f86a06749df4 service nova] Creating event network-changed:ca3160b8-9bcf-4d31-a9a6-db749330c679 for instance a7ee17d5-d905-461c-95ff-9588447cc943 on hv-cinder-85127 Aug 04 04:42:24.739937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-3c69f53f-1bd3-45b7-8f33-350e3b9b1dc3 req-641ab6a1-8fd1-4efc-8e32-f86a06749df4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038735 Aug 04 04:42:24.740622 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 206/414] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:33.940496 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:33.941348 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:33.945579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-51abbcdd-011d-42c5-97a5-8b43bc1e7a1f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:33.946092 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-51abbcdd-011d-42c5-97a5-8b43bc1e7a1f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:33.954297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-51abbcdd-011d-42c5-97a5-8b43bc1e7a1f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:33.954751 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-51abbcdd-011d-42c5-97a5-8b43bc1e7a1f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:33.955549 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-51abbcdd-011d-42c5-97a5-8b43bc1e7a1f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:33.955994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-51abbcdd-011d-42c5-97a5-8b43bc1e7a1f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:33.984076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-51abbcdd-011d-42c5-97a5-8b43bc1e7a1f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6/ips" status: 200 len: 149 microversion: 2.1 time: 0.044950 Aug 04 04:42:33.984755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 209/415] 10.222.0.47 () {58 vars in 1248 bytes} [Thu Aug 4 04:42:33 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:33.998324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-23bd6798-ae30-4487-b32e-d1cddb620248 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0960b040-d517-43ab-bf33-9ab1e6c05fef"}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:34.000889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-23bd6798-ae30-4487-b32e-d1cddb620248 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:34.007476 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-23bd6798-ae30-4487-b32e-d1cddb620248 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:34.007935 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-23bd6798-ae30-4487-b32e-d1cddb620248 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:34.008714 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-23bd6798-ae30-4487-b32e-d1cddb620248 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:34.009157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-23bd6798-ae30-4487-b32e-d1cddb620248 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:34.011852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:34.101792 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-23bd6798-ae30-4487-b32e-d1cddb620248 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] HTTP exception thrown: Invalid volume: volume 0960b040-d517-43ab-bf33-9ab1e6c05fef is already attached to instances: b66d5fe6-f2d3-45e8-a225-8d7d10522e92 Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-23bd6798-ae30-4487-b32e-d1cddb620248 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Request method failure captured: Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: POST /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6/os-volume_attachments HTTP/1.1 Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 74 Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi601nPjLcmPV0vVg2FNKyAsUUje18RWIG_TxIfWC210jnaphASZrRhZyq9Y_SDchjVsQCYWSIYUoM5T9CtXKQ_J1Fh7Tjbxe-nlzSYrFMa_gd3dtSn8J6vs-YriYCapLoJ7GeQWUpW8try5lu_qo4lbCzvyB9WeIJv208TzJ5f7iZnds Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 04:42:34.103523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 04:42:34.105149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9124d19d48f44fe2a904a715e5db1223", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:42:34.105149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:42:34.105149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 04:42:34.105149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:42:34.105149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 04:42:34.105149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 04:42:34.105149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 04:42:34.105149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 49a7ce9a27734dc0a187d1b217206785 Aug 04 04:42:34.105149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 04:42:34.105149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Aug 04 04:42:34.105149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {"volumeAttachment": {"volumeId": "0960b040-d517-43ab-bf33-9ab1e6c05fef"}} Aug 04 04:42:34.105149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Invalid volume: volume 0960b040-d517-43ab-bf33-9ab1e6c05fef is already attached to instances: b66d5fe6-f2d3-45e8-a225-8d7d10522e92 Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'server_id': '609de40c-089d-4edb-bb3e-9d66b12890a6', 'body': {'volumeAttachment': {'volumeId': '0960b040-d517-43ab-bf33-9ab1e6c05fef'}}} Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0960b040-d517-43ab-bf33-9ab1e6c05fef is already attached to instances: b66d5fe6-f2d3-45e8-a225-8d7d10522e92 Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:42:34.106031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0960b040-d517-43ab-bf33-9ab1e6c05fef is already attached to instances: b66d5fe6-f2d3-45e8-a225-8d7d10522e92 Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:34.107568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:34.108971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:34.108971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:42:34.108971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:42:34.108971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0960b040-d517-43ab-bf33-9ab1e6c05fef is already attached to instances: b66d5fe6-f2d3-45e8-a225-8d7d10522e92 Aug 04 04:42:34.108971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:42:34.108971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-23bd6798-ae30-4487-b32e-d1cddb620248 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Returning 400 to user: Invalid volume: volume 0960b040-d517-43ab-bf33-9ab1e6c05fef is already attached to instances: b66d5fe6-f2d3-45e8-a225-8d7d10522e92 {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:34.108971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-23bd6798-ae30-4487-b32e-d1cddb620248 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "POST /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111868 Aug 04 04:42:34.108971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 207/416] 10.222.0.47 () {60 vars in 1323 bytes} [Thu Aug 4 04:42:33 2022] POST /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:42:34.114473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a7dbcded-6700-4382-8afc-d297f1e9e257 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:34.114967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a7dbcded-6700-4382-8afc-d297f1e9e257 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:34.121187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a7dbcded-6700-4382-8afc-d297f1e9e257 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:34.121666 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a7dbcded-6700-4382-8afc-d297f1e9e257 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:34.122432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a7dbcded-6700-4382-8afc-d297f1e9e257 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:34.122866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a7dbcded-6700-4382-8afc-d297f1e9e257 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:34.149233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a7dbcded-6700-4382-8afc-d297f1e9e257 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Going to try to terminate instance {{(pid=134884) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:42:34.246537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a7dbcded-6700-4382-8afc-d297f1e9e257 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "DELETE /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 204 len: 0 microversion: 2.1 time: 0.135706 Aug 04 04:42:34.247128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 210/417] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:42:34 2022] DELETE /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:42:34.261142 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-83143dba-caa4-4e49-aae6-11dd6f03c58c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:34.262641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-83143dba-caa4-4e49-aae6-11dd6f03c58c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:34.273830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83143dba-caa4-4e49-aae6-11dd6f03c58c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:34.274560 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83143dba-caa4-4e49-aae6-11dd6f03c58c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:34.275725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83143dba-caa4-4e49-aae6-11dd6f03c58c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:34.276359 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-83143dba-caa4-4e49-aae6-11dd6f03c58c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:34.343280 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1aed2fb4-9112-4486-96c2-5695171007a2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:34.351742 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1aed2fb4-9112-4486-96c2-5695171007a2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:34.352356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1aed2fb4-9112-4486-96c2-5695171007a2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:34.420339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1aed2fb4-9112-4486-96c2-5695171007a2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Going to try to stop instance {{(pid=134884) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 04:42:34.476669 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1aed2fb4-9112-4486-96c2-5695171007a2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "POST /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/action" status: 202 len: 0 microversion: 2.1 time: 0.137609 Aug 04 04:42:34.477538 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 211/418] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:42:34 2022] POST /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:42:34.479049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-83143dba-caa4-4e49-aae6-11dd6f03c58c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:34.486231 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8ec61fff-c700-439b-b218-7f0423b5d5ba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:34.486848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8ec61fff-c700-439b-b218-7f0423b5d5ba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:34.494146 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ec61fff-c700-439b-b218-7f0423b5d5ba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:34.494596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ec61fff-c700-439b-b218-7f0423b5d5ba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:34.495377 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ec61fff-c700-439b-b218-7f0423b5d5ba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:34.495860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ec61fff-c700-439b-b218-7f0423b5d5ba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:34.497230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-83143dba-caa4-4e49-aae6-11dd6f03c58c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1681 microversion: 2.1 time: 0.241076 Aug 04 04:42:34.510080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 208/419] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:34 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1681 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:34.681532 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8ec61fff-c700-439b-b218-7f0423b5d5ba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:34.692588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8ec61fff-c700-439b-b218-7f0423b5d5ba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.210347 Aug 04 04:42:34.697874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 212/420] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:34 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:35.521475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7f4035a1-4378-4759-bcdb-05e099056694 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:35.522285 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7f4035a1-4378-4759-bcdb-05e099056694 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:35.529224 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7f4035a1-4378-4759-bcdb-05e099056694 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:35.529853 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7f4035a1-4378-4759-bcdb-05e099056694 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:35.530653 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7f4035a1-4378-4759-bcdb-05e099056694 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:35.531092 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7f4035a1-4378-4759-bcdb-05e099056694 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:35.670887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7f4035a1-4378-4759-bcdb-05e099056694 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:35.680290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7f4035a1-4378-4759-bcdb-05e099056694 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1681 microversion: 2.1 time: 0.163748 Aug 04 04:42:35.680873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 209/421] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:35 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:35.717180 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-44cf3c03-61f3-4c88-9415-59bc9e09c728 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:35.717816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-44cf3c03-61f3-4c88-9415-59bc9e09c728 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:35.724736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44cf3c03-61f3-4c88-9415-59bc9e09c728 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:35.725354 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44cf3c03-61f3-4c88-9415-59bc9e09c728 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:35.726168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44cf3c03-61f3-4c88-9415-59bc9e09c728 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:35.726604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44cf3c03-61f3-4c88-9415-59bc9e09c728 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:35.878559 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-44cf3c03-61f3-4c88-9415-59bc9e09c728 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:35.886215 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-44cf3c03-61f3-4c88-9415-59bc9e09c728 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.173434 Aug 04 04:42:35.886801 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 213/422] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:35 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:36.707840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5efaba2c-62bb-4d58-896e-cef94eaadf4e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:36.710161 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5efaba2c-62bb-4d58-896e-cef94eaadf4e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:36.716579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5efaba2c-62bb-4d58-896e-cef94eaadf4e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:36.717013 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5efaba2c-62bb-4d58-896e-cef94eaadf4e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:36.717828 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5efaba2c-62bb-4d58-896e-cef94eaadf4e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:36.718268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5efaba2c-62bb-4d58-896e-cef94eaadf4e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:36.821810 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5efaba2c-62bb-4d58-896e-cef94eaadf4e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:36.831835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5efaba2c-62bb-4d58-896e-cef94eaadf4e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1614 microversion: 2.1 time: 0.132149 Aug 04 04:42:36.832407 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 210/423] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:36 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1614 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:36.908132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ce92c7fb-2907-418c-8026-1d61a8c48748 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:36.909633 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ce92c7fb-2907-418c-8026-1d61a8c48748 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:36.917233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce92c7fb-2907-418c-8026-1d61a8c48748 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:36.917848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce92c7fb-2907-418c-8026-1d61a8c48748 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:36.918697 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce92c7fb-2907-418c-8026-1d61a8c48748 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:36.919211 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce92c7fb-2907-418c-8026-1d61a8c48748 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:37.347977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2e6efaa9-b909-4c98-ad40-92e682445229 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:37.348669 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2e6efaa9-b909-4c98-ad40-92e682445229 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:37.355580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2e6efaa9-b909-4c98-ad40-92e682445229 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:37.356290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2e6efaa9-b909-4c98-ad40-92e682445229 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:37.357358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2e6efaa9-b909-4c98-ad40-92e682445229 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:37.358248 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2e6efaa9-b909-4c98-ad40-92e682445229 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:37.397484 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ce92c7fb-2907-418c-8026-1d61a8c48748 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:37.407114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ce92c7fb-2907-418c-8026-1d61a8c48748 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.502891 Aug 04 04:42:37.407951 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 214/424] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:36 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:37.414440 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-7d440419-b24b-45b1-bcc7-b8a4d7d6c1ae req-f2b939ba-a8cd-4cc3-9d3a-cf08d2463492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609de40c-089d-4edb-bb3e-9d66b12890a6", "name": "network-vif-deleted", "tag": "36029921-51e1-49fb-8e5b-472199d8098b"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:37.424209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-7d440419-b24b-45b1-bcc7-b8a4d7d6c1ae req-f2b939ba-a8cd-4cc3-9d3a-cf08d2463492 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:37.425741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-7d440419-b24b-45b1-bcc7-b8a4d7d6c1ae req-f2b939ba-a8cd-4cc3-9d3a-cf08d2463492 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:37.439554 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-7d440419-b24b-45b1-bcc7-b8a4d7d6c1ae req-f2b939ba-a8cd-4cc3-9d3a-cf08d2463492 service nova] Creating event network-vif-deleted:36029921-51e1-49fb-8e5b-472199d8098b for instance 609de40c-089d-4edb-bb3e-9d66b12890a6 on hv-cinder-85127 Aug 04 04:42:37.448161 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-7d440419-b24b-45b1-bcc7-b8a4d7d6c1ae req-f2b939ba-a8cd-4cc3-9d3a-cf08d2463492 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037802 Aug 04 04:42:37.449240 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 215/425] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:37.494333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-2e6efaa9-b909-4c98-ad40-92e682445229 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lazy-loading 'services' on Instance uuid 58f6da3e-0628-438b-860b-97947b44ee7f {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:42:37.597123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2e6efaa9-b909-4c98-ad40-92e682445229 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "DELETE /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f/os-volume_attachments/d376a252-f2a2-46bf-b375-31254ce16a00" status: 202 len: 0 microversion: 2.1 time: 0.253560 Aug 04 04:42:37.598041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 211/426] 10.222.0.47 () {58 vars in 1416 bytes} [Thu Aug 4 04:42:37 2022] DELETE /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f/os-volume_attachments/d376a252-f2a2-46bf-b375-31254ce16a00 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:42:37.867326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-67864ef9-8c50-483c-8880-f90939ebc546 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:37.868209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-67864ef9-8c50-483c-8880-f90939ebc546 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:37.878168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67864ef9-8c50-483c-8880-f90939ebc546 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:37.879191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67864ef9-8c50-483c-8880-f90939ebc546 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:37.880261 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67864ef9-8c50-483c-8880-f90939ebc546 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:37.881189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67864ef9-8c50-483c-8880-f90939ebc546 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:37.923819 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67864ef9-8c50-483c-8880-f90939ebc546 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:37.925280 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67864ef9-8c50-483c-8880-f90939ebc546 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:37.926066 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.objects.instance [None req-67864ef9-8c50-483c-8880-f90939ebc546 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lazy-loading 'fault' on Instance uuid 609de40c-089d-4edb-bb3e-9d66b12890a6 {{(pid=134884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:42:37.987631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-67864ef9-8c50-483c-8880-f90939ebc546 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:37.997229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-67864ef9-8c50-483c-8880-f90939ebc546 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 200 len: 1332 microversion: 2.1 time: 0.147356 Aug 04 04:42:37.998015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 216/427] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:37 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 1332 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:38.437236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f7d246f9-2f6e-4b4a-9607-638d0d9424bf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:38.438033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f7d246f9-2f6e-4b4a-9607-638d0d9424bf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:38.449482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7d246f9-2f6e-4b4a-9607-638d0d9424bf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:38.450056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7d246f9-2f6e-4b4a-9607-638d0d9424bf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:38.450851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7d246f9-2f6e-4b4a-9607-638d0d9424bf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:38.451291 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7d246f9-2f6e-4b4a-9607-638d0d9424bf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:38.662579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f7d246f9-2f6e-4b4a-9607-638d0d9424bf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:38.673823 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f7d246f9-2f6e-4b4a-9607-638d0d9424bf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.240660 Aug 04 04:42:38.675766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 212/428] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:38 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:38.813948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-efaacff5-afd7-411e-8ab3-f7908d241f64 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:38.814463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-efaacff5-afd7-411e-8ab3-f7908d241f64 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:38.822236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-efaacff5-afd7-411e-8ab3-f7908d241f64 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:38.822750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-efaacff5-afd7-411e-8ab3-f7908d241f64 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:38.823755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-efaacff5-afd7-411e-8ab3-f7908d241f64 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:38.824412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-efaacff5-afd7-411e-8ab3-f7908d241f64 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:38.854915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-efaacff5-afd7-411e-8ab3-f7908d241f64 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Going to try to terminate instance {{(pid=134884) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:42:38.950782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-efaacff5-afd7-411e-8ab3-f7908d241f64 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "DELETE /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 204 len: 0 microversion: 2.1 time: 0.140352 Aug 04 04:42:38.952168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 217/429] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:42:38 2022] DELETE /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:42:38.962635 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ca4224cf-71a3-41f0-b8ef-11009e46c669 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:38.963467 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ca4224cf-71a3-41f0-b8ef-11009e46c669 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:38.970433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca4224cf-71a3-41f0-b8ef-11009e46c669 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:38.971480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca4224cf-71a3-41f0-b8ef-11009e46c669 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:38.972605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca4224cf-71a3-41f0-b8ef-11009e46c669 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:38.973114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca4224cf-71a3-41f0-b8ef-11009e46c669 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.030545 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2b9fd7fa-19f3-49fc-9370-a3f8bf6ed36b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:39.031350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2b9fd7fa-19f3-49fc-9370-a3f8bf6ed36b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:39.039446 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b9fd7fa-19f3-49fc-9370-a3f8bf6ed36b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.040178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b9fd7fa-19f3-49fc-9370-a3f8bf6ed36b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.041398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b9fd7fa-19f3-49fc-9370-a3f8bf6ed36b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.041862 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b9fd7fa-19f3-49fc-9370-a3f8bf6ed36b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.058028 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-2b9fd7fa-19f3-49fc-9370-a3f8bf6ed36b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] HTTP exception thrown: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2b9fd7fa-19f3-49fc-9370-a3f8bf6ed36b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Request method failure captured: Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 HTTP/1.1 Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601nPjLcmPV0vVg2FNKyAsUUje18RWIG_TxIfWC210jnaphASZrRhZyq9Y_SDchjVsQCYWSIYUoM5T9CtXKQ_J1Fh7Tjbxe-nlzSYrFMa_gd3dtSn8J6vs-YriYCapLoJ7GeQWUpW8try5lu_qo4lbCzvyB9WeIJv208TzJ5f7iZnds Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:42:39.059725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:42:39.061305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9124d19d48f44fe2a904a715e5db1223", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:42:39.061305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:42:39.061305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 04:42:39.061305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:42:39.061305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 04:42:39.061305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:42:39.061305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:42:39.061305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 49a7ce9a27734dc0a187d1b217206785 Aug 04 04:42:39.061305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 04:42:39.061305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 04:42:39.061305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 04:42:39.061305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '609de40c-089d-4edb-bb3e-9d66b12890a6'} Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:39.062221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 04:42:39.063619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:39.065356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2b9fd7fa-19f3-49fc-9370-a3f8bf6ed36b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Returning 404 to user: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:39.065356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2b9fd7fa-19f3-49fc-9370-a3f8bf6ed36b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 404 len: 111 microversion: 2.1 time: 0.034991 Aug 04 04:42:39.065512 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 218/430] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:39 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:42:39.070670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c82af3c7-7aed-4dde-beb1-034f77a696b5 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '.version_select at 0x7fc9422a6dc0>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:39.102128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c82af3c7-7aed-4dde-beb1-034f77a696b5 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610084148" status: 202 len: 0 microversion: 2.1 time: 0.035431 Aug 04 04:42:39.102747 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 219/431] 10.222.0.47 () {58 vars in 1221 bytes} [Thu Aug 4 04:42:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610084148 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:42:39.140898 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ca4224cf-71a3-41f0-b8ef-11009e46c669 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:39.148723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ca4224cf-71a3-41f0-b8ef-11009e46c669 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1515 microversion: 2.1 time: 0.190823 Aug 04 04:42:39.149371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 213/432] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:38 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:39.703898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ce02249d-58b4-4f21-8ba9-eb49f9346eb4 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:39.704432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ce02249d-58b4-4f21-8ba9-eb49f9346eb4 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:39.715521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce02249d-58b4-4f21-8ba9-eb49f9346eb4 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.715977 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce02249d-58b4-4f21-8ba9-eb49f9346eb4 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.716757 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce02249d-58b4-4f21-8ba9-eb49f9346eb4 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.717394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce02249d-58b4-4f21-8ba9-eb49f9346eb4 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.879235 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ce02249d-58b4-4f21-8ba9-eb49f9346eb4 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:39.887101 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ce02249d-58b4-4f21-8ba9-eb49f9346eb4 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.187277 Aug 04 04:42:39.887757 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 220/433] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:39 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:39.918311 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f1e9e2fb-0cff-41b6-8623-e792dfd9e58e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:39.918999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f1e9e2fb-0cff-41b6-8623-e792dfd9e58e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:39.931220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1e9e2fb-0cff-41b6-8623-e792dfd9e58e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.931220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1e9e2fb-0cff-41b6-8623-e792dfd9e58e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:39.931220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1e9e2fb-0cff-41b6-8623-e792dfd9e58e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:39.931220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1e9e2fb-0cff-41b6-8623-e792dfd9e58e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:40.018318 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-f1e9e2fb-0cff-41b6-8623-e792dfd9e58e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lazy-loading 'services' on Instance uuid b66d5fe6-f2d3-45e8-a225-8d7d10522e92 {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:42:40.122357 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f1e9e2fb-0cff-41b6-8623-e792dfd9e58e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/os-volume_attachments/0960b040-d517-43ab-bf33-9ab1e6c05fef" status: 202 len: 0 microversion: 2.1 time: 0.208124 Aug 04 04:42:40.122950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 214/434] 10.222.0.47 () {58 vars in 1416 bytes} [Thu Aug 4 04:42:39 2022] DELETE /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/os-volume_attachments/0960b040-d517-43ab-bf33-9ab1e6c05fef => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:42:40.131860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ce651da3-e09d-4b12-9edd-636866260766 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:40.135130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ce651da3-e09d-4b12-9edd-636866260766 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:40.143931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce651da3-e09d-4b12-9edd-636866260766 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:40.144378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce651da3-e09d-4b12-9edd-636866260766 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:40.145168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce651da3-e09d-4b12-9edd-636866260766 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:40.145625 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce651da3-e09d-4b12-9edd-636866260766 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:40.172887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2a6585b1-9789-4782-92d1-2cbb2ef56ef5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:40.173948 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2a6585b1-9789-4782-92d1-2cbb2ef56ef5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:40.180261 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ce651da3-e09d-4b12-9edd-636866260766 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052586 Aug 04 04:42:40.180848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 221/435] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:42:40 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:40.185602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2a6585b1-9789-4782-92d1-2cbb2ef56ef5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:40.185602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2a6585b1-9789-4782-92d1-2cbb2ef56ef5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:40.185602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2a6585b1-9789-4782-92d1-2cbb2ef56ef5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:40.185602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2a6585b1-9789-4782-92d1-2cbb2ef56ef5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:40.327784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2a6585b1-9789-4782-92d1-2cbb2ef56ef5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:40.335913 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2a6585b1-9789-4782-92d1-2cbb2ef56ef5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1515 microversion: 2.1 time: 0.168303 Aug 04 04:42:40.336473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 215/436] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:40 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:40.909270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0ed64d14-5fac-4bb2-8f89-8ca2fcc32a55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:40.909905 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0ed64d14-5fac-4bb2-8f89-8ca2fcc32a55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:40.916266 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ed64d14-5fac-4bb2-8f89-8ca2fcc32a55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:40.916716 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ed64d14-5fac-4bb2-8f89-8ca2fcc32a55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:40.917494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ed64d14-5fac-4bb2-8f89-8ca2fcc32a55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:40.917952 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ed64d14-5fac-4bb2-8f89-8ca2fcc32a55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:41.053291 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0ed64d14-5fac-4bb2-8f89-8ca2fcc32a55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:41.061054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0ed64d14-5fac-4bb2-8f89-8ca2fcc32a55 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.155693 Aug 04 04:42:41.061648 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 222/437] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:40 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:41.193132 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7b0d0ef3-d283-45a4-b562-5de9fdd8c001 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:41.195412 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7b0d0ef3-d283-45a4-b562-5de9fdd8c001 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:41.202858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b0d0ef3-d283-45a4-b562-5de9fdd8c001 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:41.203313 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b0d0ef3-d283-45a4-b562-5de9fdd8c001 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:41.204089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b0d0ef3-d283-45a4-b562-5de9fdd8c001 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:41.204525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b0d0ef3-d283-45a4-b562-5de9fdd8c001 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:41.238941 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7b0d0ef3-d283-45a4-b562-5de9fdd8c001 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050292 Aug 04 04:42:41.239515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 216/438] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:42:41 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:41.358085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-345cf034-0c89-4b09-af86-0e416af86b76 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:41.358772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-345cf034-0c89-4b09-af86-0e416af86b76 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:41.366469 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-345cf034-0c89-4b09-af86-0e416af86b76 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:41.366927 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-345cf034-0c89-4b09-af86-0e416af86b76 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:41.367712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-345cf034-0c89-4b09-af86-0e416af86b76 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:41.368151 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-345cf034-0c89-4b09-af86-0e416af86b76 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:41.389171 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:41.624821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-345cf034-0c89-4b09-af86-0e416af86b76 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:41.633888 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-345cf034-0c89-4b09-af86-0e416af86b76 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1515 microversion: 2.1 time: 0.279552 Aug 04 04:42:41.634472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 223/439] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:41 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1515 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:42.016484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-276c59fd-707a-409c-a0cf-edc260b506a8 req-4d034a01-b07f-4b17-bc65-44c8d7565080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f6da3e-0628-438b-860b-97947b44ee7f", "name": "network-vif-deleted", "tag": "e5c5de47-a2a2-4d9b-8e39-1716334e8a05"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:42.027250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-276c59fd-707a-409c-a0cf-edc260b506a8 req-4d034a01-b07f-4b17-bc65-44c8d7565080 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.027698 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-276c59fd-707a-409c-a0cf-edc260b506a8 req-4d034a01-b07f-4b17-bc65-44c8d7565080 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.041352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-276c59fd-707a-409c-a0cf-edc260b506a8 req-4d034a01-b07f-4b17-bc65-44c8d7565080 service nova] Creating event network-vif-deleted:e5c5de47-a2a2-4d9b-8e39-1716334e8a05 for instance 58f6da3e-0628-438b-860b-97947b44ee7f on hv-cinder-85127 Aug 04 04:42:42.046499 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-276c59fd-707a-409c-a0cf-edc260b506a8 req-4d034a01-b07f-4b17-bc65-44c8d7565080 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033854 Aug 04 04:42:42.052767 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 217/440] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:42.084454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-33597830-c2c3-4cc4-b541-d3f18ed6a1fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:42.085070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-33597830-c2c3-4cc4-b541-d3f18ed6a1fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:42.093263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-33597830-c2c3-4cc4-b541-d3f18ed6a1fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.093846 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-33597830-c2c3-4cc4-b541-d3f18ed6a1fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.094730 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-33597830-c2c3-4cc4-b541-d3f18ed6a1fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.095237 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-33597830-c2c3-4cc4-b541-d3f18ed6a1fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.245646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-33597830-c2c3-4cc4-b541-d3f18ed6a1fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:42.251544 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-faee3907-7f92-4231-9809-3a58d1ceafb0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:42.254254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-33597830-c2c3-4cc4-b541-d3f18ed6a1fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.173805 Aug 04 04:42:42.254602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-faee3907-7f92-4231-9809-3a58d1ceafb0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:42.255500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 224/441] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:42 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:42.261655 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-faee3907-7f92-4231-9809-3a58d1ceafb0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.262105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-faee3907-7f92-4231-9809-3a58d1ceafb0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.262871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-faee3907-7f92-4231-9809-3a58d1ceafb0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.263332 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-faee3907-7f92-4231-9809-3a58d1ceafb0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.298452 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-faee3907-7f92-4231-9809-3a58d1ceafb0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051175 Aug 04 04:42:42.299070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 218/442] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:42:42 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:42:42.363168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-39e444e1-c916-40bd-ab44-c9e5f6c1f71f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:42.363750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-39e444e1-c916-40bd-ab44-c9e5f6c1f71f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:42.371981 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39e444e1-c916-40bd-ab44-c9e5f6c1f71f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.372732 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39e444e1-c916-40bd-ab44-c9e5f6c1f71f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.373809 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39e444e1-c916-40bd-ab44-c9e5f6c1f71f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.374246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39e444e1-c916-40bd-ab44-c9e5f6c1f71f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.406619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-39e444e1-c916-40bd-ab44-c9e5f6c1f71f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Going to try to terminate instance {{(pid=134884) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:42:42.498130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-39e444e1-c916-40bd-ab44-c9e5f6c1f71f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 204 len: 0 microversion: 2.1 time: 0.139440 Aug 04 04:42:42.501722 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 225/443] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:42:42 2022] DELETE /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:42:42.511980 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d69165d2-6692-492e-8076-fdfafd7df599 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:42.512609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d69165d2-6692-492e-8076-fdfafd7df599 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:42.518792 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d69165d2-6692-492e-8076-fdfafd7df599 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.519315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d69165d2-6692-492e-8076-fdfafd7df599 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.520241 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d69165d2-6692-492e-8076-fdfafd7df599 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.520735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d69165d2-6692-492e-8076-fdfafd7df599 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.657177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-339a5fea-f358-4c64-92d6-92c0c89f8d8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:42.657924 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-339a5fea-f358-4c64-92d6-92c0c89f8d8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:42.664261 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-339a5fea-f358-4c64-92d6-92c0c89f8d8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.664719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-339a5fea-f358-4c64-92d6-92c0c89f8d8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.665505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-339a5fea-f358-4c64-92d6-92c0c89f8d8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.666225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-339a5fea-f358-4c64-92d6-92c0c89f8d8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.667624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d69165d2-6692-492e-8076-fdfafd7df599 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:42.677161 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d69165d2-6692-492e-8076-fdfafd7df599 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1682 microversion: 2.1 time: 0.170643 Aug 04 04:42:42.677775 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 219/444] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:42 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:42.701862 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-339a5fea-f358-4c64-92d6-92c0c89f8d8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:42.702307 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-339a5fea-f358-4c64-92d6-92c0c89f8d8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:42.702765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.objects.instance [None req-339a5fea-f358-4c64-92d6-92c0c89f8d8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lazy-loading 'fault' on Instance uuid 58f6da3e-0628-438b-860b-97947b44ee7f {{(pid=134884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:42:42.746780 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-339a5fea-f358-4c64-92d6-92c0c89f8d8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:42.755213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-339a5fea-f358-4c64-92d6-92c0c89f8d8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1309 microversion: 2.1 time: 0.102318 Aug 04 04:42:42.755932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 226/445] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:42 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:43.276576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7030b64b-76df-488c-8f5d-18aeba934bba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:43.277190 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7030b64b-76df-488c-8f5d-18aeba934bba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:43.284010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7030b64b-76df-488c-8f5d-18aeba934bba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.284463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7030b64b-76df-488c-8f5d-18aeba934bba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.285317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7030b64b-76df-488c-8f5d-18aeba934bba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.285837 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7030b64b-76df-488c-8f5d-18aeba934bba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.428822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7030b64b-76df-488c-8f5d-18aeba934bba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:43.436246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7030b64b-76df-488c-8f5d-18aeba934bba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.163725 Aug 04 04:42:43.436807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 220/446] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:43 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:43.700204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dcbd33eb-4456-4b06-af29-e79e3f743cc5 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:43.700817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dcbd33eb-4456-4b06-af29-e79e3f743cc5 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:43.707680 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dcbd33eb-4456-4b06-af29-e79e3f743cc5 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.708129 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dcbd33eb-4456-4b06-af29-e79e3f743cc5 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.708899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dcbd33eb-4456-4b06-af29-e79e3f743cc5 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.709332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dcbd33eb-4456-4b06-af29-e79e3f743cc5 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.776597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6295d5c4-8e4f-46fe-8959-bbf299e6ef4a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:43.777114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6295d5c4-8e4f-46fe-8959-bbf299e6ef4a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:43.783118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6295d5c4-8e4f-46fe-8959-bbf299e6ef4a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.784283 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6295d5c4-8e4f-46fe-8959-bbf299e6ef4a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.785185 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6295d5c4-8e4f-46fe-8959-bbf299e6ef4a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.785652 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6295d5c4-8e4f-46fe-8959-bbf299e6ef4a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.819742 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6295d5c4-8e4f-46fe-8959-bbf299e6ef4a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:43.820192 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6295d5c4-8e4f-46fe-8959-bbf299e6ef4a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:43.820661 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-6295d5c4-8e4f-46fe-8959-bbf299e6ef4a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lazy-loading 'fault' on Instance uuid 58f6da3e-0628-438b-860b-97947b44ee7f {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:42:43.861429 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-dcbd33eb-4456-4b06-af29-e79e3f743cc5 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:43.869199 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dcbd33eb-4456-4b06-af29-e79e3f743cc5 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1682 microversion: 2.1 time: 0.172731 Aug 04 04:42:43.869800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 227/447] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:43 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:43.878013 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6295d5c4-8e4f-46fe-8959-bbf299e6ef4a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:43.886041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6295d5c4-8e4f-46fe-8959-bbf299e6ef4a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 200 len: 1309 microversion: 2.1 time: 0.113364 Aug 04 04:42:43.886659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 221/448] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:43 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:44.459255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5fd597b5-00af-4d42-a158-1f65fbaf6ac2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:44.459786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5fd597b5-00af-4d42-a158-1f65fbaf6ac2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:44.466289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5fd597b5-00af-4d42-a158-1f65fbaf6ac2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:44.466748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5fd597b5-00af-4d42-a158-1f65fbaf6ac2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:44.467517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5fd597b5-00af-4d42-a158-1f65fbaf6ac2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:44.467954 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5fd597b5-00af-4d42-a158-1f65fbaf6ac2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:44.688163 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5fd597b5-00af-4d42-a158-1f65fbaf6ac2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:44.697964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5fd597b5-00af-4d42-a158-1f65fbaf6ac2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.243411 Aug 04 04:42:44.698720 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 228/449] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:44 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:44.890931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b317e3ca-ec38-46ec-8dd0-0b8b72ecc85b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:44.891545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b317e3ca-ec38-46ec-8dd0-0b8b72ecc85b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:44.898472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b317e3ca-ec38-46ec-8dd0-0b8b72ecc85b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:44.898926 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b317e3ca-ec38-46ec-8dd0-0b8b72ecc85b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:44.899718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b317e3ca-ec38-46ec-8dd0-0b8b72ecc85b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:44.900144 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b317e3ca-ec38-46ec-8dd0-0b8b72ecc85b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:44.908336 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3e1c704f-aa17-4223-8b88-588e2d6d4d5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:44.909736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3e1c704f-aa17-4223-8b88-588e2d6d4d5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: 58f6da3e-0628-438b-860b-97947b44ee7f] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:44.916947 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3e1c704f-aa17-4223-8b88-588e2d6d4d5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:44.917381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3e1c704f-aa17-4223-8b88-588e2d6d4d5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:44.918230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3e1c704f-aa17-4223-8b88-588e2d6d4d5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:44.918640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3e1c704f-aa17-4223-8b88-588e2d6d4d5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:44.935920 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-3e1c704f-aa17-4223-8b88-588e2d6d4d5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] HTTP exception thrown: Instance 58f6da3e-0628-438b-860b-97947b44ee7f could not be found. Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3e1c704f-aa17-4223-8b88-588e2d6d4d5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Request method failure captured: Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f HTTP/1.1 Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi603_YPwdDktomD1IKGQEZcEWg2zI6N2jQzAWiqSokBLqG-ovSHwAKZGkRse_BJZpZTteXo9-82qSg1FsIF85RM8oPGnSa5OQ4e3qC2auLImFOuGSMsV_HvclMHS1HfSvdKMrWdgLnoU-gVAHDwi27WCInAq3nhR1W4VlszUBUynCvmc Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 58d8f4b47019401ab6e953bbbbd801fd Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1570130459 Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:42:44.937674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:42:44.939149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/58d8f4b47019401ab6e953bbbbd801fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/58d8f4b47019401ab6e953bbbbd801fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_58d8f4b47019401ab6e953bbbbd801fd", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/58d8f4b47019401ab6e953bbbbd801fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:42:44.939149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-VolumesSnapshotTestJSON-1570130459 Aug 04 04:42:44.939149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 58d8f4b47019401ab6e953bbbbd801fd Aug 04 04:42:44.939149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1570130459 Aug 04 04:42:44.939149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-VolumesSnapshotTestJSON-1570130459-project Aug 04 04:42:44.939149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:42:44.939149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:42:44.939149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: d604afd3c4234473ac1f2fcff2501743 Aug 04 04:42:44.939149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-VolumesSnapshotTestJSON-1570130459-project Aug 04 04:42:44.939149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 04:42:44.939149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 58f6da3e-0628-438b-860b-97947b44ee7f could not be found. Aug 04 04:42:44.939149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '58f6da3e-0628-438b-860b-97947b44ee7f'} Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f6da3e-0628-438b-860b-97947b44ee7f could not be found. Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:44.940640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f6da3e-0628-438b-860b-97947b44ee7f could not be found. Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f6da3e-0628-438b-860b-97947b44ee7f could not be found. Aug 04 04:42:44.942116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:44.943368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3e1c704f-aa17-4223-8b88-588e2d6d4d5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Returning 404 to user: Instance 58f6da3e-0628-438b-860b-97947b44ee7f could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:44.943368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3e1c704f-aa17-4223-8b88-588e2d6d4d5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f" status: 404 len: 111 microversion: 2.1 time: 0.034814 Aug 04 04:42:44.943368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 229/450] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:44 2022] GET /compute/v2.1/servers/58f6da3e-0628-438b-860b-97947b44ee7f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:42:45.176312 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b317e3ca-ec38-46ec-8dd0-0b8b72ecc85b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:45.179187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:45.186633 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b317e3ca-ec38-46ec-8dd0-0b8b72ecc85b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1682 microversion: 2.1 time: 0.299531 Aug 04 04:42:45.187306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 222/451] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:44 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1682 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:45.609762 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-999b9f2b-59fa-4b4a-9b27-08e59463be2d req-cc823ee9-8377-4af5-813f-7a9c9d57574a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66d5fe6-f2d3-45e8-a225-8d7d10522e92", "name": "network-vif-deleted", "tag": "399fc288-7263-4519-916b-0f65a42f8c19"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:45.620495 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-999b9f2b-59fa-4b4a-9b27-08e59463be2d req-cc823ee9-8377-4af5-813f-7a9c9d57574a service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:45.620929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-999b9f2b-59fa-4b4a-9b27-08e59463be2d req-cc823ee9-8377-4af5-813f-7a9c9d57574a service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:45.635028 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-999b9f2b-59fa-4b4a-9b27-08e59463be2d req-cc823ee9-8377-4af5-813f-7a9c9d57574a service nova] Creating event network-vif-deleted:399fc288-7263-4519-916b-0f65a42f8c19 for instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 on hv-cinder-85127 Aug 04 04:42:45.645335 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-999b9f2b-59fa-4b4a-9b27-08e59463be2d req-cc823ee9-8377-4af5-813f-7a9c9d57574a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038621 Aug 04 04:42:45.646397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 230/452] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:42:45.722808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-82628f6d-22bc-4b7e-8f88-c13ad1925bdf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:45.723528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-82628f6d-22bc-4b7e-8f88-c13ad1925bdf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:45.731416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-82628f6d-22bc-4b7e-8f88-c13ad1925bdf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:45.731869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-82628f6d-22bc-4b7e-8f88-c13ad1925bdf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:45.732654 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-82628f6d-22bc-4b7e-8f88-c13ad1925bdf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:45.733229 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-82628f6d-22bc-4b7e-8f88-c13ad1925bdf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:45.906256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-82628f6d-22bc-4b7e-8f88-c13ad1925bdf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:45.917482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-82628f6d-22bc-4b7e-8f88-c13ad1925bdf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.199571 Aug 04 04:42:45.918201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 223/453] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:45 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:46.209986 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-30334638-757f-4a65-93c1-20e287ab162d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:46.210879 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-30334638-757f-4a65-93c1-20e287ab162d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:46.218862 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-30334638-757f-4a65-93c1-20e287ab162d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:46.220028 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-30334638-757f-4a65-93c1-20e287ab162d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:46.221592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-30334638-757f-4a65-93c1-20e287ab162d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:46.222490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-30334638-757f-4a65-93c1-20e287ab162d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:46.298190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-30334638-757f-4a65-93c1-20e287ab162d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:46.306202 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-30334638-757f-4a65-93c1-20e287ab162d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1614 microversion: 2.1 time: 0.101489 Aug 04 04:42:46.309682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 231/454] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:46 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1614 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:46.939879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-099f866b-fc69-483a-bed6-0059687b983a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:46.941666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-099f866b-fc69-483a-bed6-0059687b983a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:46.948455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-099f866b-fc69-483a-bed6-0059687b983a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:46.948844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-099f866b-fc69-483a-bed6-0059687b983a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:46.949647 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-099f866b-fc69-483a-bed6-0059687b983a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:46.950084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-099f866b-fc69-483a-bed6-0059687b983a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:47.088848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-099f866b-fc69-483a-bed6-0059687b983a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:47.096518 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-099f866b-fc69-483a-bed6-0059687b983a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.160671 Aug 04 04:42:47.097085 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 224/455] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:46 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:47.327404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c2eda45b-6c72-4130-8790-897bef73bb2c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:47.328165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c2eda45b-6c72-4130-8790-897bef73bb2c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:47.335109 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2eda45b-6c72-4130-8790-897bef73bb2c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:47.335551 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2eda45b-6c72-4130-8790-897bef73bb2c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:47.336323 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2eda45b-6c72-4130-8790-897bef73bb2c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:47.336754 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2eda45b-6c72-4130-8790-897bef73bb2c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:47.403190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c2eda45b-6c72-4130-8790-897bef73bb2c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:47.411326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c2eda45b-6c72-4130-8790-897bef73bb2c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1327 microversion: 2.1 time: 0.087794 Aug 04 04:42:47.411892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 232/456] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:47 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1327 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:48.119270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3b2b9c1c-8305-4ca7-a397-edb77ae408f1 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:48.119974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3b2b9c1c-8305-4ca7-a397-edb77ae408f1 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:48.126474 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3b2b9c1c-8305-4ca7-a397-edb77ae408f1 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:48.127468 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3b2b9c1c-8305-4ca7-a397-edb77ae408f1 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:48.128604 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3b2b9c1c-8305-4ca7-a397-edb77ae408f1 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:48.129049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3b2b9c1c-8305-4ca7-a397-edb77ae408f1 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:48.274000 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3b2b9c1c-8305-4ca7-a397-edb77ae408f1 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:48.281848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3b2b9c1c-8305-4ca7-a397-edb77ae408f1 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.167660 Aug 04 04:42:48.282423 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 225/457] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:48 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:48.432612 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f55d7cc7-7884-417b-8004-95df2f86860a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:48.433232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f55d7cc7-7884-417b-8004-95df2f86860a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:48.442328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f55d7cc7-7884-417b-8004-95df2f86860a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:48.442971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f55d7cc7-7884-417b-8004-95df2f86860a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:48.443849 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f55d7cc7-7884-417b-8004-95df2f86860a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:48.444465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f55d7cc7-7884-417b-8004-95df2f86860a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:48.484552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f55d7cc7-7884-417b-8004-95df2f86860a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:48.484926 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f55d7cc7-7884-417b-8004-95df2f86860a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:48.485379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.objects.instance [None req-f55d7cc7-7884-417b-8004-95df2f86860a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lazy-loading 'fault' on Instance uuid b66d5fe6-f2d3-45e8-a225-8d7d10522e92 {{(pid=134884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:42:48.537740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f55d7cc7-7884-417b-8004-95df2f86860a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:48.545552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f55d7cc7-7884-417b-8004-95df2f86860a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 200 len: 1332 microversion: 2.1 time: 0.116855 Aug 04 04:42:48.553273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 233/458] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:48 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:49.305451 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2fb01465-a67f-4c5f-bb93-c8a10923ad6c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:49.306111 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2fb01465-a67f-4c5f-bb93-c8a10923ad6c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:49.313061 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2fb01465-a67f-4c5f-bb93-c8a10923ad6c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:49.313517 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2fb01465-a67f-4c5f-bb93-c8a10923ad6c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:49.314330 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2fb01465-a67f-4c5f-bb93-c8a10923ad6c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:49.314759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2fb01465-a67f-4c5f-bb93-c8a10923ad6c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:49.465563 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2fb01465-a67f-4c5f-bb93-c8a10923ad6c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:49.473700 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2fb01465-a67f-4c5f-bb93-c8a10923ad6c tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.172649 Aug 04 04:42:49.474372 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 226/459] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:49 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:49.569566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-113a08ef-6271-4a79-94bb-e95572618a51 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:49.570316 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-113a08ef-6271-4a79-94bb-e95572618a51 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:49.577947 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-113a08ef-6271-4a79-94bb-e95572618a51 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:49.578397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-113a08ef-6271-4a79-94bb-e95572618a51 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:49.579189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-113a08ef-6271-4a79-94bb-e95572618a51 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:49.579624 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-113a08ef-6271-4a79-94bb-e95572618a51 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:49.596046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-113a08ef-6271-4a79-94bb-e95572618a51 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] HTTP exception thrown: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-113a08ef-6271-4a79-94bb-e95572618a51 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Request method failure captured: Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 HTTP/1.1 Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601nPjLcmPV0vVg2FNKyAsUUje18RWIG_TxIfWC210jnaphASZrRhZyq9Y_SDchjVsQCYWSIYUoM5T9CtXKQ_J1Fh7Tjbxe-nlzSYrFMa_gd3dtSn8J6vs-YriYCapLoJ7GeQWUpW8try5lu_qo4lbCzvyB9WeIJv208TzJ5f7iZnds Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:42:49.598209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:42:49.599536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9124d19d48f44fe2a904a715e5db1223", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:42:49.599536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:42:49.599536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 04:42:49.599536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:42:49.599536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 04:42:49.599536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:42:49.599536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:42:49.599536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 49a7ce9a27734dc0a187d1b217206785 Aug 04 04:42:49.599536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 04:42:49.599536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 04:42:49.599536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 04:42:49.599536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'b66d5fe6-f2d3-45e8-a225-8d7d10522e92'} Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:42:49.600287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 04:42:49.601683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:42:49.603244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-113a08ef-6271-4a79-94bb-e95572618a51 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Returning 404 to user: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:42:49.603244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-113a08ef-6271-4a79-94bb-e95572618a51 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 404 len: 111 microversion: 2.1 time: 0.035423 Aug 04 04:42:49.603244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 234/460] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:49 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:42:49.609086 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c2b16f36-4cab-4ebe-8d4f-f0b7c8318a8b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '.version_select at 0x7fc9421d1160>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:49.633213 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c2b16f36-4cab-4ebe-8d4f-f0b7c8318a8b tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531736435" status: 202 len: 0 microversion: 2.1 time: 0.027864 Aug 04 04:42:49.634195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 227/461] 10.222.0.47 () {58 vars in 1221 bytes} [Thu Aug 4 04:42:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531736435 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:42:50.344531 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-854b1ebb-2660-449b-b38b-596128125c89 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Action: 'create', calling method: .version_select at 0x7fc94224c940>, body: {"keypair": {"name": "tempest-keypair-1287708061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxYlENxqrSDGEETblBWyxqKveL8pMkB9WIf/ZP3adUN5rOInoJ2QcUcxTLhcnkNQ8OsMLKrPAuJLQKSdRPITX6cTxjSA2zSur+1myvJJUPBRWVWz4vVqB9CuS/LbPNSyA=="}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:50.363819 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-854b1ebb-2660-449b-b38b-596128125c89 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for project 9124d19d48f44fe2a904a715e5db1223. Resources: {'key_pairs'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:42:50.368422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-854b1ebb-2660-449b-b38b-596128125c89 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for user 49a7ce9a27734dc0a187d1b217206785 and project 9124d19d48f44fe2a904a715e5db1223. Resources: {'key_pairs'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:42:50.398102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-854b1ebb-2660-449b-b38b-596128125c89 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057286 Aug 04 04:42:50.398987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 235/462] 10.222.0.47 () {60 vars in 1159 bytes} [Thu Aug 4 04:42:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:42:50.494861 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-921c0b2d-8149-42cc-8a60-e264283814d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:50.495472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-921c0b2d-8149-42cc-8a60-e264283814d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:50.506410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-921c0b2d-8149-42cc-8a60-e264283814d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:50.506867 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-921c0b2d-8149-42cc-8a60-e264283814d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:50.507715 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-921c0b2d-8149-42cc-8a60-e264283814d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:50.508154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-921c0b2d-8149-42cc-8a60-e264283814d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:50.713715 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-921c0b2d-8149-42cc-8a60-e264283814d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:50.727354 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-921c0b2d-8149-42cc-8a60-e264283814d9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.235943 Aug 04 04:42:50.731154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 228/463] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:50 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:51.754252 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f901660c-3bf5-4a1f-8955-42d0c504424e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:51.755280 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f901660c-3bf5-4a1f-8955-42d0c504424e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:51.771264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f901660c-3bf5-4a1f-8955-42d0c504424e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:51.771726 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f901660c-3bf5-4a1f-8955-42d0c504424e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:51.772518 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f901660c-3bf5-4a1f-8955-42d0c504424e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:51.772962 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f901660c-3bf5-4a1f-8955-42d0c504424e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:51.863222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-747166097", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67ecd182-cac3-46ef-97d0-ee767463d615"}], "security_groups": [{"name": "tempest-securitygroup--1253767157"}], "key_name": "tempest-keypair-1287708061", "user_data": "}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:51.871741 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:51.925315 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f901660c-3bf5-4a1f-8955-42d0c504424e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:51.933297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f901660c-3bf5-4a1f-8955-42d0c504424e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.187305 Aug 04 04:42:51.933919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 236/464] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:51 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:51.982502 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] validate_networks() for [('67ecd182-cac3-46ef-97d0-ee767463d615', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:42:52.376153 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:42:52.376580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:42:52.377638 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:42:52.378147 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:42:52.378564 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:42:52.387532 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:52.387984 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:52.388784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:52.389219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:52.406294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for project 9124d19d48f44fe2a904a715e5db1223. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:42:52.410542 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for user 49a7ce9a27734dc0a187d1b217206785 and project 9124d19d48f44fe2a904a715e5db1223. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:42:52.422129 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:42:52.425183 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:42:52.472873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7205a472-a110-4a57-9761-988dbc90e716 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614560 Aug 04 04:42:52.473516 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 229/465] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:42:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:42:52.485824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8b7c19fb-75e9-4383-9e28-8111dc57b996 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:52.487378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8b7c19fb-75e9-4383-9e28-8111dc57b996 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:52.551311 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8b7c19fb-75e9-4383-9e28-8111dc57b996 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:52.564901 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8b7c19fb-75e9-4383-9e28-8111dc57b996 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1241 microversion: 2.1 time: 0.077817 Aug 04 04:42:52.564901 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 237/466] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:52 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:52.955842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d274d913-4935-42e2-8a49-088bf970ac4f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:52.956547 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d274d913-4935-42e2-8a49-088bf970ac4f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:52.963678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d274d913-4935-42e2-8a49-088bf970ac4f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:52.964126 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d274d913-4935-42e2-8a49-088bf970ac4f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:52.964891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d274d913-4935-42e2-8a49-088bf970ac4f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:52.965329 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d274d913-4935-42e2-8a49-088bf970ac4f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:53.106346 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d274d913-4935-42e2-8a49-088bf970ac4f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:53.113927 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d274d913-4935-42e2-8a49-088bf970ac4f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1674 microversion: 2.1 time: 0.163015 Aug 04 04:42:53.114507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 230/467] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:52 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:53.491936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-88f8026b-0518-4bc9-aef0-468428ff5c3b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:53.494170 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-88f8026b-0518-4bc9-aef0-468428ff5c3b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:53.501474 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88f8026b-0518-4bc9-aef0-468428ff5c3b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:53.502449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88f8026b-0518-4bc9-aef0-468428ff5c3b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:53.503232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88f8026b-0518-4bc9-aef0-468428ff5c3b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:53.503677 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88f8026b-0518-4bc9-aef0-468428ff5c3b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:53.583106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-552e1b00-dcd4-4f59-a5b3-dcb28f73f38c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:53.583736 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-552e1b00-dcd4-4f59-a5b3-dcb28f73f38c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:53.585279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-88f8026b-0518-4bc9-aef0-468428ff5c3b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "POST /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/action" status: 202 len: 0 microversion: 2.1 time: 0.096986 Aug 04 04:42:53.586092 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 238/468] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:42:53 2022] POST /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:42:53.590394 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-552e1b00-dcd4-4f59-a5b3-dcb28f73f38c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:53.590847 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-552e1b00-dcd4-4f59-a5b3-dcb28f73f38c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:53.591622 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-552e1b00-dcd4-4f59-a5b3-dcb28f73f38c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:53.592055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-552e1b00-dcd4-4f59-a5b3-dcb28f73f38c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:53.596165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a8487bb9-95a0-41ad-a2ab-277dc6e4c2ca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:53.597256 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a8487bb9-95a0-41ad-a2ab-277dc6e4c2ca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:53.601243 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:53.606187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a8487bb9-95a0-41ad-a2ab-277dc6e4c2ca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:53.606631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a8487bb9-95a0-41ad-a2ab-277dc6e4c2ca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:53.607406 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a8487bb9-95a0-41ad-a2ab-277dc6e4c2ca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:53.607834 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a8487bb9-95a0-41ad-a2ab-277dc6e4c2ca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:53.675838 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-552e1b00-dcd4-4f59-a5b3-dcb28f73f38c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:53.683489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-552e1b00-dcd4-4f59-a5b3-dcb28f73f38c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1245 microversion: 2.1 time: 0.104886 Aug 04 04:42:53.684073 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 231/469] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:53 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:53.788165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a8487bb9-95a0-41ad-a2ab-277dc6e4c2ca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:53.797935 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a8487bb9-95a0-41ad-a2ab-277dc6e4c2ca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1748 microversion: 2.1 time: 0.207192 Aug 04 04:42:53.799288 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 239/470] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:53 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1748 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:54.136041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-78dd0cfa-d4e4-4b02-b4fe-9cd4493b4348 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:54.136784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-78dd0cfa-d4e4-4b02-b4fe-9cd4493b4348 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:54.143886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78dd0cfa-d4e4-4b02-b4fe-9cd4493b4348 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:54.144406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78dd0cfa-d4e4-4b02-b4fe-9cd4493b4348 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:54.145258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78dd0cfa-d4e4-4b02-b4fe-9cd4493b4348 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:54.145697 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78dd0cfa-d4e4-4b02-b4fe-9cd4493b4348 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:54.295800 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-78dd0cfa-d4e4-4b02-b4fe-9cd4493b4348 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:54.305337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-78dd0cfa-d4e4-4b02-b4fe-9cd4493b4348 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1651 microversion: 2.1 time: 0.172990 Aug 04 04:42:54.305979 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 232/471] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:54 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1651 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:54.326546 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-edba3d05-2a14-498e-8ad9-a0f82f0c0fe9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:54.333885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-edba3d05-2a14-498e-8ad9-a0f82f0c0fe9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:54.334366 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-edba3d05-2a14-498e-8ad9-a0f82f0c0fe9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:54.360444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-edba3d05-2a14-498e-8ad9-a0f82f0c0fe9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Going to try to start instance {{(pid=134884) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 04:42:54.365524 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:54.415251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-edba3d05-2a14-498e-8ad9-a0f82f0c0fe9 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "POST /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/action" status: 202 len: 0 microversion: 2.1 time: 0.092222 Aug 04 04:42:54.416035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 240/472] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:42:54 2022] POST /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:42:54.424929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a3995052-a0e3-4ecf-8050-9bad7bb2a5fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:54.426058 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a3995052-a0e3-4ecf-8050-9bad7bb2a5fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:54.435102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3995052-a0e3-4ecf-8050-9bad7bb2a5fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:54.435953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3995052-a0e3-4ecf-8050-9bad7bb2a5fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:54.436822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3995052-a0e3-4ecf-8050-9bad7bb2a5fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:54.437516 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3995052-a0e3-4ecf-8050-9bad7bb2a5fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:54.708365 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f585fbf9-c205-4aeb-a6ad-80da969e1d3c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:54.710116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f585fbf9-c205-4aeb-a6ad-80da969e1d3c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:54.717644 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f585fbf9-c205-4aeb-a6ad-80da969e1d3c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:54.718367 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f585fbf9-c205-4aeb-a6ad-80da969e1d3c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:54.719155 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f585fbf9-c205-4aeb-a6ad-80da969e1d3c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:54.720094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f585fbf9-c205-4aeb-a6ad-80da969e1d3c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:54.805517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f585fbf9-c205-4aeb-a6ad-80da969e1d3c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:54.816141 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f585fbf9-c205-4aeb-a6ad-80da969e1d3c tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1299 microversion: 2.1 time: 0.115471 Aug 04 04:42:54.817785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 241/473] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:54 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:54.827892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e128f4ed-15d4-4bb0-a27d-32cf05de1c85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:54.829338 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e128f4ed-15d4-4bb0-a27d-32cf05de1c85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:54.838115 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e128f4ed-15d4-4bb0-a27d-32cf05de1c85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:54.839457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e128f4ed-15d4-4bb0-a27d-32cf05de1c85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:54.840836 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e128f4ed-15d4-4bb0-a27d-32cf05de1c85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:54.841378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e128f4ed-15d4-4bb0-a27d-32cf05de1c85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:54.889523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a3995052-a0e3-4ecf-8050-9bad7bb2a5fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:54.898756 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a3995052-a0e3-4ecf-8050-9bad7bb2a5fe tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1660 microversion: 2.1 time: 0.477997 Aug 04 04:42:54.900594 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 233/474] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:54 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1660 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:55.096880 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1357471101", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "networks": [{"uuid": "353cdb9e-e4df-4c4f-9217-20285fd79507"}]}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:55.116799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e128f4ed-15d4-4bb0-a27d-32cf05de1c85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:55.132597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e128f4ed-15d4-4bb0-a27d-32cf05de1c85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1748 microversion: 2.1 time: 0.312863 Aug 04 04:42:55.133853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 242/475] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:54 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1748 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:55.162108 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] validate_networks() for [('353cdb9e-e4df-4c4f-9217-20285fd79507', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:42:55.629636 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:42:55.630154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:42:55.630678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:42:55.631091 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:42:55.631535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:42:55.641343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:55.641823 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:55.643870 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:55.644322 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:55.663095 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Getting quotas for project 58d8f4b47019401ab6e953bbbbd801fd. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:42:55.667787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Getting quotas for user d604afd3c4234473ac1f2fcff2501743 and project 58d8f4b47019401ab6e953bbbbd801fd. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:42:55.679755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:42:55.681913 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:42:55.732648 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-93ed738a-b5fb-4f27-93b8-38b73e1865dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640874 Aug 04 04:42:55.733535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 234/476] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:42:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:42:55.745829 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6e1b311a-d790-4e5d-8049-19919d5c7251 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:55.747680 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6e1b311a-d790-4e5d-8049-19919d5c7251 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:55.812341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6e1b311a-d790-4e5d-8049-19919d5c7251 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:55.821263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6e1b311a-d790-4e5d-8049-19919d5c7251 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1219 microversion: 2.1 time: 0.079707 Aug 04 04:42:55.822236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 243/477] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:55 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:55.837511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4201a365-f477-4d15-a5c4-e3a139ab3036 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:55.844000 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4201a365-f477-4d15-a5c4-e3a139ab3036 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:55.863103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4201a365-f477-4d15-a5c4-e3a139ab3036 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:55.866612 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4201a365-f477-4d15-a5c4-e3a139ab3036 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:55.866612 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4201a365-f477-4d15-a5c4-e3a139ab3036 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:55.867250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4201a365-f477-4d15-a5c4-e3a139ab3036 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:55.923937 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2f3127a9-aef8-44af-ab31-e69c66358cf0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:55.924961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2f3127a9-aef8-44af-ab31-e69c66358cf0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:55.933843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f3127a9-aef8-44af-ab31-e69c66358cf0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:55.934117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f3127a9-aef8-44af-ab31-e69c66358cf0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:55.935254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f3127a9-aef8-44af-ab31-e69c66358cf0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:55.935915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f3127a9-aef8-44af-ab31-e69c66358cf0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:55.958437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4201a365-f477-4d15-a5c4-e3a139ab3036 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:55.967929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4201a365-f477-4d15-a5c4-e3a139ab3036 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1299 microversion: 2.1 time: 0.133949 Aug 04 04:42:55.969296 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 235/478] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:55 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:56.117983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2f3127a9-aef8-44af-ab31-e69c66358cf0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:56.126738 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2f3127a9-aef8-44af-ab31-e69c66358cf0 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1660 microversion: 2.1 time: 0.207158 Aug 04 04:42:56.127511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 244/479] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:55 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1660 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:56.154643 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f4e29afb-90a2-48a3-a71e-6e9efe4b82dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:56.155287 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f4e29afb-90a2-48a3-a71e-6e9efe4b82dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:56.164218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f4e29afb-90a2-48a3-a71e-6e9efe4b82dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:56.166007 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f4e29afb-90a2-48a3-a71e-6e9efe4b82dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:56.168271 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f4e29afb-90a2-48a3-a71e-6e9efe4b82dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:56.169169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f4e29afb-90a2-48a3-a71e-6e9efe4b82dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:56.382752 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f4e29afb-90a2-48a3-a71e-6e9efe4b82dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:56.393829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f4e29afb-90a2-48a3-a71e-6e9efe4b82dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1753 microversion: 2.1 time: 0.243279 Aug 04 04:42:56.394413 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 236/480] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:56 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1753 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:56.850407 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a19b045b-2bf8-426b-95cc-a81ed7820b44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:56.851716 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a19b045b-2bf8-426b-95cc-a81ed7820b44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:56.858842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a19b045b-2bf8-426b-95cc-a81ed7820b44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:56.859299 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a19b045b-2bf8-426b-95cc-a81ed7820b44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:56.861223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a19b045b-2bf8-426b-95cc-a81ed7820b44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:56.862253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a19b045b-2bf8-426b-95cc-a81ed7820b44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:56.963712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a19b045b-2bf8-426b-95cc-a81ed7820b44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:56.973569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a19b045b-2bf8-426b-95cc-a81ed7820b44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1215 microversion: 2.1 time: 0.127274 Aug 04 04:42:56.974161 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 245/481] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:56 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:56.991023 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-8f9bdc98-688f-4c22-bad9-2edfcfaab867 req-abbbce17-86de-45e8-b948-efcea7817242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbf781e-8aba-4088-8d3e-037ef7c8acbd", "tag": "61ceb08c-394c-47c9-b6fd-5e32720c71f4"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:42:56.993124 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8ade15e3-6fb4-4bd1-bc48-6952737f491e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:56.994032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8ade15e3-6fb4-4bd1-bc48-6952737f491e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:57.000880 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ade15e3-6fb4-4bd1-bc48-6952737f491e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:57.001352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ade15e3-6fb4-4bd1-bc48-6952737f491e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:57.002563 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ade15e3-6fb4-4bd1-bc48-6952737f491e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:57.003007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ade15e3-6fb4-4bd1-bc48-6952737f491e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:57.004800 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-8f9bdc98-688f-4c22-bad9-2edfcfaab867 req-abbbce17-86de-45e8-b948-efcea7817242 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:57.005346 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-8f9bdc98-688f-4c22-bad9-2edfcfaab867 req-abbbce17-86de-45e8-b948-efcea7817242 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:57.017011 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-8f9bdc98-688f-4c22-bad9-2edfcfaab867 req-abbbce17-86de-45e8-b948-efcea7817242 service nova] Creating event network-changed:61ceb08c-394c-47c9-b6fd-5e32720c71f4 for instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd on hv-cinder-85127 Aug 04 04:42:57.022630 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-8f9bdc98-688f-4c22-bad9-2edfcfaab867 req-abbbce17-86de-45e8-b948-efcea7817242 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038685 Aug 04 04:42:57.023508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 237/482] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:42:57.142784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8ade15e3-6fb4-4bd1-bc48-6952737f491e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:57.147720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-72b7c500-d4fe-4ad7-8fd5-57e4af4fa846 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:57.148450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-72b7c500-d4fe-4ad7-8fd5-57e4af4fa846 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:57.162913 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8ade15e3-6fb4-4bd1-bc48-6952737f491e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1367 microversion: 2.1 time: 0.163147 Aug 04 04:42:57.162913 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 246/483] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:56 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:57.163266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72b7c500-d4fe-4ad7-8fd5-57e4af4fa846 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:57.163266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72b7c500-d4fe-4ad7-8fd5-57e4af4fa846 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:57.163266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72b7c500-d4fe-4ad7-8fd5-57e4af4fa846 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:57.163266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72b7c500-d4fe-4ad7-8fd5-57e4af4fa846 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:57.301795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-72b7c500-d4fe-4ad7-8fd5-57e4af4fa846 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:57.312426 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-72b7c500-d4fe-4ad7-8fd5-57e4af4fa846 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1664 microversion: 2.1 time: 0.168590 Aug 04 04:42:57.313190 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 238/484] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:57 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:57.417564 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cbdcc480-4a71-4bbc-a485-40c328f7aa6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:57.418368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cbdcc480-4a71-4bbc-a485-40c328f7aa6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:57.424753 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cbdcc480-4a71-4bbc-a485-40c328f7aa6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:57.425207 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cbdcc480-4a71-4bbc-a485-40c328f7aa6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:57.426024 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cbdcc480-4a71-4bbc-a485-40c328f7aa6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:57.426460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cbdcc480-4a71-4bbc-a485-40c328f7aa6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:57.587637 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-cbdcc480-4a71-4bbc-a485-40c328f7aa6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:57.596451 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cbdcc480-4a71-4bbc-a485-40c328f7aa6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1753 microversion: 2.1 time: 0.183453 Aug 04 04:42:57.597011 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 247/485] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:57 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:57.995145 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6d3baa75-2f72-4475-aeaf-18f911c97820 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:57.995891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6d3baa75-2f72-4475-aeaf-18f911c97820 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:58.003459 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6d3baa75-2f72-4475-aeaf-18f911c97820 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:58.004014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6d3baa75-2f72-4475-aeaf-18f911c97820 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:58.004805 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6d3baa75-2f72-4475-aeaf-18f911c97820 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:58.005356 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6d3baa75-2f72-4475-aeaf-18f911c97820 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:58.075228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6d3baa75-2f72-4475-aeaf-18f911c97820 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:58.083796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6d3baa75-2f72-4475-aeaf-18f911c97820 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1271 microversion: 2.1 time: 0.092583 Aug 04 04:42:58.084572 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 239/486] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:57 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:58.174596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-53b0a7f3-c358-4d5c-8862-4325702a073e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:58.175499 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-53b0a7f3-c358-4d5c-8862-4325702a073e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:58.182321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53b0a7f3-c358-4d5c-8862-4325702a073e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:58.182767 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53b0a7f3-c358-4d5c-8862-4325702a073e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:58.183539 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53b0a7f3-c358-4d5c-8862-4325702a073e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:58.183972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53b0a7f3-c358-4d5c-8862-4325702a073e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:58.333064 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-53b0a7f3-c358-4d5c-8862-4325702a073e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:58.341402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-53b0a7f3-c358-4d5c-8862-4325702a073e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1367 microversion: 2.1 time: 0.171665 Aug 04 04:42:58.342025 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 248/487] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:58 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:58.620174 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-57d03163-0067-4bd7-a1d9-9f5fc4daabdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:58.620844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-57d03163-0067-4bd7-a1d9-9f5fc4daabdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:58.628623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-57d03163-0067-4bd7-a1d9-9f5fc4daabdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:58.629078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-57d03163-0067-4bd7-a1d9-9f5fc4daabdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:58.630028 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-57d03163-0067-4bd7-a1d9-9f5fc4daabdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:58.630466 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-57d03163-0067-4bd7-a1d9-9f5fc4daabdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:58.783887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-57d03163-0067-4bd7-a1d9-9f5fc4daabdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:58.792576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-57d03163-0067-4bd7-a1d9-9f5fc4daabdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1753 microversion: 2.1 time: 0.176528 Aug 04 04:42:58.793170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 240/488] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:58 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:59.107039 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cf3a7890-2056-4697-96f9-ed15721d2e29 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:59.107676 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cf3a7890-2056-4697-96f9-ed15721d2e29 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:59.115123 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cf3a7890-2056-4697-96f9-ed15721d2e29 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:59.115862 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cf3a7890-2056-4697-96f9-ed15721d2e29 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:59.116827 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cf3a7890-2056-4697-96f9-ed15721d2e29 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:59.117437 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cf3a7890-2056-4697-96f9-ed15721d2e29 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:59.184237 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-cf3a7890-2056-4697-96f9-ed15721d2e29 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:59.205751 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cf3a7890-2056-4697-96f9-ed15721d2e29 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1277 microversion: 2.1 time: 0.102479 Aug 04 04:42:59.213079 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 249/489] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:59 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:42:59.363872 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cd245360-7cd0-4309-9f53-433910aad2f6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:59.364748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cd245360-7cd0-4309-9f53-433910aad2f6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:59.371860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd245360-7cd0-4309-9f53-433910aad2f6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:59.372301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd245360-7cd0-4309-9f53-433910aad2f6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:59.373073 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd245360-7cd0-4309-9f53-433910aad2f6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:59.373728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd245360-7cd0-4309-9f53-433910aad2f6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:59.537239 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-cd245360-7cd0-4309-9f53-433910aad2f6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:59.545694 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cd245360-7cd0-4309-9f53-433910aad2f6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1367 microversion: 2.1 time: 0.185828 Aug 04 04:42:59.546279 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 241/490] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:59 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:42:59.815587 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d74f4b9c-7fe2-464b-ad32-4e0554893a62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:42:59.816748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d74f4b9c-7fe2-464b-ad32-4e0554893a62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:42:59.827054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d74f4b9c-7fe2-464b-ad32-4e0554893a62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:59.828040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d74f4b9c-7fe2-464b-ad32-4e0554893a62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:59.828989 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d74f4b9c-7fe2-464b-ad32-4e0554893a62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:42:59.830029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d74f4b9c-7fe2-464b-ad32-4e0554893a62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:42:59.985459 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d74f4b9c-7fe2-464b-ad32-4e0554893a62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:42:59.998106 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d74f4b9c-7fe2-464b-ad32-4e0554893a62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1753 microversion: 2.1 time: 0.188099 Aug 04 04:42:59.998692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 250/491] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:42:59 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:00.226586 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dc36087d-cdd8-4b97-96b4-20d48e3d855a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:00.227340 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dc36087d-cdd8-4b97-96b4-20d48e3d855a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:00.234228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc36087d-cdd8-4b97-96b4-20d48e3d855a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:00.234764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc36087d-cdd8-4b97-96b4-20d48e3d855a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:00.235645 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc36087d-cdd8-4b97-96b4-20d48e3d855a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:00.236619 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc36087d-cdd8-4b97-96b4-20d48e3d855a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:00.254261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:00.384071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dc36087d-cdd8-4b97-96b4-20d48e3d855a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:00.391572 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dc36087d-cdd8-4b97-96b4-20d48e3d855a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1319 microversion: 2.1 time: 0.168758 Aug 04 04:43:00.392666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 242/492] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:00 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:00.567847 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d085ce00-9667-4d7b-bb8d-2d8a40deadcc tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:00.568475 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d085ce00-9667-4d7b-bb8d-2d8a40deadcc tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:00.575018 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d085ce00-9667-4d7b-bb8d-2d8a40deadcc tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:00.575475 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d085ce00-9667-4d7b-bb8d-2d8a40deadcc tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:00.576356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d085ce00-9667-4d7b-bb8d-2d8a40deadcc tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:00.576797 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d085ce00-9667-4d7b-bb8d-2d8a40deadcc tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:00.730202 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d085ce00-9667-4d7b-bb8d-2d8a40deadcc tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:00.738810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d085ce00-9667-4d7b-bb8d-2d8a40deadcc tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1367 microversion: 2.1 time: 0.175318 Aug 04 04:43:00.739395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 251/493] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:00 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:00.788182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-e17fe22a-8508-4794-9f6e-81fef4487c2e req-76b13ab1-1aed-4734-b24c-9044007aeeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf81135-dc56-4991-b7a5-0ed62f3fc2a6", "tag": "a814e481-ae95-4c87-b59d-c2f124c91e2b"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:00.801106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-e17fe22a-8508-4794-9f6e-81fef4487c2e req-76b13ab1-1aed-4734-b24c-9044007aeeb3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:00.801763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-e17fe22a-8508-4794-9f6e-81fef4487c2e req-76b13ab1-1aed-4734-b24c-9044007aeeb3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:00.815530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-e17fe22a-8508-4794-9f6e-81fef4487c2e req-76b13ab1-1aed-4734-b24c-9044007aeeb3 service nova] Creating event network-changed:a814e481-ae95-4c87-b59d-c2f124c91e2b for instance dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 on hv-cinder-85127 Aug 04 04:43:00.820967 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-e17fe22a-8508-4794-9f6e-81fef4487c2e req-76b13ab1-1aed-4734-b24c-9044007aeeb3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036374 Aug 04 04:43:00.821897 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 243/494] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:01.031644 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8509b6c2-2aa1-4c36-b657-20d92ecabcfe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:01.032285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8509b6c2-2aa1-4c36-b657-20d92ecabcfe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:01.050501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8509b6c2-2aa1-4c36-b657-20d92ecabcfe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:01.050962 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8509b6c2-2aa1-4c36-b657-20d92ecabcfe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.051747 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8509b6c2-2aa1-4c36-b657-20d92ecabcfe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:01.052435 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8509b6c2-2aa1-4c36-b657-20d92ecabcfe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.220185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8509b6c2-2aa1-4c36-b657-20d92ecabcfe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:01.231468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8509b6c2-2aa1-4c36-b657-20d92ecabcfe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1753 microversion: 2.1 time: 0.214764 Aug 04 04:43:01.233579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 252/495] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:01 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1753 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:01.416059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-27f520c2-f904-45ef-ba7a-93487c760fc3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:01.416763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-27f520c2-f904-45ef-ba7a-93487c760fc3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:01.423705 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27f520c2-f904-45ef-ba7a-93487c760fc3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:01.424155 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27f520c2-f904-45ef-ba7a-93487c760fc3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.426185 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27f520c2-f904-45ef-ba7a-93487c760fc3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:01.426185 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27f520c2-f904-45ef-ba7a-93487c760fc3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.581998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-27f520c2-f904-45ef-ba7a-93487c760fc3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:01.592598 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-27f520c2-f904-45ef-ba7a-93487c760fc3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1319 microversion: 2.1 time: 0.181451 Aug 04 04:43:01.593361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 244/496] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:01 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:01.760037 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5f22f78b-df61-4646-bd5e-ee57ae7cbbb1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:01.760636 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5f22f78b-df61-4646-bd5e-ee57ae7cbbb1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:01.768869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f22f78b-df61-4646-bd5e-ee57ae7cbbb1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:01.769339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f22f78b-df61-4646-bd5e-ee57ae7cbbb1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.770206 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f22f78b-df61-4646-bd5e-ee57ae7cbbb1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:01.770605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f22f78b-df61-4646-bd5e-ee57ae7cbbb1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:01.915206 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5f22f78b-df61-4646-bd5e-ee57ae7cbbb1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:01.925661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5f22f78b-df61-4646-bd5e-ee57ae7cbbb1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1367 microversion: 2.1 time: 0.169267 Aug 04 04:43:01.926546 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 253/497] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:01 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:02.256378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-985a4b25-c866-44d4-8e40-ba45ffbc5c52 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:02.257027 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-985a4b25-c866-44d4-8e40-ba45ffbc5c52 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:02.263200 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-985a4b25-c866-44d4-8e40-ba45ffbc5c52 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:02.263668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-985a4b25-c866-44d4-8e40-ba45ffbc5c52 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:02.264438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-985a4b25-c866-44d4-8e40-ba45ffbc5c52 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:02.264869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-985a4b25-c866-44d4-8e40-ba45ffbc5c52 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:02.422775 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-985a4b25-c866-44d4-8e40-ba45ffbc5c52 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:02.432388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-985a4b25-c866-44d4-8e40-ba45ffbc5c52 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1753 microversion: 2.1 time: 0.181657 Aug 04 04:43:02.433364 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 245/498] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:02 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:02.614560 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-890568f3-6cac-4afc-bdfe-d45ca0f4703b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:02.615183 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-890568f3-6cac-4afc-bdfe-d45ca0f4703b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:02.621577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-890568f3-6cac-4afc-bdfe-d45ca0f4703b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:02.622040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-890568f3-6cac-4afc-bdfe-d45ca0f4703b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:02.623037 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-890568f3-6cac-4afc-bdfe-d45ca0f4703b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:02.623475 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-890568f3-6cac-4afc-bdfe-d45ca0f4703b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:02.765283 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-890568f3-6cac-4afc-bdfe-d45ca0f4703b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:02.774991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-890568f3-6cac-4afc-bdfe-d45ca0f4703b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1319 microversion: 2.1 time: 0.164757 Aug 04 04:43:02.775560 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 254/499] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:02 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:02.946940 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a7e53735-5468-4291-8d44-4fc0b30b283d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:02.947599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a7e53735-5468-4291-8d44-4fc0b30b283d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:02.954070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a7e53735-5468-4291-8d44-4fc0b30b283d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:02.955618 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a7e53735-5468-4291-8d44-4fc0b30b283d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:02.956490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a7e53735-5468-4291-8d44-4fc0b30b283d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:02.956927 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a7e53735-5468-4291-8d44-4fc0b30b283d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.095203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a7e53735-5468-4291-8d44-4fc0b30b283d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:03.103708 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a7e53735-5468-4291-8d44-4fc0b30b283d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1367 microversion: 2.1 time: 0.160660 Aug 04 04:43:03.104637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 246/500] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:02 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:03.463858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8a946c65-7b69-4185-832c-fee5f564a450 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:03.463858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8a946c65-7b69-4185-832c-fee5f564a450 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:03.475407 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a946c65-7b69-4185-832c-fee5f564a450 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:03.476070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a946c65-7b69-4185-832c-fee5f564a450 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.476999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a946c65-7b69-4185-832c-fee5f564a450 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:03.477527 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a946c65-7b69-4185-832c-fee5f564a450 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.686745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-d12ec2a5-3d50-4ef6-87c7-d1c28fc343ff req-de220bb8-a837-4f1e-996e-fa2baed97a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbf781e-8aba-4088-8d3e-037ef7c8acbd", "name": "network-vif-plugged", "status": "completed", "tag": "61ceb08c-394c-47c9-b6fd-5e32720c71f4"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:03.692706 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8a946c65-7b69-4185-832c-fee5f564a450 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:03.705378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8a946c65-7b69-4185-832c-fee5f564a450 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1753 microversion: 2.1 time: 0.252752 Aug 04 04:43:03.706442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 255/501] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:03 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1753 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:03.709899 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-d12ec2a5-3d50-4ef6-87c7-d1c28fc343ff req-de220bb8-a837-4f1e-996e-fa2baed97a3b service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:03.710671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-d12ec2a5-3d50-4ef6-87c7-d1c28fc343ff req-de220bb8-a837-4f1e-996e-fa2baed97a3b service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.731350 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-d12ec2a5-3d50-4ef6-87c7-d1c28fc343ff req-de220bb8-a837-4f1e-996e-fa2baed97a3b service nova] Creating event network-vif-plugged:61ceb08c-394c-47c9-b6fd-5e32720c71f4 for instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd on hv-cinder-85127 Aug 04 04:43:03.739897 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-d12ec2a5-3d50-4ef6-87c7-d1c28fc343ff req-de220bb8-a837-4f1e-996e-fa2baed97a3b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059965 Aug 04 04:43:03.740523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 247/502] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:03.797765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1af9467d-cd32-4f9d-b42e-99f737d7a2fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:03.798970 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1af9467d-cd32-4f9d-b42e-99f737d7a2fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:03.806899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1af9467d-cd32-4f9d-b42e-99f737d7a2fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:03.807639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1af9467d-cd32-4f9d-b42e-99f737d7a2fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.809200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1af9467d-cd32-4f9d-b42e-99f737d7a2fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:03.810093 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1af9467d-cd32-4f9d-b42e-99f737d7a2fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:03.981606 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1af9467d-cd32-4f9d-b42e-99f737d7a2fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:03.989855 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1af9467d-cd32-4f9d-b42e-99f737d7a2fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1319 microversion: 2.1 time: 0.195919 Aug 04 04:43:03.990542 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 256/503] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:03 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:04.133209 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-433d0b82-8b57-457a-b863-fc5854efbd56 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:04.134627 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-433d0b82-8b57-457a-b863-fc5854efbd56 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:04.142099 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-433d0b82-8b57-457a-b863-fc5854efbd56 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:04.142550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-433d0b82-8b57-457a-b863-fc5854efbd56 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:04.143488 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-433d0b82-8b57-457a-b863-fc5854efbd56 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:04.143955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-433d0b82-8b57-457a-b863-fc5854efbd56 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:04.307542 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-433d0b82-8b57-457a-b863-fc5854efbd56 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:04.317992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-433d0b82-8b57-457a-b863-fc5854efbd56 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1367 microversion: 2.1 time: 0.189906 Aug 04 04:43:04.318568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 248/504] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:04 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:04.729937 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4f95a613-ca4f-46f3-8757-12b475ae3b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:04.730665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4f95a613-ca4f-46f3-8757-12b475ae3b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:04.737003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4f95a613-ca4f-46f3-8757-12b475ae3b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:04.737449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4f95a613-ca4f-46f3-8757-12b475ae3b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:04.738243 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4f95a613-ca4f-46f3-8757-12b475ae3b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:04.738670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4f95a613-ca4f-46f3-8757-12b475ae3b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:04.757597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:04.899890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4f95a613-ca4f-46f3-8757-12b475ae3b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:04.908140 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4f95a613-ca4f-46f3-8757-12b475ae3b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1753 microversion: 2.1 time: 0.182025 Aug 04 04:43:04.908709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 257/505] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:04 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:05.011275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0f479ee5-4622-4a9d-a7f4-b0795e50efc6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:05.011900 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0f479ee5-4622-4a9d-a7f4-b0795e50efc6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:05.018674 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0f479ee5-4622-4a9d-a7f4-b0795e50efc6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:05.019131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0f479ee5-4622-4a9d-a7f4-b0795e50efc6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:05.019910 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0f479ee5-4622-4a9d-a7f4-b0795e50efc6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:05.020350 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0f479ee5-4622-4a9d-a7f4-b0795e50efc6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:05.180029 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0f479ee5-4622-4a9d-a7f4-b0795e50efc6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:05.187948 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0f479ee5-4622-4a9d-a7f4-b0795e50efc6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1319 microversion: 2.1 time: 0.180592 Aug 04 04:43:05.189575 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 249/506] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:05 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:05.342127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-31803aed-a2de-41e4-bd2a-2d18ba367a35 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:05.342867 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-31803aed-a2de-41e4-bd2a-2d18ba367a35 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:05.350900 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-31803aed-a2de-41e4-bd2a-2d18ba367a35 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:05.357225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-31803aed-a2de-41e4-bd2a-2d18ba367a35 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:05.359270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-31803aed-a2de-41e4-bd2a-2d18ba367a35 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:05.359737 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-31803aed-a2de-41e4-bd2a-2d18ba367a35 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:05.550496 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-31803aed-a2de-41e4-bd2a-2d18ba367a35 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:05.566028 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-31803aed-a2de-41e4-bd2a-2d18ba367a35 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1367 microversion: 2.1 time: 0.229952 Aug 04 04:43:05.567003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 258/507] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:05 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:05.763591 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-61056d92-b2fb-44dd-af16-a9cbd357c7e8 req-24202eb1-fe8b-41e1-9ccd-38670e580f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf81135-dc56-4991-b7a5-0ed62f3fc2a6", "name": "network-vif-plugged", "status": "completed", "tag": "a814e481-ae95-4c87-b59d-c2f124c91e2b"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:05.769625 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=4 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:05.770395 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=12 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:05.777111 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-61056d92-b2fb-44dd-af16-a9cbd357c7e8 req-24202eb1-fe8b-41e1-9ccd-38670e580f1d service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:05.777741 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-61056d92-b2fb-44dd-af16-a9cbd357c7e8 req-24202eb1-fe8b-41e1-9ccd-38670e580f1d service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:05.790088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-61056d92-b2fb-44dd-af16-a9cbd357c7e8 req-24202eb1-fe8b-41e1-9ccd-38670e580f1d service nova] Creating event network-vif-plugged:a814e481-ae95-4c87-b59d-c2f124c91e2b for instance dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 on hv-cinder-85127 Aug 04 04:43:05.795517 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-61056d92-b2fb-44dd-af16-a9cbd357c7e8 req-24202eb1-fe8b-41e1-9ccd-38670e580f1d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035915 Aug 04 04:43:05.796071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 250/508] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:05.930331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cc20e9f5-3e29-4d08-a83b-7d68eec836d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:05.931113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cc20e9f5-3e29-4d08-a83b-7d68eec836d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:05.933487 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=8 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:05.939881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cc20e9f5-3e29-4d08-a83b-7d68eec836d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:05.940330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cc20e9f5-3e29-4d08-a83b-7d68eec836d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:05.941146 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cc20e9f5-3e29-4d08-a83b-7d68eec836d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:05.941735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cc20e9f5-3e29-4d08-a83b-7d68eec836d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:06.114526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-cc20e9f5-3e29-4d08-a83b-7d68eec836d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:06.122819 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cc20e9f5-3e29-4d08-a83b-7d68eec836d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1753 microversion: 2.1 time: 0.196369 Aug 04 04:43:06.123394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 259/509] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:05 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1753 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:06.212747 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-aed79200-19d3-4c31-8940-ffdb83392873 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:06.213756 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-aed79200-19d3-4c31-8940-ffdb83392873 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:06.221173 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aed79200-19d3-4c31-8940-ffdb83392873 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:06.221993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aed79200-19d3-4c31-8940-ffdb83392873 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:06.222746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aed79200-19d3-4c31-8940-ffdb83392873 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:06.223325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aed79200-19d3-4c31-8940-ffdb83392873 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:06.374105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-aed79200-19d3-4c31-8940-ffdb83392873 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:06.382806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-aed79200-19d3-4c31-8940-ffdb83392873 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1319 microversion: 2.1 time: 0.175406 Aug 04 04:43:06.383409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 251/510] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:06 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:06.590386 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-af9f477f-b049-4b9c-b250-83127a00770d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:06.590916 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-af9f477f-b049-4b9c-b250-83127a00770d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:06.597887 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af9f477f-b049-4b9c-b250-83127a00770d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:06.598334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af9f477f-b049-4b9c-b250-83127a00770d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:06.599094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af9f477f-b049-4b9c-b250-83127a00770d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:06.599569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af9f477f-b049-4b9c-b250-83127a00770d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:06.732554 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-af9f477f-b049-4b9c-b250-83127a00770d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:06.740732 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-af9f477f-b049-4b9c-b250-83127a00770d tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1558 microversion: 2.1 time: 0.154433 Aug 04 04:43:06.741325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 260/511] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:06 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:06.765760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4449a3f9-2411-4bee-a450-60f66beda5ae tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:06.766343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4449a3f9-2411-4bee-a450-60f66beda5ae tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:06.773217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4449a3f9-2411-4bee-a450-60f66beda5ae tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:06.773711 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4449a3f9-2411-4bee-a450-60f66beda5ae tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:06.774491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4449a3f9-2411-4bee-a450-60f66beda5ae tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:06.774934 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4449a3f9-2411-4bee-a450-60f66beda5ae tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:06.858098 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4449a3f9-2411-4bee-a450-60f66beda5ae tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096216 Aug 04 04:43:06.858687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 252/512] 10.222.0.47 () {58 vars in 1275 bytes} [Thu Aug 4 04:43:06 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:07.147134 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-58615417-42c6-4efb-aae2-7ff168a36370 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:07.147668 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-58615417-42c6-4efb-aae2-7ff168a36370 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:07.154550 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-58615417-42c6-4efb-aae2-7ff168a36370 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:07.155004 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-58615417-42c6-4efb-aae2-7ff168a36370 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:07.155845 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-58615417-42c6-4efb-aae2-7ff168a36370 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:07.156285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-58615417-42c6-4efb-aae2-7ff168a36370 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:07.405128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-78bfb67a-b039-4427-98c9-07aaa1ceabeb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:07.405916 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-78bfb67a-b039-4427-98c9-07aaa1ceabeb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:07.412805 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78bfb67a-b039-4427-98c9-07aaa1ceabeb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:07.413259 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78bfb67a-b039-4427-98c9-07aaa1ceabeb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:07.414072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78bfb67a-b039-4427-98c9-07aaa1ceabeb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:07.414515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78bfb67a-b039-4427-98c9-07aaa1ceabeb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:07.460024 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-58615417-42c6-4efb-aae2-7ff168a36370 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:07.469287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-58615417-42c6-4efb-aae2-7ff168a36370 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1753 microversion: 2.1 time: 0.326213 Aug 04 04:43:07.470606 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 261/513] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:07 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1753 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:07.645238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-78bfb67a-b039-4427-98c9-07aaa1ceabeb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:07.652842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-78bfb67a-b039-4427-98c9-07aaa1ceabeb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1319 microversion: 2.1 time: 0.252157 Aug 04 04:43:07.653415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 253/514] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:07 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:08.013104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-db7d3e43-452b-44da-9a2d-7670d0c02908 req-9678cd36-1319-4a23-8785-4772d5fb1f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbf781e-8aba-4088-8d3e-037ef7c8acbd", "tag": "61ceb08c-394c-47c9-b6fd-5e32720c71f4"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:08.023425 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-db7d3e43-452b-44da-9a2d-7670d0c02908 req-9678cd36-1319-4a23-8785-4772d5fb1f25 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:08.023873 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-db7d3e43-452b-44da-9a2d-7670d0c02908 req-9678cd36-1319-4a23-8785-4772d5fb1f25 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:08.035410 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-db7d3e43-452b-44da-9a2d-7670d0c02908 req-9678cd36-1319-4a23-8785-4772d5fb1f25 service nova] Creating event network-changed:61ceb08c-394c-47c9-b6fd-5e32720c71f4 for instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd on hv-cinder-85127 Aug 04 04:43:08.040615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-db7d3e43-452b-44da-9a2d-7670d0c02908 req-9678cd36-1319-4a23-8785-4772d5fb1f25 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030891 Aug 04 04:43:08.041207 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 262/515] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:08.492606 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4bf9d894-d87e-4ffe-a15a-de15e95516c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:08.493293 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4bf9d894-d87e-4ffe-a15a-de15e95516c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:08.505709 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4bf9d894-d87e-4ffe-a15a-de15e95516c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:08.506161 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4bf9d894-d87e-4ffe-a15a-de15e95516c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:08.507440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4bf9d894-d87e-4ffe-a15a-de15e95516c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:08.508116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4bf9d894-d87e-4ffe-a15a-de15e95516c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:08.676999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c9455219-b011-4b7a-bd53-a1993a12bee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:08.678501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c9455219-b011-4b7a-bd53-a1993a12bee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:08.686131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c9455219-b011-4b7a-bd53-a1993a12bee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:08.686967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c9455219-b011-4b7a-bd53-a1993a12bee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:08.687999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c9455219-b011-4b7a-bd53-a1993a12bee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:08.688735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c9455219-b011-4b7a-bd53-a1993a12bee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:08.696430 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4bf9d894-d87e-4ffe-a15a-de15e95516c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:08.705877 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4bf9d894-d87e-4ffe-a15a-de15e95516c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1753 microversion: 2.1 time: 0.216865 Aug 04 04:43:08.706478 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 254/516] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1753 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:08.855148 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c9455219-b011-4b7a-bd53-a1993a12bee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:08.863850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c9455219-b011-4b7a-bd53-a1993a12bee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1508 microversion: 2.1 time: 0.192696 Aug 04 04:43:08.864884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 263/517] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:08 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:08.886550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c4fec8f4-52ca-4fe7-ba5c-0231a331125b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83f1e6f6-5caa-4592-bbab-04344788c4b6", "device": "/dev/sdb"}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:08.889004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c4fec8f4-52ca-4fe7-ba5c-0231a331125b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:08.895931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c4fec8f4-52ca-4fe7-ba5c-0231a331125b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:08.896380 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c4fec8f4-52ca-4fe7-ba5c-0231a331125b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:08.897147 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c4fec8f4-52ca-4fe7-ba5c-0231a331125b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:08.897599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c4fec8f4-52ca-4fe7-ba5c-0231a331125b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:09.159124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c4fec8f4-52ca-4fe7-ba5c-0231a331125b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "POST /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277232 Aug 04 04:43:09.160008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 255/518] 10.222.0.47 () {60 vars in 1323 bytes} [Thu Aug 4 04:43:08 2022] POST /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:09.730471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-997dd206-e24a-4db7-b533-797def866363 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:09.731119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-997dd206-e24a-4db7-b533-797def866363 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:09.738856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-997dd206-e24a-4db7-b533-797def866363 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:09.739331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-997dd206-e24a-4db7-b533-797def866363 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:09.740097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-997dd206-e24a-4db7-b533-797def866363 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:09.740535 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-997dd206-e24a-4db7-b533-797def866363 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:09.883806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-997dd206-e24a-4db7-b533-797def866363 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:09.891757 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-997dd206-e24a-4db7-b533-797def866363 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1753 microversion: 2.1 time: 0.165018 Aug 04 04:43:09.892354 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 264/519] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:09 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:10.914295 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-34139dd8-fdf7-4e1d-85ad-7e7e7aa8ab27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:10.914987 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-34139dd8-fdf7-4e1d-85ad-7e7e7aa8ab27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:10.921660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-34139dd8-fdf7-4e1d-85ad-7e7e7aa8ab27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:10.922103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-34139dd8-fdf7-4e1d-85ad-7e7e7aa8ab27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:10.923542 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-34139dd8-fdf7-4e1d-85ad-7e7e7aa8ab27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:10.924151 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-34139dd8-fdf7-4e1d-85ad-7e7e7aa8ab27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.072552 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-34139dd8-fdf7-4e1d-85ad-7e7e7aa8ab27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:11.081361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-34139dd8-fdf7-4e1d-85ad-7e7e7aa8ab27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1753 microversion: 2.1 time: 0.171889 Aug 04 04:43:11.081957 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 256/520] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:11.388656 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bfeaa13f-78e0-4558-9443-15ae97555cb2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9fe92c6-0cd5-4edd-9622-790e8befdda9"}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:11.391071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bfeaa13f-78e0-4558-9443-15ae97555cb2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:11.397867 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bfeaa13f-78e0-4558-9443-15ae97555cb2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:11.398320 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bfeaa13f-78e0-4558-9443-15ae97555cb2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.399087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bfeaa13f-78e0-4558-9443-15ae97555cb2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:11.399527 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bfeaa13f-78e0-4558-9443-15ae97555cb2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:11.999758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bfeaa13f-78e0-4558-9443-15ae97555cb2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "POST /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.614944 Aug 04 04:43:12.000472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 265/521] 10.222.0.47 () {60 vars in 1323 bytes} [Thu Aug 4 04:43:11 2022] POST /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 194 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:12.102428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-db38cd62-f3b2-4a81-963c-77d0a453f06e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:12.103071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-db38cd62-f3b2-4a81-963c-77d0a453f06e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:12.109466 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db38cd62-f3b2-4a81-963c-77d0a453f06e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:12.109959 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db38cd62-f3b2-4a81-963c-77d0a453f06e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:12.110711 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db38cd62-f3b2-4a81-963c-77d0a453f06e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:12.111141 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db38cd62-f3b2-4a81-963c-77d0a453f06e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:12.255658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-db38cd62-f3b2-4a81-963c-77d0a453f06e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:12.263592 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-db38cd62-f3b2-4a81-963c-77d0a453f06e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1756 microversion: 2.1 time: 0.165028 Aug 04 04:43:12.264153 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 257/522] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:12 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:39.107074 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=54 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:39.107843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:39.112682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-499283d4-b970-4da5-ace6-2dc1e387d575 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:39.115094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-499283d4-b970-4da5-ace6-2dc1e387d575 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:39.122673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-499283d4-b970-4da5-ace6-2dc1e387d575 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:39.123122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-499283d4-b970-4da5-ace6-2dc1e387d575 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:39.123940 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-499283d4-b970-4da5-ace6-2dc1e387d575 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:39.124397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-499283d4-b970-4da5-ace6-2dc1e387d575 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:39.154497 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-499283d4-b970-4da5-ace6-2dc1e387d575 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049011 Aug 04 04:43:39.155052 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 266/523] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:43:39 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 04:43:39.217344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ab8283d4-5b94-4f9e-9500-13185a38668d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:39.218578 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ab8283d4-5b94-4f9e-9500-13185a38668d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:39.221309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:39.222439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:39.228697 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab8283d4-5b94-4f9e-9500-13185a38668d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:39.229154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab8283d4-5b94-4f9e-9500-13185a38668d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:39.229963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab8283d4-5b94-4f9e-9500-13185a38668d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:39.230402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab8283d4-5b94-4f9e-9500-13185a38668d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:39.262437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ab8283d4-5b94-4f9e-9500-13185a38668d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Going to try to terminate instance {{(pid=134883) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:43:39.341403 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ab8283d4-5b94-4f9e-9500-13185a38668d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 204 len: 0 microversion: 2.1 time: 0.127449 Aug 04 04:43:39.341964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 258/524] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:43:39 2022] DELETE /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:43:39.351075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1d0e3ef0-66d5-454b-a6df-6ed699fa4fb3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:39.351673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1d0e3ef0-66d5-454b-a6df-6ed699fa4fb3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:39.358235 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1d0e3ef0-66d5-454b-a6df-6ed699fa4fb3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:39.359897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1d0e3ef0-66d5-454b-a6df-6ed699fa4fb3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:39.360680 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1d0e3ef0-66d5-454b-a6df-6ed699fa4fb3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:39.361122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1d0e3ef0-66d5-454b-a6df-6ed699fa4fb3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:39.502090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1d0e3ef0-66d5-454b-a6df-6ed699fa4fb3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:39.509931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1d0e3ef0-66d5-454b-a6df-6ed699fa4fb3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.162773 Aug 04 04:43:39.510681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 267/525] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:39 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:40.533092 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-31ef104d-871d-4332-9517-af38b047094d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:40.533819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-31ef104d-871d-4332-9517-af38b047094d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:40.540573 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31ef104d-871d-4332-9517-af38b047094d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:40.541020 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31ef104d-871d-4332-9517-af38b047094d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:40.541805 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31ef104d-871d-4332-9517-af38b047094d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:40.542239 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31ef104d-871d-4332-9517-af38b047094d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:40.707084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-31ef104d-871d-4332-9517-af38b047094d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:40.714531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-31ef104d-871d-4332-9517-af38b047094d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.185910 Aug 04 04:43:40.715088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 259/526] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:40 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:41.739014 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1db15d07-87b7-4986-8f03-b47abac9cd65 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:41.739665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1db15d07-87b7-4986-8f03-b47abac9cd65 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:41.746359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1db15d07-87b7-4986-8f03-b47abac9cd65 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:41.746812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1db15d07-87b7-4986-8f03-b47abac9cd65 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:41.747587 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1db15d07-87b7-4986-8f03-b47abac9cd65 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:41.748030 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1db15d07-87b7-4986-8f03-b47abac9cd65 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:41.887535 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1db15d07-87b7-4986-8f03-b47abac9cd65 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:41.895592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1db15d07-87b7-4986-8f03-b47abac9cd65 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.161090 Aug 04 04:43:41.896179 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 268/527] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:41 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:42.918373 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-35d1a867-ead1-4106-81b4-eff784bc968e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:42.918966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-35d1a867-ead1-4106-81b4-eff784bc968e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:42.926201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-35d1a867-ead1-4106-81b4-eff784bc968e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:42.926648 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-35d1a867-ead1-4106-81b4-eff784bc968e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:42.927406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-35d1a867-ead1-4106-81b4-eff784bc968e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:42.927842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-35d1a867-ead1-4106-81b4-eff784bc968e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:43.066185 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-35d1a867-ead1-4106-81b4-eff784bc968e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:43.073941 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-35d1a867-ead1-4106-81b4-eff784bc968e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.159698 Aug 04 04:43:43.074506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 260/528] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:42 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:44.095723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8de3d7ec-5a6f-4f0c-a763-20b725a4e693 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:44.096349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8de3d7ec-5a6f-4f0c-a763-20b725a4e693 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:44.103408 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8de3d7ec-5a6f-4f0c-a763-20b725a4e693 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:44.103863 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8de3d7ec-5a6f-4f0c-a763-20b725a4e693 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:44.104636 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8de3d7ec-5a6f-4f0c-a763-20b725a4e693 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:44.105079 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8de3d7ec-5a6f-4f0c-a763-20b725a4e693 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:44.240353 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8de3d7ec-5a6f-4f0c-a763-20b725a4e693 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:44.247950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8de3d7ec-5a6f-4f0c-a763-20b725a4e693 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.156621 Aug 04 04:43:44.248517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 269/529] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:44 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:45.269769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4e049b2e-2356-422d-803b-d7eb60ea8a46 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:45.270390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4e049b2e-2356-422d-803b-d7eb60ea8a46 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:45.277306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e049b2e-2356-422d-803b-d7eb60ea8a46 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:45.277791 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e049b2e-2356-422d-803b-d7eb60ea8a46 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:45.278572 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e049b2e-2356-422d-803b-d7eb60ea8a46 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:45.279010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e049b2e-2356-422d-803b-d7eb60ea8a46 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:45.429493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4e049b2e-2356-422d-803b-d7eb60ea8a46 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:45.437358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4e049b2e-2356-422d-803b-d7eb60ea8a46 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.171704 Aug 04 04:43:45.437970 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 261/530] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:45 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:43:46.459378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2d54f601-4db3-465d-ba58-78f6acd68e93 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:46.460042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2d54f601-4db3-465d-ba58-78f6acd68e93 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:46.467349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d54f601-4db3-465d-ba58-78f6acd68e93 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:46.468380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d54f601-4db3-465d-ba58-78f6acd68e93 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:46.469467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d54f601-4db3-465d-ba58-78f6acd68e93 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:46.470151 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d54f601-4db3-465d-ba58-78f6acd68e93 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:46.617159 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2d54f601-4db3-465d-ba58-78f6acd68e93 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:46.626919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2d54f601-4db3-465d-ba58-78f6acd68e93 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.171308 Aug 04 04:43:46.627498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 270/531] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:46 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:47.660341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b5ec44bb-16f0-4353-97c9-31b3b650f671 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:47.660964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b5ec44bb-16f0-4353-97c9-31b3b650f671 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:47.668191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b5ec44bb-16f0-4353-97c9-31b3b650f671 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:47.668645 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b5ec44bb-16f0-4353-97c9-31b3b650f671 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:47.669422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b5ec44bb-16f0-4353-97c9-31b3b650f671 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:47.669914 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b5ec44bb-16f0-4353-97c9-31b3b650f671 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:47.979518 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b5ec44bb-16f0-4353-97c9-31b3b650f671 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:47.987842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b5ec44bb-16f0-4353-97c9-31b3b650f671 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.331365 Aug 04 04:43:47.988422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 262/532] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:47 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:49.009654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e0d6e331-a87a-4a09-a0bf-78d5c0c42ef6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:49.010265 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e0d6e331-a87a-4a09-a0bf-78d5c0c42ef6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:49.017007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e0d6e331-a87a-4a09-a0bf-78d5c0c42ef6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:49.017446 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e0d6e331-a87a-4a09-a0bf-78d5c0c42ef6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:49.018233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e0d6e331-a87a-4a09-a0bf-78d5c0c42ef6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:49.018663 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e0d6e331-a87a-4a09-a0bf-78d5c0c42ef6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:49.211054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e0d6e331-a87a-4a09-a0bf-78d5c0c42ef6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:49.219058 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e0d6e331-a87a-4a09-a0bf-78d5c0c42ef6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.213273 Aug 04 04:43:49.219604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 271/533] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:49 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:50.240087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c562d778-a8c5-47ce-bdc2-171506f2941a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:50.240708 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c562d778-a8c5-47ce-bdc2-171506f2941a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:50.249336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c562d778-a8c5-47ce-bdc2-171506f2941a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:50.249813 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c562d778-a8c5-47ce-bdc2-171506f2941a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:50.250637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c562d778-a8c5-47ce-bdc2-171506f2941a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:50.251076 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c562d778-a8c5-47ce-bdc2-171506f2941a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:50.388776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c562d778-a8c5-47ce-bdc2-171506f2941a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:50.397464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c562d778-a8c5-47ce-bdc2-171506f2941a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.161140 Aug 04 04:43:50.398095 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 263/534] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:50 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:50.692583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b558da16-5888-4bbb-9a5d-6e5d03c026e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-587143431"}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:50.693454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b558da16-5888-4bbb-9a5d-6e5d03c026e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:50.699881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b558da16-5888-4bbb-9a5d-6e5d03c026e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:50.700326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b558da16-5888-4bbb-9a5d-6e5d03c026e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:50.701092 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b558da16-5888-4bbb-9a5d-6e5d03c026e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:50.702244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b558da16-5888-4bbb-9a5d-6e5d03c026e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:51.103855 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.network.security_group_api [None req-b558da16-5888-4bbb-9a5d-6e5d03c026e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Removing security group 829bd7b8-0f07-48b5-8ad6-57db14796fdf from port e652ee96-0575-4a05-ad13-04b1d7dbc6e7 Aug 04 04:43:51.424930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-457298f2-177b-4519-9595-dd9ad9640819 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:51.426135 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-457298f2-177b-4519-9595-dd9ad9640819 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:51.437775 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-457298f2-177b-4519-9595-dd9ad9640819 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:51.438585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-457298f2-177b-4519-9595-dd9ad9640819 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:51.440107 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-457298f2-177b-4519-9595-dd9ad9640819 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:51.440890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-457298f2-177b-4519-9595-dd9ad9640819 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:51.475723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b558da16-5888-4bbb-9a5d-6e5d03c026e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "POST /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/action" status: 202 len: 0 microversion: 2.1 time: 0.787040 Aug 04 04:43:51.479696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 272/535] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:43:50 2022] POST /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:43:51.489240 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8f77dd93-1e2b-4ecf-92dd-e8a1fd473649 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:51.494583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8f77dd93-1e2b-4ecf-92dd-e8a1fd473649 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:51.508218 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8f77dd93-1e2b-4ecf-92dd-e8a1fd473649 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:51.513001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8f77dd93-1e2b-4ecf-92dd-e8a1fd473649 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:51.514166 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8f77dd93-1e2b-4ecf-92dd-e8a1fd473649 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:51.514899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8f77dd93-1e2b-4ecf-92dd-e8a1fd473649 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:51.558725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8f77dd93-1e2b-4ecf-92dd-e8a1fd473649 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd/ips" status: 200 len: 150 microversion: 2.1 time: 0.081249 Aug 04 04:43:51.582250 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 273/536] 10.222.0.47 () {58 vars in 1248 bytes} [Thu Aug 4 04:43:51 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd/ips => generated 150 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:51.587957 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-1d3bc7f9-d03a-4ed7-a1da-70391732c521 req-f9d997fc-bf25-46fe-9bd2-24b960d881e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1762cb-4b08-41db-8302-59f56c67370a", "tag": "e652ee96-0575-4a05-ad13-04b1d7dbc6e7"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:51.628795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-1d3bc7f9-d03a-4ed7-a1da-70391732c521 req-f9d997fc-bf25-46fe-9bd2-24b960d881e1 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:51.631868 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-1d3bc7f9-d03a-4ed7-a1da-70391732c521 req-f9d997fc-bf25-46fe-9bd2-24b960d881e1 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:51.639610 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-457298f2-177b-4519-9595-dd9ad9640819 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:51.648280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-457298f2-177b-4519-9595-dd9ad9640819 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.230524 Aug 04 04:43:51.649431 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 264/537] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:51 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:51.664673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-1d3bc7f9-d03a-4ed7-a1da-70391732c521 req-f9d997fc-bf25-46fe-9bd2-24b960d881e1 service nova] Creating event network-changed:e652ee96-0575-4a05-ad13-04b1d7dbc6e7 for instance af1762cb-4b08-41db-8302-59f56c67370a on hv-cinder-85127 Aug 04 04:43:51.670929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-1d3bc7f9-d03a-4ed7-a1da-70391732c521 req-f9d997fc-bf25-46fe-9bd2-24b960d881e1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086560 Aug 04 04:43:51.672280 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 274/538] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:52.671526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-48589ff2-c6ed-4517-bed1-b51d64811596 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:52.672254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-48589ff2-c6ed-4517-bed1-b51d64811596 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:52.681776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48589ff2-c6ed-4517-bed1-b51d64811596 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:52.682556 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48589ff2-c6ed-4517-bed1-b51d64811596 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:52.683984 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48589ff2-c6ed-4517-bed1-b51d64811596 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:52.684688 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48589ff2-c6ed-4517-bed1-b51d64811596 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:52.728142 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-706449b9-6e5c-46ba-9a9c-9cfb03d479f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:52.730165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-706449b9-6e5c-46ba-9a9c-9cfb03d479f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:52.743175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-706449b9-6e5c-46ba-9a9c-9cfb03d479f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:52.744331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-706449b9-6e5c-46ba-9a9c-9cfb03d479f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:52.745792 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-706449b9-6e5c-46ba-9a9c-9cfb03d479f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:52.746592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-706449b9-6e5c-46ba-9a9c-9cfb03d479f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:52.842919 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-48589ff2-c6ed-4517-bed1-b51d64811596 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:52.857203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-48589ff2-c6ed-4517-bed1-b51d64811596 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.188970 Aug 04 04:43:52.858809 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 265/539] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:52 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:52.923776 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.objects.instance [None req-706449b9-6e5c-46ba-9a9c-9cfb03d479f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lazy-loading 'services' on Instance uuid af1762cb-4b08-41db-8302-59f56c67370a {{(pid=134884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:43:53.089380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-706449b9-6e5c-46ba-9a9c-9cfb03d479f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "DELETE /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments/294cbad6-59c9-4cdc-abda-2a60a0e77e44" status: 202 len: 0 microversion: 2.1 time: 0.370689 Aug 04 04:43:53.090180 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 275/540] 10.222.0.47 () {58 vars in 1416 bytes} [Thu Aug 4 04:43:52 2022] DELETE /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments/294cbad6-59c9-4cdc-abda-2a60a0e77e44 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:43:53.101015 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-182574ba-422e-4220-be0b-adc8a3390542 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:53.103620 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-182574ba-422e-4220-be0b-adc8a3390542 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:53.111515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-182574ba-422e-4220-be0b-adc8a3390542 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:53.112127 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-182574ba-422e-4220-be0b-adc8a3390542 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:53.113018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-182574ba-422e-4220-be0b-adc8a3390542 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:53.113695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-182574ba-422e-4220-be0b-adc8a3390542 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:53.145740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-182574ba-422e-4220-be0b-adc8a3390542 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048577 Aug 04 04:43:53.146455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 266/541] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:43:53 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:43:53.688281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-a396af48-aa41-49e5-b977-a837329e9ebe req-edebda32-f1fb-4b32-9494-f2c88202ae3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1762cb-4b08-41db-8302-59f56c67370a", "tag": "e652ee96-0575-4a05-ad13-04b1d7dbc6e7"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:43:53.698326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-a396af48-aa41-49e5-b977-a837329e9ebe req-edebda32-f1fb-4b32-9494-f2c88202ae3e service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:53.698782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-a396af48-aa41-49e5-b977-a837329e9ebe req-edebda32-f1fb-4b32-9494-f2c88202ae3e service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:53.713534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-a396af48-aa41-49e5-b977-a837329e9ebe req-edebda32-f1fb-4b32-9494-f2c88202ae3e service nova] Creating event network-changed:e652ee96-0575-4a05-ad13-04b1d7dbc6e7 for instance af1762cb-4b08-41db-8302-59f56c67370a on hv-cinder-85127 Aug 04 04:43:53.719350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-a396af48-aa41-49e5-b977-a837329e9ebe req-edebda32-f1fb-4b32-9494-f2c88202ae3e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035746 Aug 04 04:43:53.719886 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 276/542] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:53.881207 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c06b5ee7-d17a-45e4-afc7-e57d3c54bc0a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:53.882002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c06b5ee7-d17a-45e4-afc7-e57d3c54bc0a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:53.888772 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c06b5ee7-d17a-45e4-afc7-e57d3c54bc0a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:53.889902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c06b5ee7-d17a-45e4-afc7-e57d3c54bc0a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:53.890804 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c06b5ee7-d17a-45e4-afc7-e57d3c54bc0a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:53.891143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c06b5ee7-d17a-45e4-afc7-e57d3c54bc0a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:54.024359 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c06b5ee7-d17a-45e4-afc7-e57d3c54bc0a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:54.032365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c06b5ee7-d17a-45e4-afc7-e57d3c54bc0a tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.155253 Aug 04 04:43:54.032938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 267/543] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:53 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:54.160008 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b0c84d29-4c4d-4908-9b33-6d583458c36d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:54.162300 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b0c84d29-4c4d-4908-9b33-6d583458c36d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:54.169044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0c84d29-4c4d-4908-9b33-6d583458c36d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:54.169585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0c84d29-4c4d-4908-9b33-6d583458c36d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:54.171070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0c84d29-4c4d-4908-9b33-6d583458c36d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:54.171712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0c84d29-4c4d-4908-9b33-6d583458c36d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:54.202434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b0c84d29-4c4d-4908-9b33-6d583458c36d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047712 Aug 04 04:43:54.203011 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 277/544] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:43:54 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:55.054708 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7ecd39c8-e07a-4910-9a4d-8b50ac870537 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:55.055438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7ecd39c8-e07a-4910-9a4d-8b50ac870537 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:55.062430 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ecd39c8-e07a-4910-9a4d-8b50ac870537 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:55.062898 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ecd39c8-e07a-4910-9a4d-8b50ac870537 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:55.063816 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ecd39c8-e07a-4910-9a4d-8b50ac870537 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:55.064094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ecd39c8-e07a-4910-9a4d-8b50ac870537 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:55.202743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7ecd39c8-e07a-4910-9a4d-8b50ac870537 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:55.210368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7ecd39c8-e07a-4910-9a4d-8b50ac870537 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.159515 Aug 04 04:43:55.210937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 268/545] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:55 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:55.215168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6df60460-1a1d-420c-8144-5bc4eb0839e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:55.218895 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6df60460-1a1d-420c-8144-5bc4eb0839e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:55.226827 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6df60460-1a1d-420c-8144-5bc4eb0839e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:55.227279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6df60460-1a1d-420c-8144-5bc4eb0839e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:55.228057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6df60460-1a1d-420c-8144-5bc4eb0839e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:55.228490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6df60460-1a1d-420c-8144-5bc4eb0839e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:55.259827 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6df60460-1a1d-420c-8144-5bc4eb0839e8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048763 Aug 04 04:43:55.260428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 278/546] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:43:55 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:43:56.235573 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-74b6cd91-568b-46ec-bb9f-2f570c9b7aba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:56.236482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-74b6cd91-568b-46ec-bb9f-2f570c9b7aba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:56.245165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-74b6cd91-568b-46ec-bb9f-2f570c9b7aba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:56.245812 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-74b6cd91-568b-46ec-bb9f-2f570c9b7aba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:56.246777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-74b6cd91-568b-46ec-bb9f-2f570c9b7aba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:56.247341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-74b6cd91-568b-46ec-bb9f-2f570c9b7aba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:56.272985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-60896866-4716-4312-b1e1-56865a897e62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:56.275495 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-60896866-4716-4312-b1e1-56865a897e62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:56.284472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-60896866-4716-4312-b1e1-56865a897e62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:56.284948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-60896866-4716-4312-b1e1-56865a897e62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:56.285771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-60896866-4716-4312-b1e1-56865a897e62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:56.286247 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-60896866-4716-4312-b1e1-56865a897e62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:56.322421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-60896866-4716-4312-b1e1-56865a897e62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053786 Aug 04 04:43:56.323049 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 279/547] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:43:56 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:43:56.394702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-74b6cd91-568b-46ec-bb9f-2f570c9b7aba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:56.403080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-74b6cd91-568b-46ec-bb9f-2f570c9b7aba tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.173894 Aug 04 04:43:56.403683 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 269/548] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:56 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:57.335827 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-81c088ca-9648-4df6-87bd-091300f456a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:57.338080 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-81c088ca-9648-4df6-87bd-091300f456a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:57.345381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-81c088ca-9648-4df6-87bd-091300f456a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:57.345848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-81c088ca-9648-4df6-87bd-091300f456a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:57.346632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-81c088ca-9648-4df6-87bd-091300f456a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:57.347067 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-81c088ca-9648-4df6-87bd-091300f456a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:57.377033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-81c088ca-9648-4df6-87bd-091300f456a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Aug 04 04:43:57.377812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 280/549] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:43:57 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:57.427492 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0c8689b1-7397-4601-bcab-397a0f23e36e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:57.428119 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0c8689b1-7397-4601-bcab-397a0f23e36e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:57.434802 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c8689b1-7397-4601-bcab-397a0f23e36e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:57.435257 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c8689b1-7397-4601-bcab-397a0f23e36e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:57.436661 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c8689b1-7397-4601-bcab-397a0f23e36e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:57.437105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c8689b1-7397-4601-bcab-397a0f23e36e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:57.576971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0c8689b1-7397-4601-bcab-397a0f23e36e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:57.586884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0c8689b1-7397-4601-bcab-397a0f23e36e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.163353 Aug 04 04:43:57.587466 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 270/550] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:57 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:58.390044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-30b46363-09ed-4194-a69d-d10b484adf23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:58.392482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-30b46363-09ed-4194-a69d-d10b484adf23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:58.399476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-30b46363-09ed-4194-a69d-d10b484adf23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:58.399730 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-30b46363-09ed-4194-a69d-d10b484adf23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:58.400503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-30b46363-09ed-4194-a69d-d10b484adf23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:58.400951 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-30b46363-09ed-4194-a69d-d10b484adf23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:58.432213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-30b46363-09ed-4194-a69d-d10b484adf23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047232 Aug 04 04:43:58.432785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 281/551] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:43:58 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:43:58.611663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-33006441-fd58-4c9d-8106-ed26ff1e43fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:58.612393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-33006441-fd58-4c9d-8106-ed26ff1e43fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:58.618957 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-33006441-fd58-4c9d-8106-ed26ff1e43fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:58.619405 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-33006441-fd58-4c9d-8106-ed26ff1e43fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:58.620165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-33006441-fd58-4c9d-8106-ed26ff1e43fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:58.620595 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-33006441-fd58-4c9d-8106-ed26ff1e43fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:58.778619 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-33006441-fd58-4c9d-8106-ed26ff1e43fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:58.786639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-33006441-fd58-4c9d-8106-ed26ff1e43fc tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.178917 Aug 04 04:43:58.787467 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 271/552] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:58 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:43:59.446752 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-975d9681-60bd-4e57-b651-bdcc306ff31f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:59.449629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-975d9681-60bd-4e57-b651-bdcc306ff31f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:59.458475 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-975d9681-60bd-4e57-b651-bdcc306ff31f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:59.458950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-975d9681-60bd-4e57-b651-bdcc306ff31f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:59.459869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-975d9681-60bd-4e57-b651-bdcc306ff31f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:59.460443 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-975d9681-60bd-4e57-b651-bdcc306ff31f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:59.497637 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-975d9681-60bd-4e57-b651-bdcc306ff31f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056321 Aug 04 04:43:59.498791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 282/553] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:43:59 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:43:59.812045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-db16ac1d-6b6a-4535-bdda-bb3ac3503717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:43:59.812660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-db16ac1d-6b6a-4535-bdda-bb3ac3503717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:43:59.819292 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db16ac1d-6b6a-4535-bdda-bb3ac3503717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:59.819883 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db16ac1d-6b6a-4535-bdda-bb3ac3503717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:59.820615 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db16ac1d-6b6a-4535-bdda-bb3ac3503717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:43:59.821037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db16ac1d-6b6a-4535-bdda-bb3ac3503717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:43:59.958387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-db16ac1d-6b6a-4535-bdda-bb3ac3503717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:43:59.961923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:59.967412 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-db16ac1d-6b6a-4535-bdda-bb3ac3503717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.159694 Aug 04 04:43:59.968004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 272/554] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:43:59 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:00.512241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-738c7b33-7a6f-4a4c-811b-38e758085830 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:00.516102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-738c7b33-7a6f-4a4c-811b-38e758085830 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:00.522517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-738c7b33-7a6f-4a4c-811b-38e758085830 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:00.522967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-738c7b33-7a6f-4a4c-811b-38e758085830 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:00.523749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-738c7b33-7a6f-4a4c-811b-38e758085830 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:00.524181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-738c7b33-7a6f-4a4c-811b-38e758085830 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:00.551640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:00.556963 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-738c7b33-7a6f-4a4c-811b-38e758085830 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048733 Aug 04 04:44:00.557539 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 283/555] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:00 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:00.993497 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b444d93c-a58a-4795-9cda-7ab680b29717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:00.994146 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b444d93c-a58a-4795-9cda-7ab680b29717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:01.002759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b444d93c-a58a-4795-9cda-7ab680b29717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:01.003235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b444d93c-a58a-4795-9cda-7ab680b29717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:01.004028 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b444d93c-a58a-4795-9cda-7ab680b29717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:01.004464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b444d93c-a58a-4795-9cda-7ab680b29717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:01.163784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b444d93c-a58a-4795-9cda-7ab680b29717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:01.173520 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b444d93c-a58a-4795-9cda-7ab680b29717 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.185675 Aug 04 04:44:01.174162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 273/556] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:00 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:01.569117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f775b654-0506-4024-be28-74dffc197fdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:01.571281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f775b654-0506-4024-be28-74dffc197fdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:01.578489 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f775b654-0506-4024-be28-74dffc197fdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:01.578936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f775b654-0506-4024-be28-74dffc197fdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:01.579700 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f775b654-0506-4024-be28-74dffc197fdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:01.580129 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f775b654-0506-4024-be28-74dffc197fdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:01.612718 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f775b654-0506-4024-be28-74dffc197fdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048132 Aug 04 04:44:01.613343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 284/557] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:01 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:44:02.196638 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c7bdac24-3065-41ed-a225-16e03f1f38dd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:02.197237 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c7bdac24-3065-41ed-a225-16e03f1f38dd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:02.205148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7bdac24-3065-41ed-a225-16e03f1f38dd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:02.205632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7bdac24-3065-41ed-a225-16e03f1f38dd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:02.206457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7bdac24-3065-41ed-a225-16e03f1f38dd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:02.206915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7bdac24-3065-41ed-a225-16e03f1f38dd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:02.350983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c7bdac24-3065-41ed-a225-16e03f1f38dd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:02.359649 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c7bdac24-3065-41ed-a225-16e03f1f38dd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.166959 Aug 04 04:44:02.360251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 274/558] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:02 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:02.626189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-648b3da8-f9e5-41db-be44-7964fec70500 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:02.628298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-648b3da8-f9e5-41db-be44-7964fec70500 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:02.635045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-648b3da8-f9e5-41db-be44-7964fec70500 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:02.635475 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-648b3da8-f9e5-41db-be44-7964fec70500 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:02.636246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-648b3da8-f9e5-41db-be44-7964fec70500 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:02.636680 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-648b3da8-f9e5-41db-be44-7964fec70500 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:02.667194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-648b3da8-f9e5-41db-be44-7964fec70500 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045573 Aug 04 04:44:02.667753 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 285/559] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:02 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:03.382388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-748caa92-7dc5-4723-b388-7cf661b09a7f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:03.383094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-748caa92-7dc5-4723-b388-7cf661b09a7f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:03.390137 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-748caa92-7dc5-4723-b388-7cf661b09a7f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:03.390588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-748caa92-7dc5-4723-b388-7cf661b09a7f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:03.391383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-748caa92-7dc5-4723-b388-7cf661b09a7f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:03.391800 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-748caa92-7dc5-4723-b388-7cf661b09a7f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:03.534156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-748caa92-7dc5-4723-b388-7cf661b09a7f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:03.542134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-748caa92-7dc5-4723-b388-7cf661b09a7f tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.163534 Aug 04 04:44:03.542715 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 275/560] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:03 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:03.680398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2856d730-e9d4-43f5-9143-b10d6755f189 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:03.682526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2856d730-e9d4-43f5-9143-b10d6755f189 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:03.689286 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2856d730-e9d4-43f5-9143-b10d6755f189 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:03.689784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2856d730-e9d4-43f5-9143-b10d6755f189 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:03.690568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2856d730-e9d4-43f5-9143-b10d6755f189 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:03.691001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2856d730-e9d4-43f5-9143-b10d6755f189 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:03.724094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2856d730-e9d4-43f5-9143-b10d6755f189 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047612 Aug 04 04:44:03.724773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 286/561] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:03 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:04.564608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fb51d4df-486d-401e-998d-bf64239310b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:04.565179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fb51d4df-486d-401e-998d-bf64239310b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:04.572006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fb51d4df-486d-401e-998d-bf64239310b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:04.572453 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fb51d4df-486d-401e-998d-bf64239310b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:04.573225 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fb51d4df-486d-401e-998d-bf64239310b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:04.573687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fb51d4df-486d-401e-998d-bf64239310b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:04.728668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-fb51d4df-486d-401e-998d-bf64239310b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:04.737012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-59058709-584b-4418-a7a4-d74a6e70bd51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:04.739358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fb51d4df-486d-401e-998d-bf64239310b2 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.179157 Aug 04 04:44:04.739828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-59058709-584b-4418-a7a4-d74a6e70bd51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:04.747355 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-59058709-584b-4418-a7a4-d74a6e70bd51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:04.749058 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-59058709-584b-4418-a7a4-d74a6e70bd51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:04.750003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-59058709-584b-4418-a7a4-d74a6e70bd51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:04.750446 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-59058709-584b-4418-a7a4-d74a6e70bd51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:04.753827 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 276/562] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:04 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:04.783669 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-59058709-584b-4418-a7a4-d74a6e70bd51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051270 Aug 04 04:44:04.784243 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 287/563] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:04 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:05.767846 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b52ee043-06d2-428d-867e-187c963534db tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:05.768595 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b52ee043-06d2-428d-867e-187c963534db tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:05.777012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b52ee043-06d2-428d-867e-187c963534db tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:05.780074 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b52ee043-06d2-428d-867e-187c963534db tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:05.780968 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b52ee043-06d2-428d-867e-187c963534db tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:05.782463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b52ee043-06d2-428d-867e-187c963534db tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:05.798763 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-126578c5-ba0e-4320-a52a-5eb46a40d0a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:05.801033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-126578c5-ba0e-4320-a52a-5eb46a40d0a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:05.808917 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-126578c5-ba0e-4320-a52a-5eb46a40d0a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:05.809356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-126578c5-ba0e-4320-a52a-5eb46a40d0a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:05.810215 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-126578c5-ba0e-4320-a52a-5eb46a40d0a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:05.810926 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-126578c5-ba0e-4320-a52a-5eb46a40d0a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:05.852084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-126578c5-ba0e-4320-a52a-5eb46a40d0a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057273 Aug 04 04:44:05.853180 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 288/564] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:05 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:05.944008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b52ee043-06d2-428d-867e-187c963534db tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:05.953103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b52ee043-06d2-428d-867e-187c963534db tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.189983 Aug 04 04:44:05.953714 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 277/565] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:05 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:06.865385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4c3a76c7-7e38-4504-94c2-cce004655089 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:06.867736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4c3a76c7-7e38-4504-94c2-cce004655089 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:06.876023 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c3a76c7-7e38-4504-94c2-cce004655089 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:06.876477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c3a76c7-7e38-4504-94c2-cce004655089 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:06.877256 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c3a76c7-7e38-4504-94c2-cce004655089 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:06.877741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c3a76c7-7e38-4504-94c2-cce004655089 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:06.911927 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4c3a76c7-7e38-4504-94c2-cce004655089 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050708 Aug 04 04:44:06.912506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 289/566] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:06 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:06.976271 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e803a41d-e8c5-463c-be60-7bcac3edadaf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:06.976926 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e803a41d-e8c5-463c-be60-7bcac3edadaf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:06.985262 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e803a41d-e8c5-463c-be60-7bcac3edadaf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:06.985775 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e803a41d-e8c5-463c-be60-7bcac3edadaf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:06.986555 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e803a41d-e8c5-463c-be60-7bcac3edadaf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:06.986990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e803a41d-e8c5-463c-be60-7bcac3edadaf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:07.136630 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e803a41d-e8c5-463c-be60-7bcac3edadaf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:07.144973 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e803a41d-e8c5-463c-be60-7bcac3edadaf tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.173384 Aug 04 04:44:07.145573 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 278/567] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:06 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:07.925896 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-867e3a2f-c877-42c4-8101-11a8886962b5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:07.928042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-867e3a2f-c877-42c4-8101-11a8886962b5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:07.934865 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-867e3a2f-c877-42c4-8101-11a8886962b5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:07.935615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-867e3a2f-c877-42c4-8101-11a8886962b5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:07.936421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-867e3a2f-c877-42c4-8101-11a8886962b5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:07.936861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-867e3a2f-c877-42c4-8101-11a8886962b5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:07.968169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-867e3a2f-c877-42c4-8101-11a8886962b5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046259 Aug 04 04:44:07.968736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 290/568] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:07 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:08.288210 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-97b7d1b6-f05f-4d20-bc5c-51d46ff94d1e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:08.288827 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-97b7d1b6-f05f-4d20-bc5c-51d46ff94d1e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:08.296417 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97b7d1b6-f05f-4d20-bc5c-51d46ff94d1e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:08.297293 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97b7d1b6-f05f-4d20-bc5c-51d46ff94d1e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:08.298699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97b7d1b6-f05f-4d20-bc5c-51d46ff94d1e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:08.299148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97b7d1b6-f05f-4d20-bc5c-51d46ff94d1e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:08.449325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-97b7d1b6-f05f-4d20-bc5c-51d46ff94d1e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:08.458398 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-97b7d1b6-f05f-4d20-bc5c-51d46ff94d1e tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.295850 Aug 04 04:44:08.458970 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 279/569] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:08 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:08.981017 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-82d8df20-164a-4bfa-94fa-8d45db2409af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:08.983750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-82d8df20-164a-4bfa-94fa-8d45db2409af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:08.990337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-82d8df20-164a-4bfa-94fa-8d45db2409af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:08.990788 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-82d8df20-164a-4bfa-94fa-8d45db2409af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:08.991559 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-82d8df20-164a-4bfa-94fa-8d45db2409af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:08.991998 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-82d8df20-164a-4bfa-94fa-8d45db2409af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:09.021866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-82d8df20-164a-4bfa-94fa-8d45db2409af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044784 Aug 04 04:44:09.022431 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 291/570] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:09.478699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8e3374d4-0d82-47a9-8549-be945c8f5b04 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:09.479310 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8e3374d4-0d82-47a9-8549-be945c8f5b04 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:09.482827 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:09.488276 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8e3374d4-0d82-47a9-8549-be945c8f5b04 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:09.488730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8e3374d4-0d82-47a9-8549-be945c8f5b04 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:09.489488 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8e3374d4-0d82-47a9-8549-be945c8f5b04 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:09.489946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8e3374d4-0d82-47a9-8549-be945c8f5b04 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:09.626791 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8e3374d4-0d82-47a9-8549-be945c8f5b04 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:09.634374 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8e3374d4-0d82-47a9-8549-be945c8f5b04 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.159502 Aug 04 04:44:09.634958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 280/571] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:09 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:10.035375 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4b575ca3-1443-4674-920b-925927a92002 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:10.037512 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4b575ca3-1443-4674-920b-925927a92002 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:10.040195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=53 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:10.046273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b575ca3-1443-4674-920b-925927a92002 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:10.046727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b575ca3-1443-4674-920b-925927a92002 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:10.047499 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b575ca3-1443-4674-920b-925927a92002 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:10.047941 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b575ca3-1443-4674-920b-925927a92002 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:10.076488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4b575ca3-1443-4674-920b-925927a92002 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045028 Aug 04 04:44:10.077037 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 292/572] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:10.656980 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7b27b00e-18af-4298-808e-92f9a8b2cb6b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:10.657676 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7b27b00e-18af-4298-808e-92f9a8b2cb6b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:10.664557 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b27b00e-18af-4298-808e-92f9a8b2cb6b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:10.664951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b27b00e-18af-4298-808e-92f9a8b2cb6b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:10.665750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b27b00e-18af-4298-808e-92f9a8b2cb6b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:10.666219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b27b00e-18af-4298-808e-92f9a8b2cb6b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:10.803027 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7b27b00e-18af-4298-808e-92f9a8b2cb6b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:10.810806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7b27b00e-18af-4298-808e-92f9a8b2cb6b tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.158532 Aug 04 04:44:10.811377 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 281/573] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:10 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:11.088871 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fc49b0a3-a88b-4fde-b21c-9459adc4b069 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:11.092409 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fc49b0a3-a88b-4fde-b21c-9459adc4b069 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:11.099100 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc49b0a3-a88b-4fde-b21c-9459adc4b069 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:11.099852 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc49b0a3-a88b-4fde-b21c-9459adc4b069 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:11.100750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc49b0a3-a88b-4fde-b21c-9459adc4b069 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:11.101190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc49b0a3-a88b-4fde-b21c-9459adc4b069 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:11.131401 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fc49b0a3-a88b-4fde-b21c-9459adc4b069 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046625 Aug 04 04:44:11.131959 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 293/574] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:11 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:11.832923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-20d7226c-d0c0-45fa-b543-66dd3e8fb2d7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:11.833500 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-20d7226c-d0c0-45fa-b543-66dd3e8fb2d7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:11.840112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-20d7226c-d0c0-45fa-b543-66dd3e8fb2d7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:11.840567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-20d7226c-d0c0-45fa-b543-66dd3e8fb2d7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:11.841925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-20d7226c-d0c0-45fa-b543-66dd3e8fb2d7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:11.842508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-20d7226c-d0c0-45fa-b543-66dd3e8fb2d7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:12.022448 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-20d7226c-d0c0-45fa-b543-66dd3e8fb2d7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:12.033789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-20d7226c-d0c0-45fa-b543-66dd3e8fb2d7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1670 microversion: 2.1 time: 0.204682 Aug 04 04:44:12.034506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 282/575] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:11 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1670 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:12.144602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e5a6ebb1-9207-41d8-801b-91da4effeea0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:12.147654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e5a6ebb1-9207-41d8-801b-91da4effeea0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:12.155681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5a6ebb1-9207-41d8-801b-91da4effeea0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:12.156150 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5a6ebb1-9207-41d8-801b-91da4effeea0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:12.157065 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5a6ebb1-9207-41d8-801b-91da4effeea0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:12.157697 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5a6ebb1-9207-41d8-801b-91da4effeea0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:12.192029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e5a6ebb1-9207-41d8-801b-91da4effeea0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051801 Aug 04 04:44:12.192857 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 294/576] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:12 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:12.720600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-993b4cde-1010-43ec-8e03-c0e516461965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:12.724112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-993b4cde-1010-43ec-8e03-c0e516461965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:12.732054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-993b4cde-1010-43ec-8e03-c0e516461965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:12.732644 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-993b4cde-1010-43ec-8e03-c0e516461965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:12.734754 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-993b4cde-1010-43ec-8e03-c0e516461965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:12.734754 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-993b4cde-1010-43ec-8e03-c0e516461965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:12.759774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-993b4cde-1010-43ec-8e03-c0e516461965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lazy-loading 'flavor' on Instance uuid a7ee17d5-d905-461c-95ff-9588447cc943 {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:44:12.899657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-993b4cde-1010-43ec-8e03-c0e516461965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "POST /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/action" status: 200 len: 32 microversion: 2.1 time: 0.184346 Aug 04 04:44:12.900646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 283/577] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:44:12 2022] POST /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 04:44:12.910079 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a56ef64c-c889-4be3-a25d-331bafa2107c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:12.910861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a56ef64c-c889-4be3-a25d-331bafa2107c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:12.917294 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a56ef64c-c889-4be3-a25d-331bafa2107c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:12.917856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a56ef64c-c889-4be3-a25d-331bafa2107c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:12.918700 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a56ef64c-c889-4be3-a25d-331bafa2107c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:12.919859 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a56ef64c-c889-4be3-a25d-331bafa2107c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:13.061679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eca657d2-c656-40ac-8ba0-acdb78217c83 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:13.062754 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eca657d2-c656-40ac-8ba0-acdb78217c83 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:13.083450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eca657d2-c656-40ac-8ba0-acdb78217c83 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:13.085898 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eca657d2-c656-40ac-8ba0-acdb78217c83 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:13.089734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eca657d2-c656-40ac-8ba0-acdb78217c83 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:13.091321 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eca657d2-c656-40ac-8ba0-acdb78217c83 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:13.092851 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a56ef64c-c889-4be3-a25d-331bafa2107c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:13.104360 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a56ef64c-c889-4be3-a25d-331bafa2107c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.198153 Aug 04 04:44:13.104945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 295/578] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:13.111114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-7713fb34-1536-46bf-a05a-4ee1f8400275 req-f66830b0-330f-4a5c-9526-e7fd1e137aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce02b26c-276e-4d87-9790-87a8469fac7a", "name": "network-vif-deleted", "tag": "53a920ec-439a-4a5f-9d51-66dee4c91777"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:13.130628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-7713fb34-1536-46bf-a05a-4ee1f8400275 req-f66830b0-330f-4a5c-9526-e7fd1e137aad service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:13.131830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-7713fb34-1536-46bf-a05a-4ee1f8400275 req-f66830b0-330f-4a5c-9526-e7fd1e137aad service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:13.170920 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-7713fb34-1536-46bf-a05a-4ee1f8400275 req-f66830b0-330f-4a5c-9526-e7fd1e137aad service nova] Creating event network-vif-deleted:53a920ec-439a-4a5f-9d51-66dee4c91777 for instance ce02b26c-276e-4d87-9790-87a8469fac7a on hv-cinder-85127 Aug 04 04:44:13.186020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-7713fb34-1536-46bf-a05a-4ee1f8400275 req-f66830b0-330f-4a5c-9526-e7fd1e137aad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079434 Aug 04 04:44:13.186957 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 296/579] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:13.206798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b2e8c3b5-b0fd-4249-92e6-9622d6acf2d1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:13.209304 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b2e8c3b5-b0fd-4249-92e6-9622d6acf2d1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:13.214554 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-eca657d2-c656-40ac-8ba0-acdb78217c83 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:13.218241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b2e8c3b5-b0fd-4249-92e6-9622d6acf2d1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:13.218702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b2e8c3b5-b0fd-4249-92e6-9622d6acf2d1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:13.219528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b2e8c3b5-b0fd-4249-92e6-9622d6acf2d1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:13.219925 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b2e8c3b5-b0fd-4249-92e6-9622d6acf2d1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:13.227369 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eca657d2-c656-40ac-8ba0-acdb78217c83 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 200 len: 1602 microversion: 2.1 time: 0.174356 Aug 04 04:44:13.227987 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 284/580] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:13 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 1602 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:13.266966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b2e8c3b5-b0fd-4249-92e6-9622d6acf2d1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065661 Aug 04 04:44:13.268148 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 297/581] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:13 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:44:14.132399 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-268a7b4d-762d-41a5-943e-002db07c68c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:14.133019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-268a7b4d-762d-41a5-943e-002db07c68c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:14.140261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-268a7b4d-762d-41a5-943e-002db07c68c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:14.140717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-268a7b4d-762d-41a5-943e-002db07c68c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:14.141498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-268a7b4d-762d-41a5-943e-002db07c68c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:14.141957 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-268a7b4d-762d-41a5-943e-002db07c68c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:14.264269 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7018c3aa-28e2-4009-9fa8-b0c1851d9178 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:14.265063 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7018c3aa-28e2-4009-9fa8-b0c1851d9178 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:14.280941 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7018c3aa-28e2-4009-9fa8-b0c1851d9178 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:14.282985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7018c3aa-28e2-4009-9fa8-b0c1851d9178 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:14.284122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7018c3aa-28e2-4009-9fa8-b0c1851d9178 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:14.284816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7018c3aa-28e2-4009-9fa8-b0c1851d9178 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:14.303504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-7018c3aa-28e2-4009-9fa8-b0c1851d9178 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] HTTP exception thrown: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7018c3aa-28e2-4009-9fa8-b0c1851d9178 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Request method failure captured: Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a HTTP/1.1 Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601qv00E86gDF5SzueP9-B8uyKvLj0nc6Sro2hqNRnxqf2FFlVY_GJALo_D0NGRq_yIC65WvSXE_w16sIVtcZnCaKtgGOc7rRi-c_pAJDe7GccoFXaRba4f_54MB_ilclV0cxbNI5IM7M76SLtoy4xBpnigqD0YOU-aN8nNE7xHgrj4 Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 157a41f0f76c41cb8dfff71a14138534 Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeTestJSON-1618805094 Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:44:14.305810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:44:14.307339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_157a41f0f76c41cb8dfff71a14138534", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:44:14.307339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeTestJSON-1618805094 Aug 04 04:44:14.307339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 157a41f0f76c41cb8dfff71a14138534 Aug 04 04:44:14.307339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1618805094 Aug 04 04:44:14.307339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeTestJSON-1618805094-project Aug 04 04:44:14.307339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:44:14.307339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:44:14.307339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 12f7b1c19d824ac7b8207bf001b79057 Aug 04 04:44:14.307339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeTestJSON-1618805094-project Aug 04 04:44:14.307339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 04:44:14.307339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 04:44:14.307339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'ce02b26c-276e-4d87-9790-87a8469fac7a'} Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:44:14.308121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 04:44:14.311731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:44:14.314220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-268a7b4d-762d-41a5-943e-002db07c68c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:14.323153 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-268a7b4d-762d-41a5-943e-002db07c68c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.194938 Aug 04 04:44:14.325054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 285/582] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:14 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:14.330779 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cd7f9b83-9bb8-45db-92fb-d153a262494c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:14.333186 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cd7f9b83-9bb8-45db-92fb-d153a262494c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:14.339972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd7f9b83-9bb8-45db-92fb-d153a262494c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:14.340347 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd7f9b83-9bb8-45db-92fb-d153a262494c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:14.342130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7018c3aa-28e2-4009-9fa8-b0c1851d9178 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Returning 404 to user: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:44:14.342291 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd7f9b83-9bb8-45db-92fb-d153a262494c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:14.342651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd7f9b83-9bb8-45db-92fb-d153a262494c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:14.344590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7018c3aa-28e2-4009-9fa8-b0c1851d9178 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 404 len: 111 microversion: 2.1 time: 0.097922 Aug 04 04:44:14.347872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 298/583] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:14 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:44:14.358708 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-93b5e4ae-a284-4a3f-8154-919785d01d30 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '.version_select at 0x7fc94211b280>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:14.390136 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cd7f9b83-9bb8-45db-92fb-d153a262494c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063464 Aug 04 04:44:14.390742 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 286/584] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:14 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:14.400729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-93b5e4ae-a284-4a3f-8154-919785d01d30 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-249672397" status: 202 len: 0 microversion: 2.1 time: 0.048168 Aug 04 04:44:14.401807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 299/585] 10.222.0.47 () {58 vars in 1218 bytes} [Thu Aug 4 04:44:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-249672397 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:44:15.091907 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-71605a11-ee0a-43cb-8b19-9d08eee28423 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Action: 'create', calling method: .version_select at 0x7fc9420ec430>, body: {"keypair": {"name": "tempest-keypair-587767176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdV7CSZnPCQtuP4J2C6HdoQuqPKV0DkwEJ3VReuq7oBA15uY6YtLntlul69cX/+mk/EWTqe6adgnsBIWzBQcITnM4xNVcYD/qdSLpF5G8+jTsu4b5tnnJslmkigCqEdZA=="}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:15.108896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-71605a11-ee0a-43cb-8b19-9d08eee28423 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Getting quotas for project 157a41f0f76c41cb8dfff71a14138534. Resources: {'key_pairs'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:44:15.113491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-71605a11-ee0a-43cb-8b19-9d08eee28423 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Getting quotas for user 12f7b1c19d824ac7b8207bf001b79057 and project 157a41f0f76c41cb8dfff71a14138534. Resources: {'key_pairs'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:44:15.141406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-71605a11-ee0a-43cb-8b19-9d08eee28423 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053979 Aug 04 04:44:15.142107 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 287/586] 10.222.0.47 () {60 vars in 1159 bytes} [Thu Aug 4 04:44:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:15.348179 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-db775619-2c86-427a-a2e5-d747a988b539 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:15.348781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-db775619-2c86-427a-a2e5-d747a988b539 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:15.366608 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db775619-2c86-427a-a2e5-d747a988b539 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:15.367057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db775619-2c86-427a-a2e5-d747a988b539 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:15.367836 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db775619-2c86-427a-a2e5-d747a988b539 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:15.368271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db775619-2c86-427a-a2e5-d747a988b539 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:15.402123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4991224e-f053-40bb-a71e-062c51dce040 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:15.405018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4991224e-f053-40bb-a71e-062c51dce040 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:15.418038 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4991224e-f053-40bb-a71e-062c51dce040 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:15.418635 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4991224e-f053-40bb-a71e-062c51dce040 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:15.420116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4991224e-f053-40bb-a71e-062c51dce040 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:15.420670 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4991224e-f053-40bb-a71e-062c51dce040 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:15.440722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:15.459302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4991224e-f053-40bb-a71e-062c51dce040 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060970 Aug 04 04:44:15.460318 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 288/587] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:15 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:44:15.573813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-db775619-2c86-427a-a2e5-d747a988b539 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:15.583756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-db775619-2c86-427a-a2e5-d747a988b539 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.240588 Aug 04 04:44:15.584159 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 300/588] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:15 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:16.474236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-27c17553-d559-4774-88df-c080ef7daf0b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:16.476389 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-27c17553-d559-4774-88df-c080ef7daf0b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:16.484679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27c17553-d559-4774-88df-c080ef7daf0b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:16.485125 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27c17553-d559-4774-88df-c080ef7daf0b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:16.485924 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27c17553-d559-4774-88df-c080ef7daf0b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:16.486357 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27c17553-d559-4774-88df-c080ef7daf0b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:16.523849 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-27c17553-d559-4774-88df-c080ef7daf0b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055332 Aug 04 04:44:16.524898 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 289/589] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:16 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:16.607505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8df44c7c-c5b1-401b-be04-e2109c88e3c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:16.608174 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8df44c7c-c5b1-401b-be04-e2109c88e3c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:16.615254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8df44c7c-c5b1-401b-be04-e2109c88e3c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:16.615840 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8df44c7c-c5b1-401b-be04-e2109c88e3c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:16.616835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8df44c7c-c5b1-401b-be04-e2109c88e3c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:16.617439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8df44c7c-c5b1-401b-be04-e2109c88e3c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:16.629891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1080234229", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a74bfc1f-40a0-4124-8b9e-742f5d37af4d"}], "security_groups": [{"name": "tempest-securitygroup--1493127392"}], "key_name": "tempest-keypair-587767176", "user_data": "}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:16.782829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] validate_networks() for [('a74bfc1f-40a0-4124-8b9e-742f5d37af4d', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:44:16.823584 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8df44c7c-c5b1-401b-be04-e2109c88e3c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:16.832745 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8df44c7c-c5b1-401b-be04-e2109c88e3c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.229820 Aug 04 04:44:16.833326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 301/590] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:17.233580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:44:17.234046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:44:17.234544 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:44:17.234949 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:44:17.235356 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:44:17.244418 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:17.244867 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:17.245691 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:17.246125 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:17.269041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Getting quotas for project 157a41f0f76c41cb8dfff71a14138534. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:44:17.273483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Getting quotas for user 12f7b1c19d824ac7b8207bf001b79057 and project 157a41f0f76c41cb8dfff71a14138534. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:44:17.285537 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:44:17.287987 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:44:17.342670 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ad7cc0b3-d691-4d4b-9020-48cbeab646d6 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.717231 Aug 04 04:44:17.343748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 290/591] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:44:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 04:44:17.357397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9e3e67be-d552-4874-9260-8b4bfeda3632 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:17.358077 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9e3e67be-d552-4874-9260-8b4bfeda3632 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:17.413574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9e3e67be-d552-4874-9260-8b4bfeda3632 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:17.420827 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9e3e67be-d552-4874-9260-8b4bfeda3632 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 200 len: 1237 microversion: 2.1 time: 0.069430 Aug 04 04:44:17.421411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 302/592] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:17 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:17.536547 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-09fccade-d177-4a49-95d7-8dd494ba6a0a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:17.539095 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-09fccade-d177-4a49-95d7-8dd494ba6a0a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:17.547135 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-09fccade-d177-4a49-95d7-8dd494ba6a0a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:17.547582 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-09fccade-d177-4a49-95d7-8dd494ba6a0a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:17.548368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-09fccade-d177-4a49-95d7-8dd494ba6a0a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:17.548800 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-09fccade-d177-4a49-95d7-8dd494ba6a0a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:17.580442 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-09fccade-d177-4a49-95d7-8dd494ba6a0a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047844 Aug 04 04:44:17.581188 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 291/593] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:17 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:17.858305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a1ce83d0-f61e-4a8f-a0b5-01cc575ea7e5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:17.859549 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a1ce83d0-f61e-4a8f-a0b5-01cc575ea7e5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:17.871286 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1ce83d0-f61e-4a8f-a0b5-01cc575ea7e5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:17.872729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1ce83d0-f61e-4a8f-a0b5-01cc575ea7e5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:17.874245 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1ce83d0-f61e-4a8f-a0b5-01cc575ea7e5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:17.875251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1ce83d0-f61e-4a8f-a0b5-01cc575ea7e5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:18.056931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a1ce83d0-f61e-4a8f-a0b5-01cc575ea7e5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:18.061096 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:18.066691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a1ce83d0-f61e-4a8f-a0b5-01cc575ea7e5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.216203 Aug 04 04:44:18.067281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 303/594] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:17 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:18.441971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-95553392-d8ee-45d2-be8b-0d1567225875 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:18.442508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-95553392-d8ee-45d2-be8b-0d1567225875 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:18.449004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-95553392-d8ee-45d2-be8b-0d1567225875 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:18.449469 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-95553392-d8ee-45d2-be8b-0d1567225875 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:18.450903 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-95553392-d8ee-45d2-be8b-0d1567225875 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:18.451656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-95553392-d8ee-45d2-be8b-0d1567225875 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:18.520860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-95553392-d8ee-45d2-be8b-0d1567225875 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:18.523648 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:44:18.524962 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 04:44:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:44:18.532160 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-95553392-d8ee-45d2-be8b-0d1567225875 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 200 len: 1289 microversion: 2.1 time: 0.094025 Aug 04 04:44:18.533129 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 292/595] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:18 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:18.599234 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3d0aaf1a-2e6c-43b4-b34b-77a5e6410a38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:18.601830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3d0aaf1a-2e6c-43b4-b34b-77a5e6410a38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:18.610208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3d0aaf1a-2e6c-43b4-b34b-77a5e6410a38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:18.610749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3d0aaf1a-2e6c-43b4-b34b-77a5e6410a38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:18.611751 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3d0aaf1a-2e6c-43b4-b34b-77a5e6410a38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:18.612180 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3d0aaf1a-2e6c-43b4-b34b-77a5e6410a38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:18.653244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3d0aaf1a-2e6c-43b4-b34b-77a5e6410a38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064018 Aug 04 04:44:18.661748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 304/596] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:18 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:19.089480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0dff48b0-6806-443e-854a-f24849244c45 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:19.090130 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0dff48b0-6806-443e-854a-f24849244c45 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:19.097983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0dff48b0-6806-443e-854a-f24849244c45 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:19.098429 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0dff48b0-6806-443e-854a-f24849244c45 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:19.099210 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0dff48b0-6806-443e-854a-f24849244c45 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:19.099651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0dff48b0-6806-443e-854a-f24849244c45 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:19.254292 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0dff48b0-6806-443e-854a-f24849244c45 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:19.265002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0dff48b0-6806-443e-854a-f24849244c45 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.179367 Aug 04 04:44:19.266417 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 293/597] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:19.555359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9fe31c54-3ba0-4dc3-b515-b5ecf9fc4ae7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:19.556040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9fe31c54-3ba0-4dc3-b515-b5ecf9fc4ae7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:19.564856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9fe31c54-3ba0-4dc3-b515-b5ecf9fc4ae7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:19.565596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9fe31c54-3ba0-4dc3-b515-b5ecf9fc4ae7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:19.566398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9fe31c54-3ba0-4dc3-b515-b5ecf9fc4ae7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:19.566831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9fe31c54-3ba0-4dc3-b515-b5ecf9fc4ae7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:19.669879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a80bf7ec-35ee-4816-9c20-d2e013309bd8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:19.672717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a80bf7ec-35ee-4816-9c20-d2e013309bd8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:19.679660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a80bf7ec-35ee-4816-9c20-d2e013309bd8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:19.680649 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a80bf7ec-35ee-4816-9c20-d2e013309bd8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:19.682794 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a80bf7ec-35ee-4816-9c20-d2e013309bd8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:19.683512 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a80bf7ec-35ee-4816-9c20-d2e013309bd8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:19.733152 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a80bf7ec-35ee-4816-9c20-d2e013309bd8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067620 Aug 04 04:44:19.734326 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 294/598] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:19 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:19.737341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9fe31c54-3ba0-4dc3-b515-b5ecf9fc4ae7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:19.746344 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9fe31c54-3ba0-4dc3-b515-b5ecf9fc4ae7 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 200 len: 1363 microversion: 2.1 time: 0.195619 Aug 04 04:44:19.746989 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 305/599] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:19 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:20.171051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-1a52dac6-0f10-442c-b854-3fe526ce4511 req-b7e236da-584a-49ed-a71c-746e047f0344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b6588e-407b-44d5-ab86-395074db1c22", "tag": "35f4f9e6-5967-4a03-9893-be7bccc37a83"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:20.182118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-1a52dac6-0f10-442c-b854-3fe526ce4511 req-b7e236da-584a-49ed-a71c-746e047f0344 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:20.183249 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-1a52dac6-0f10-442c-b854-3fe526ce4511 req-b7e236da-584a-49ed-a71c-746e047f0344 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:20.198921 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-1a52dac6-0f10-442c-b854-3fe526ce4511 req-b7e236da-584a-49ed-a71c-746e047f0344 service nova] Creating event network-changed:35f4f9e6-5967-4a03-9893-be7bccc37a83 for instance b1b6588e-407b-44d5-ab86-395074db1c22 on hv-cinder-85127 Aug 04 04:44:20.205833 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-1a52dac6-0f10-442c-b854-3fe526ce4511 req-b7e236da-584a-49ed-a71c-746e047f0344 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038887 Aug 04 04:44:20.206937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 295/600] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:20.287785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c194c216-627c-41f9-9ba8-512b626a5113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:20.288398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c194c216-627c-41f9-9ba8-512b626a5113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:20.295565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c194c216-627c-41f9-9ba8-512b626a5113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:20.296020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c194c216-627c-41f9-9ba8-512b626a5113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:20.296799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c194c216-627c-41f9-9ba8-512b626a5113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:20.297241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c194c216-627c-41f9-9ba8-512b626a5113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:20.444368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c194c216-627c-41f9-9ba8-512b626a5113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:20.453294 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c194c216-627c-41f9-9ba8-512b626a5113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.169437 Aug 04 04:44:20.454446 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 306/601] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:20.747175 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8b3469ab-84cb-427c-b0ab-87b5d609cb6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:20.749446 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8b3469ab-84cb-427c-b0ab-87b5d609cb6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:20.756084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8b3469ab-84cb-427c-b0ab-87b5d609cb6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:20.756530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8b3469ab-84cb-427c-b0ab-87b5d609cb6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:20.757287 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8b3469ab-84cb-427c-b0ab-87b5d609cb6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:20.757754 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8b3469ab-84cb-427c-b0ab-87b5d609cb6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:20.769766 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5834e769-b0a4-45cd-b21b-02e9cd1e8194 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:20.770408 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5834e769-b0a4-45cd-b21b-02e9cd1e8194 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:20.777278 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5834e769-b0a4-45cd-b21b-02e9cd1e8194 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:20.777675 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5834e769-b0a4-45cd-b21b-02e9cd1e8194 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:20.779813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5834e769-b0a4-45cd-b21b-02e9cd1e8194 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:20.780257 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5834e769-b0a4-45cd-b21b-02e9cd1e8194 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:20.792307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8b3469ab-84cb-427c-b0ab-87b5d609cb6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050010 Aug 04 04:44:20.793088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 296/602] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:20 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:20.921977 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5834e769-b0a4-45cd-b21b-02e9cd1e8194 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:20.929418 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5834e769-b0a4-45cd-b21b-02e9cd1e8194 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 200 len: 1363 microversion: 2.1 time: 0.163501 Aug 04 04:44:20.930001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 307/603] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:20 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:44:21.477179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9dcae9f9-aae7-4350-8356-f31a1107fbe6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:21.477826 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9dcae9f9-aae7-4350-8356-f31a1107fbe6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:21.485301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9dcae9f9-aae7-4350-8356-f31a1107fbe6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:21.485896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9dcae9f9-aae7-4350-8356-f31a1107fbe6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:21.486710 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9dcae9f9-aae7-4350-8356-f31a1107fbe6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:21.487146 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9dcae9f9-aae7-4350-8356-f31a1107fbe6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:21.806015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-41af03e6-5719-431d-90be-0ecf2318e567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:21.809020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-41af03e6-5719-431d-90be-0ecf2318e567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:21.816551 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-41af03e6-5719-431d-90be-0ecf2318e567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:21.817252 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-41af03e6-5719-431d-90be-0ecf2318e567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:21.818365 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-41af03e6-5719-431d-90be-0ecf2318e567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:21.818966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-41af03e6-5719-431d-90be-0ecf2318e567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:21.852188 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-41af03e6-5719-431d-90be-0ecf2318e567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051236 Aug 04 04:44:21.858017 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 308/604] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:21 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:21.929626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9dcae9f9-aae7-4350-8356-f31a1107fbe6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:21.938498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9dcae9f9-aae7-4350-8356-f31a1107fbe6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.465522 Aug 04 04:44:21.939079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 297/605] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:21 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:21.957153 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7c6624c8-9495-4a33-904c-de8835e4a6bd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:21.957870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7c6624c8-9495-4a33-904c-de8835e4a6bd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:21.964479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c6624c8-9495-4a33-904c-de8835e4a6bd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:21.964956 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c6624c8-9495-4a33-904c-de8835e4a6bd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:21.966471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c6624c8-9495-4a33-904c-de8835e4a6bd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:21.967102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c6624c8-9495-4a33-904c-de8835e4a6bd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:22.116780 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7c6624c8-9495-4a33-904c-de8835e4a6bd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:22.125070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7c6624c8-9495-4a33-904c-de8835e4a6bd tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 200 len: 1363 microversion: 2.1 time: 0.172119 Aug 04 04:44:22.125682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 309/606] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:21 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:22.865390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4478a0da-129b-43c1-a1a5-496b1757a6de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:22.867580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4478a0da-129b-43c1-a1a5-496b1757a6de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:22.875167 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4478a0da-129b-43c1-a1a5-496b1757a6de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:22.875615 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4478a0da-129b-43c1-a1a5-496b1757a6de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:22.876381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4478a0da-129b-43c1-a1a5-496b1757a6de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:22.876811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4478a0da-129b-43c1-a1a5-496b1757a6de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:22.908437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4478a0da-129b-43c1-a1a5-496b1757a6de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046925 Aug 04 04:44:22.909479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 298/607] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:22 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:22.960237 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c227fec7-b78c-4d17-b250-f5889ec7d135 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:22.961538 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c227fec7-b78c-4d17-b250-f5889ec7d135 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:22.969966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c227fec7-b78c-4d17-b250-f5889ec7d135 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:22.970904 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c227fec7-b78c-4d17-b250-f5889ec7d135 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:22.972385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c227fec7-b78c-4d17-b250-f5889ec7d135 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:22.973093 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c227fec7-b78c-4d17-b250-f5889ec7d135 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:23.116247 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c227fec7-b78c-4d17-b250-f5889ec7d135 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:23.124816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c227fec7-b78c-4d17-b250-f5889ec7d135 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.168530 Aug 04 04:44:23.125384 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 310/608] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:22 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:23.146332 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4ee1f1f6-9d95-4073-a25e-908aaba40ded tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:23.146985 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4ee1f1f6-9d95-4073-a25e-908aaba40ded tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:23.153737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4ee1f1f6-9d95-4073-a25e-908aaba40ded tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:23.154191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4ee1f1f6-9d95-4073-a25e-908aaba40ded tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:23.154966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4ee1f1f6-9d95-4073-a25e-908aaba40ded tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:23.155402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4ee1f1f6-9d95-4073-a25e-908aaba40ded tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:23.291218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4ee1f1f6-9d95-4073-a25e-908aaba40ded tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:23.299421 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4ee1f1f6-9d95-4073-a25e-908aaba40ded tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 200 len: 1363 microversion: 2.1 time: 0.156866 Aug 04 04:44:23.299997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 299/609] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:23 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:23.839511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-be326a13-0e5e-4545-860a-1b1f3083f530 req-53344302-72ea-4b4b-bc0c-712ccdce8d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b6588e-407b-44d5-ab86-395074db1c22", "name": "network-vif-plugged", "status": "completed", "tag": "35f4f9e6-5967-4a03-9893-be7bccc37a83"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:23.849808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-be326a13-0e5e-4545-860a-1b1f3083f530 req-53344302-72ea-4b4b-bc0c-712ccdce8d5d service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:23.850258 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-be326a13-0e5e-4545-860a-1b1f3083f530 req-53344302-72ea-4b4b-bc0c-712ccdce8d5d service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:23.862925 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-be326a13-0e5e-4545-860a-1b1f3083f530 req-53344302-72ea-4b4b-bc0c-712ccdce8d5d service nova] Creating event network-vif-plugged:35f4f9e6-5967-4a03-9893-be7bccc37a83 for instance b1b6588e-407b-44d5-ab86-395074db1c22 on hv-cinder-85127 Aug 04 04:44:23.868347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-be326a13-0e5e-4545-860a-1b1f3083f530 req-53344302-72ea-4b4b-bc0c-712ccdce8d5d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033139 Aug 04 04:44:23.869148 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 311/610] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:23.922520 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-73ac6615-1ee8-40ca-8766-1a4b8361e21f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:23.925403 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-73ac6615-1ee8-40ca-8766-1a4b8361e21f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:23.932737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73ac6615-1ee8-40ca-8766-1a4b8361e21f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:23.933284 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73ac6615-1ee8-40ca-8766-1a4b8361e21f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:23.935022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73ac6615-1ee8-40ca-8766-1a4b8361e21f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:23.935789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73ac6615-1ee8-40ca-8766-1a4b8361e21f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:23.971851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-73ac6615-1ee8-40ca-8766-1a4b8361e21f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054336 Aug 04 04:44:23.973367 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 300/611] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:23 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:24.146941 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-46b79e11-8e59-4219-9ce6-924ab9f56334 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:24.147635 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-46b79e11-8e59-4219-9ce6-924ab9f56334 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:24.154569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46b79e11-8e59-4219-9ce6-924ab9f56334 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:24.155014 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46b79e11-8e59-4219-9ce6-924ab9f56334 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:24.155785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46b79e11-8e59-4219-9ce6-924ab9f56334 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:24.156218 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46b79e11-8e59-4219-9ce6-924ab9f56334 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:24.290630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-46b79e11-8e59-4219-9ce6-924ab9f56334 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:24.299842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-46b79e11-8e59-4219-9ce6-924ab9f56334 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.157604 Aug 04 04:44:24.300427 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 312/612] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:24 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:24.320586 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-31214eb8-c8a3-4f67-883a-21fedfd0a431 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:24.321277 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-31214eb8-c8a3-4f67-883a-21fedfd0a431 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:24.328109 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31214eb8-c8a3-4f67-883a-21fedfd0a431 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:24.328566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31214eb8-c8a3-4f67-883a-21fedfd0a431 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:24.329346 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31214eb8-c8a3-4f67-883a-21fedfd0a431 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:24.329813 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31214eb8-c8a3-4f67-883a-21fedfd0a431 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:24.468308 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-31214eb8-c8a3-4f67-883a-21fedfd0a431 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:24.475853 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-31214eb8-c8a3-4f67-883a-21fedfd0a431 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 200 len: 1363 microversion: 2.1 time: 0.159208 Aug 04 04:44:24.476418 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 301/613] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:24 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:24.984647 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9eba4bca-e0e1-4e0d-9010-2a2928e82a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:24.986836 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9eba4bca-e0e1-4e0d-9010-2a2928e82a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:24.992987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9eba4bca-e0e1-4e0d-9010-2a2928e82a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:24.993434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9eba4bca-e0e1-4e0d-9010-2a2928e82a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:24.994251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9eba4bca-e0e1-4e0d-9010-2a2928e82a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:24.994685 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9eba4bca-e0e1-4e0d-9010-2a2928e82a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:25.024678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9eba4bca-e0e1-4e0d-9010-2a2928e82a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Aug 04 04:44:25.025248 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 313/614] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:24 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:25.321339 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-60498522-6db8-4f19-a69d-0368c62d385f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:25.321969 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-60498522-6db8-4f19-a69d-0368c62d385f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:25.328796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-60498522-6db8-4f19-a69d-0368c62d385f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:25.329246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-60498522-6db8-4f19-a69d-0368c62d385f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:25.330052 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-60498522-6db8-4f19-a69d-0368c62d385f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:25.330489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-60498522-6db8-4f19-a69d-0368c62d385f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:25.465718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-60498522-6db8-4f19-a69d-0368c62d385f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:25.473977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-60498522-6db8-4f19-a69d-0368c62d385f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.156620 Aug 04 04:44:25.474546 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 302/615] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:25 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:25.496138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dc43c6dc-c4b6-4c0d-b669-f05803c3cd17 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:25.497389 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dc43c6dc-c4b6-4c0d-b669-f05803c3cd17 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:25.504182 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dc43c6dc-c4b6-4c0d-b669-f05803c3cd17 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:25.504627 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dc43c6dc-c4b6-4c0d-b669-f05803c3cd17 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:25.505415 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dc43c6dc-c4b6-4c0d-b669-f05803c3cd17 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:25.505850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dc43c6dc-c4b6-4c0d-b669-f05803c3cd17 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:25.645114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-dc43c6dc-c4b6-4c0d-b669-f05803c3cd17 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:25.653178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dc43c6dc-c4b6-4c0d-b669-f05803c3cd17 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 200 len: 1363 microversion: 2.1 time: 0.160311 Aug 04 04:44:25.653780 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 314/616] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:25 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:26.037499 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7c8b10bb-03e1-43a6-89bc-51453d42a322 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:26.039993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7c8b10bb-03e1-43a6-89bc-51453d42a322 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:26.047295 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7c8b10bb-03e1-43a6-89bc-51453d42a322 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:26.047740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7c8b10bb-03e1-43a6-89bc-51453d42a322 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:26.048515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7c8b10bb-03e1-43a6-89bc-51453d42a322 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:26.048950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7c8b10bb-03e1-43a6-89bc-51453d42a322 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:26.080989 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7c8b10bb-03e1-43a6-89bc-51453d42a322 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047410 Aug 04 04:44:26.081796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 303/617] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:26 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:26.495702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bc494c6c-b886-49fa-9143-0530c760ed75 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:26.496876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bc494c6c-b886-49fa-9143-0530c760ed75 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:26.503643 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc494c6c-b886-49fa-9143-0530c760ed75 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:26.504086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc494c6c-b886-49fa-9143-0530c760ed75 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:26.505244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc494c6c-b886-49fa-9143-0530c760ed75 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:26.505244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc494c6c-b886-49fa-9143-0530c760ed75 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:26.639805 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bc494c6c-b886-49fa-9143-0530c760ed75 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:26.648293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bc494c6c-b886-49fa-9143-0530c760ed75 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.156295 Aug 04 04:44:26.648792 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 315/618] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:26 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:26.673656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f01a1cc5-19fe-4184-81b8-5bd859304323 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:26.674278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f01a1cc5-19fe-4184-81b8-5bd859304323 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:26.680887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f01a1cc5-19fe-4184-81b8-5bd859304323 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:26.681339 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f01a1cc5-19fe-4184-81b8-5bd859304323 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:26.682256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f01a1cc5-19fe-4184-81b8-5bd859304323 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:26.682696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f01a1cc5-19fe-4184-81b8-5bd859304323 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:26.823450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f01a1cc5-19fe-4184-81b8-5bd859304323 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:26.831479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f01a1cc5-19fe-4184-81b8-5bd859304323 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 200 len: 1547 microversion: 2.1 time: 0.161631 Aug 04 04:44:26.832054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 304/619] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:26 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:26.852464 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5ed836a6-233d-4559-bf97-bd707b93c08d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:26.852960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5ed836a6-233d-4559-bf97-bd707b93c08d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:26.860132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5ed836a6-233d-4559-bf97-bd707b93c08d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:26.860573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5ed836a6-233d-4559-bf97-bd707b93c08d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:26.861340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5ed836a6-233d-4559-bf97-bd707b93c08d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:26.861831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5ed836a6-233d-4559-bf97-bd707b93c08d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:26.946098 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5ed836a6-233d-4559-bf97-bd707b93c08d tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097420 Aug 04 04:44:26.946693 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 316/620] 10.222.0.47 () {58 vars in 1275 bytes} [Thu Aug 4 04:44:26 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:27.094810 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-466228c0-f45e-4ed6-8697-ada0f463597d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:27.097362 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-466228c0-f45e-4ed6-8697-ada0f463597d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:27.104017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-466228c0-f45e-4ed6-8697-ada0f463597d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:27.104754 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-466228c0-f45e-4ed6-8697-ada0f463597d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:27.107056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-466228c0-f45e-4ed6-8697-ada0f463597d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:27.107822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-466228c0-f45e-4ed6-8697-ada0f463597d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:27.139846 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-466228c0-f45e-4ed6-8697-ada0f463597d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050538 Aug 04 04:44:27.144865 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 305/621] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:27 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:27.667557 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:27.674254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9f27edbc-b537-4f2b-b761-47923828acbd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:27.674910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9f27edbc-b537-4f2b-b761-47923828acbd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:27.682473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f27edbc-b537-4f2b-b761-47923828acbd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:27.682921 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f27edbc-b537-4f2b-b761-47923828acbd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:27.683798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f27edbc-b537-4f2b-b761-47923828acbd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:27.685071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f27edbc-b537-4f2b-b761-47923828acbd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:27.922294 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9f27edbc-b537-4f2b-b761-47923828acbd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:27.930512 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9f27edbc-b537-4f2b-b761-47923828acbd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.263863 Aug 04 04:44:27.931115 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 317/622] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:27 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:28.094148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:28.095147 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=10 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:28.152068 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-492530c4-c06e-475c-bffc-fda2f9ffcffd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:28.154997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-492530c4-c06e-475c-bffc-fda2f9ffcffd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:28.156555 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-28e33073-c37a-40cd-8f22-0b119161c12e req-ab9b8f6d-e238-46ce-b76c-d4f414a7fcca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b6588e-407b-44d5-ab86-395074db1c22", "tag": "35f4f9e6-5967-4a03-9893-be7bccc37a83"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:28.161671 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-492530c4-c06e-475c-bffc-fda2f9ffcffd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:28.162225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-492530c4-c06e-475c-bffc-fda2f9ffcffd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:28.163088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-492530c4-c06e-475c-bffc-fda2f9ffcffd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:28.164008 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-492530c4-c06e-475c-bffc-fda2f9ffcffd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:28.166982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-28e33073-c37a-40cd-8f22-0b119161c12e req-ab9b8f6d-e238-46ce-b76c-d4f414a7fcca service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:28.167438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-28e33073-c37a-40cd-8f22-0b119161c12e req-ab9b8f6d-e238-46ce-b76c-d4f414a7fcca service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:28.179769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-28e33073-c37a-40cd-8f22-0b119161c12e req-ab9b8f6d-e238-46ce-b76c-d4f414a7fcca service nova] Creating event network-changed:35f4f9e6-5967-4a03-9893-be7bccc37a83 for instance b1b6588e-407b-44d5-ab86-395074db1c22 on hv-cinder-85127 Aug 04 04:44:28.186150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-28e33073-c37a-40cd-8f22-0b119161c12e req-ab9b8f6d-e238-46ce-b76c-d4f414a7fcca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096811 Aug 04 04:44:28.188746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 306/623] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:28.195631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-492530c4-c06e-475c-bffc-fda2f9ffcffd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047380 Aug 04 04:44:28.196463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 318/624] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:28 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:28.956189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4a731f58-9418-4ce9-af60-cea29e270b08 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:28.956909 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4a731f58-9418-4ce9-af60-cea29e270b08 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:28.964118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4a731f58-9418-4ce9-af60-cea29e270b08 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:28.964118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4a731f58-9418-4ce9-af60-cea29e270b08 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:28.964554 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4a731f58-9418-4ce9-af60-cea29e270b08 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:28.965195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4a731f58-9418-4ce9-af60-cea29e270b08 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:28.970017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:29.110539 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4a731f58-9418-4ce9-af60-cea29e270b08 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:29.118943 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4a731f58-9418-4ce9-af60-cea29e270b08 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.167026 Aug 04 04:44:29.119739 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 307/625] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:28 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:29.209462 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-44bda958-547a-4579-8df8-bf3d27193ba9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:29.211923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-44bda958-547a-4579-8df8-bf3d27193ba9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:29.218324 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44bda958-547a-4579-8df8-bf3d27193ba9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:29.218775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44bda958-547a-4579-8df8-bf3d27193ba9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:29.219566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44bda958-547a-4579-8df8-bf3d27193ba9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:29.220003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44bda958-547a-4579-8df8-bf3d27193ba9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:29.252702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-44bda958-547a-4579-8df8-bf3d27193ba9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048053 Aug 04 04:44:29.253270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 319/626] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:29 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:30.140484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0174771c-e518-4dba-b17c-71885f179c52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:30.141108 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0174771c-e518-4dba-b17c-71885f179c52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:30.147725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0174771c-e518-4dba-b17c-71885f179c52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:30.148170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0174771c-e518-4dba-b17c-71885f179c52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:30.148930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0174771c-e518-4dba-b17c-71885f179c52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:30.149359 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0174771c-e518-4dba-b17c-71885f179c52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:30.265010 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3ee6b2ac-0a53-4f79-80c1-47c51071e85f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:30.267209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3ee6b2ac-0a53-4f79-80c1-47c51071e85f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:30.274409 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ee6b2ac-0a53-4f79-80c1-47c51071e85f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:30.274976 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ee6b2ac-0a53-4f79-80c1-47c51071e85f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:30.275767 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ee6b2ac-0a53-4f79-80c1-47c51071e85f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:30.276206 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ee6b2ac-0a53-4f79-80c1-47c51071e85f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:30.289515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0174771c-e518-4dba-b17c-71885f179c52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:30.298425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0174771c-e518-4dba-b17c-71885f179c52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.161971 Aug 04 04:44:30.299194 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 308/627] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:30 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:30.309991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3ee6b2ac-0a53-4f79-80c1-47c51071e85f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049197 Aug 04 04:44:30.310572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 320/628] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:30 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:44:31.320177 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f5e40f5e-6bdc-4980-96c1-8f43748f90e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:31.320881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f5e40f5e-6bdc-4980-96c1-8f43748f90e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:31.322007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f8131e69-af8e-4201-90e4-0d34bd0c6624 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:31.325063 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f8131e69-af8e-4201-90e4-0d34bd0c6624 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:31.328577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f5e40f5e-6bdc-4980-96c1-8f43748f90e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:31.329031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f5e40f5e-6bdc-4980-96c1-8f43748f90e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:31.329835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f5e40f5e-6bdc-4980-96c1-8f43748f90e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:31.330268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f5e40f5e-6bdc-4980-96c1-8f43748f90e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:31.331990 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8131e69-af8e-4201-90e4-0d34bd0c6624 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:31.332437 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8131e69-af8e-4201-90e4-0d34bd0c6624 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:31.333209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8131e69-af8e-4201-90e4-0d34bd0c6624 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:31.333692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8131e69-af8e-4201-90e4-0d34bd0c6624 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:31.351839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:31.367061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f8131e69-af8e-4201-90e4-0d34bd0c6624 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049157 Aug 04 04:44:31.367706 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 321/629] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:31 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:44:31.475582 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f5e40f5e-6bdc-4980-96c1-8f43748f90e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:31.484592 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f5e40f5e-6bdc-4980-96c1-8f43748f90e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.168464 Aug 04 04:44:31.485170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 309/630] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:31 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:32.380352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ca06d5ab-7d30-4638-898c-33e50b2613fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:32.382517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ca06d5ab-7d30-4638-898c-33e50b2613fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:32.390087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ca06d5ab-7d30-4638-898c-33e50b2613fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:32.390540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ca06d5ab-7d30-4638-898c-33e50b2613fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:32.391324 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ca06d5ab-7d30-4638-898c-33e50b2613fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:32.391760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ca06d5ab-7d30-4638-898c-33e50b2613fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:32.424058 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ca06d5ab-7d30-4638-898c-33e50b2613fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047611 Aug 04 04:44:32.424674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 322/631] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:32 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:44:32.505896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0b8eeb0b-079a-4b04-a6d9-aa19a1b970b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:32.506938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0b8eeb0b-079a-4b04-a6d9-aa19a1b970b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:32.514144 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0b8eeb0b-079a-4b04-a6d9-aa19a1b970b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:32.514820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0b8eeb0b-079a-4b04-a6d9-aa19a1b970b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:32.515716 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0b8eeb0b-079a-4b04-a6d9-aa19a1b970b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:32.516154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0b8eeb0b-079a-4b04-a6d9-aa19a1b970b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:32.661504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0b8eeb0b-079a-4b04-a6d9-aa19a1b970b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:32.670053 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0b8eeb0b-079a-4b04-a6d9-aa19a1b970b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.167887 Aug 04 04:44:32.670634 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 310/632] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:32 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:33.436540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f8226626-9d62-41aa-9341-80691fb01d91 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:33.438705 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f8226626-9d62-41aa-9341-80691fb01d91 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:33.445278 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8226626-9d62-41aa-9341-80691fb01d91 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:33.445782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8226626-9d62-41aa-9341-80691fb01d91 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:33.446549 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8226626-9d62-41aa-9341-80691fb01d91 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:33.446985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8226626-9d62-41aa-9341-80691fb01d91 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:33.483743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f8226626-9d62-41aa-9341-80691fb01d91 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051057 Aug 04 04:44:33.484228 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 323/633] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:33 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:33.692623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cb5d2c2e-ce28-42fe-98f9-915a0436fc89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:33.693382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cb5d2c2e-ce28-42fe-98f9-915a0436fc89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:33.701101 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb5d2c2e-ce28-42fe-98f9-915a0436fc89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:33.701572 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb5d2c2e-ce28-42fe-98f9-915a0436fc89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:33.702340 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb5d2c2e-ce28-42fe-98f9-915a0436fc89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:33.702774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb5d2c2e-ce28-42fe-98f9-915a0436fc89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:33.843525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-cb5d2c2e-ce28-42fe-98f9-915a0436fc89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:33.851559 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cb5d2c2e-ce28-42fe-98f9-915a0436fc89 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1716 microversion: 2.1 time: 0.164265 Aug 04 04:44:33.852124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 311/634] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:33 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1716 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:33.968444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-344b2906-760d-4c2f-819a-d26d48424065 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:33.969042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-344b2906-760d-4c2f-819a-d26d48424065 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:33.975363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-344b2906-760d-4c2f-819a-d26d48424065 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:33.975821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-344b2906-760d-4c2f-819a-d26d48424065 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:33.976602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-344b2906-760d-4c2f-819a-d26d48424065 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:33.977044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-344b2906-760d-4c2f-819a-d26d48424065 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:34.064472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-344b2906-760d-4c2f-819a-d26d48424065 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] HTTP exception thrown: Cannot 'detach_volume' instance a7ee17d5-d905-461c-95ff-9588447cc943 while it is in vm_state rescued Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-344b2906-760d-4c2f-819a-d26d48424065 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Request method failure captured: Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: DELETE /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments/a9fe92c6-0cd5-4edd-9622-790e8befdda9 HTTP/1.1 Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi602uPptuqgFy02y-YzHoVclj5Hq7_LkNXMBvqUC5pmyegtWcMpw0F-pJKdartgmkAfmDd6OJ6hXCBM-pb0p815YHMVq5KwB3Coc6cqRFibtNHQXOz8y91Enyk9viUVHGfYG4BP1_AVa5Ew_ePDyW5iQqlyKdaV2k_FR1A3vcY5g3BfI Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: e43171bfd4564b0c92395767641b91ce Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1508178778 Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:44:34.066135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:44:34.067667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e43171bfd4564b0c92395767641b91ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e43171bfd4564b0c92395767641b91ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e43171bfd4564b0c92395767641b91ce", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e43171bfd4564b0c92395767641b91ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:44:34.067667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1508178778 Aug 04 04:44:34.067667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: e43171bfd4564b0c92395767641b91ce Aug 04 04:44:34.067667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1508178778 Aug 04 04:44:34.067667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-ServerRescueNegativeTestJSON-1508178778-project Aug 04 04:44:34.067667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:44:34.067667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:44:34.067667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 40a2cbbc654749199e742ae96329a1d9 Aug 04 04:44:34.067667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1508178778-project Aug 04 04:44:34.067667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 04:44:34.067667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Cannot 'detach_volume' instance a7ee17d5-d905-461c-95ff-9588447cc943 while it is in vm_state rescued Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'server_id': 'a7ee17d5-d905-461c-95ff-9588447cc943', 'id': 'a9fe92c6-0cd5-4edd-9622-790e8befdda9'} Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a7ee17d5-d905-461c-95ff-9588447cc943 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:44:34.068566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a7ee17d5-d905-461c-95ff-9588447cc943 while it is in vm_state rescued Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a7ee17d5-d905-461c-95ff-9588447cc943 while it is in vm_state rescued Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:44:34.069997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-344b2906-760d-4c2f-819a-d26d48424065 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Returning 409 to user: Cannot 'detach_volume' instance a7ee17d5-d905-461c-95ff-9588447cc943 while it is in vm_state rescued {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:44:34.071027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-344b2906-760d-4c2f-819a-d26d48424065 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments/a9fe92c6-0cd5-4edd-9622-790e8befdda9" status: 409 len: 152 microversion: 2.1 time: 0.103985 Aug 04 04:44:34.071027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 324/635] 10.222.0.47 () {58 vars in 1416 bytes} [Thu Aug 4 04:44:33 2022] DELETE /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments/a9fe92c6-0cd5-4edd-9622-790e8befdda9 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 04:44:34.081766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-15de463f-a73f-48fc-986a-3b35876797c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:34.081766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-15de463f-a73f-48fc-986a-3b35876797c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:34.083791 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-15de463f-a73f-48fc-986a-3b35876797c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:34.084252 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-15de463f-a73f-48fc-986a-3b35876797c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:34.085032 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-15de463f-a73f-48fc-986a-3b35876797c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:34.085481 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-15de463f-a73f-48fc-986a-3b35876797c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:34.164344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-15de463f-a73f-48fc-986a-3b35876797c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "POST /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/action" status: 202 len: 0 microversion: 2.1 time: 0.091102 Aug 04 04:44:34.164993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 312/636] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:44:34 2022] POST /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:44:34.174061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e9e89035-c714-4853-8683-6719f955c0a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:34.174716 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e9e89035-c714-4853-8683-6719f955c0a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:34.183376 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e9e89035-c714-4853-8683-6719f955c0a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:34.183888 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e9e89035-c714-4853-8683-6719f955c0a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:34.184702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e9e89035-c714-4853-8683-6719f955c0a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:34.185167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e9e89035-c714-4853-8683-6719f955c0a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:34.338821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e9e89035-c714-4853-8683-6719f955c0a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:34.347787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e9e89035-c714-4853-8683-6719f955c0a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1724 microversion: 2.1 time: 0.177567 Aug 04 04:44:34.348365 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 325/637] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:34 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:34.499627 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-89cd4bdf-b3f4-49de-b22a-08cfd1e0b268 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:34.502076 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-89cd4bdf-b3f4-49de-b22a-08cfd1e0b268 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:34.508721 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89cd4bdf-b3f4-49de-b22a-08cfd1e0b268 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:34.509187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89cd4bdf-b3f4-49de-b22a-08cfd1e0b268 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:34.510004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89cd4bdf-b3f4-49de-b22a-08cfd1e0b268 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:34.510626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89cd4bdf-b3f4-49de-b22a-08cfd1e0b268 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:34.543480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-89cd4bdf-b3f4-49de-b22a-08cfd1e0b268 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048214 Aug 04 04:44:34.544434 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 313/638] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:34 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:35.368301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c3f189ea-7a8b-4a13-81c4-cfda67dec63d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:35.368914 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c3f189ea-7a8b-4a13-81c4-cfda67dec63d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:35.376509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c3f189ea-7a8b-4a13-81c4-cfda67dec63d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:35.376956 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c3f189ea-7a8b-4a13-81c4-cfda67dec63d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:35.377762 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c3f189ea-7a8b-4a13-81c4-cfda67dec63d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:35.378208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c3f189ea-7a8b-4a13-81c4-cfda67dec63d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:35.517927 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c3f189ea-7a8b-4a13-81c4-cfda67dec63d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:35.526007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c3f189ea-7a8b-4a13-81c4-cfda67dec63d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1724 microversion: 2.1 time: 0.161496 Aug 04 04:44:35.526578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 326/639] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:35 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:35.555801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d482b6b0-e19f-4107-866e-053490758a64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:35.558023 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d482b6b0-e19f-4107-866e-053490758a64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:35.564821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d482b6b0-e19f-4107-866e-053490758a64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:35.565276 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d482b6b0-e19f-4107-866e-053490758a64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:35.566088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d482b6b0-e19f-4107-866e-053490758a64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:35.566529 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d482b6b0-e19f-4107-866e-053490758a64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:35.596522 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d482b6b0-e19f-4107-866e-053490758a64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Aug 04 04:44:35.597102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 314/640] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:35 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:36.548032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-77a36d54-14ad-4e7b-a062-40fcd5faeb4e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:36.548650 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-77a36d54-14ad-4e7b-a062-40fcd5faeb4e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:36.555311 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77a36d54-14ad-4e7b-a062-40fcd5faeb4e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:36.555848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77a36d54-14ad-4e7b-a062-40fcd5faeb4e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:36.556534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77a36d54-14ad-4e7b-a062-40fcd5faeb4e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:36.556972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77a36d54-14ad-4e7b-a062-40fcd5faeb4e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:36.613023 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-43fb60c5-d348-4441-bebd-070be9d159d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:36.615437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-43fb60c5-d348-4441-bebd-070be9d159d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:36.625421 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-43fb60c5-d348-4441-bebd-070be9d159d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:36.626344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-43fb60c5-d348-4441-bebd-070be9d159d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:36.627719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-43fb60c5-d348-4441-bebd-070be9d159d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:36.628430 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-43fb60c5-d348-4441-bebd-070be9d159d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:36.663177 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-43fb60c5-d348-4441-bebd-070be9d159d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054862 Aug 04 04:44:36.664211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 315/641] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:36 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:36.704298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-77a36d54-14ad-4e7b-a062-40fcd5faeb4e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:36.714381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-77a36d54-14ad-4e7b-a062-40fcd5faeb4e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1724 microversion: 2.1 time: 0.169813 Aug 04 04:44:36.715470 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 327/642] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:36 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:37.678410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-811a2930-6a59-4220-b26b-129f39bd46ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:37.681266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-811a2930-6a59-4220-b26b-129f39bd46ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:37.688511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-811a2930-6a59-4220-b26b-129f39bd46ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:37.688957 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-811a2930-6a59-4220-b26b-129f39bd46ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:37.690317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-811a2930-6a59-4220-b26b-129f39bd46ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:37.690317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-811a2930-6a59-4220-b26b-129f39bd46ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:37.722177 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-811a2930-6a59-4220-b26b-129f39bd46ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047408 Aug 04 04:44:37.722429 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 316/643] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:37 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:37.737116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-862d2137-4d5a-4f99-b842-46c8e7cc4e65 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:37.737765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-862d2137-4d5a-4f99-b842-46c8e7cc4e65 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:37.747293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-862d2137-4d5a-4f99-b842-46c8e7cc4e65 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:37.747977 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-862d2137-4d5a-4f99-b842-46c8e7cc4e65 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:37.748778 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-862d2137-4d5a-4f99-b842-46c8e7cc4e65 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:37.749210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-862d2137-4d5a-4f99-b842-46c8e7cc4e65 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:37.892242 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-862d2137-4d5a-4f99-b842-46c8e7cc4e65 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:44:37.900351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-862d2137-4d5a-4f99-b842-46c8e7cc4e65 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1730 microversion: 2.1 time: 0.167023 Aug 04 04:44:37.900923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 328/644] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:44:37 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:44:37.922433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7ba2f3d1-2200-4b07-87d3-18fc3428d337 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:37.922941 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7ba2f3d1-2200-4b07-87d3-18fc3428d337 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:37.924905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:37.930411 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ba2f3d1-2200-4b07-87d3-18fc3428d337 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:37.930803 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ba2f3d1-2200-4b07-87d3-18fc3428d337 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:37.931588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ba2f3d1-2200-4b07-87d3-18fc3428d337 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:37.932030 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ba2f3d1-2200-4b07-87d3-18fc3428d337 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:38.014915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7ba2f3d1-2200-4b07-87d3-18fc3428d337 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096953 Aug 04 04:44:38.015524 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 317/645] 10.222.0.47 () {58 vars in 1275 bytes} [Thu Aug 4 04:44:37 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:38.734901 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-47867d42-a90d-4a4d-b048-748eb21a416e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:38.737222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-47867d42-a90d-4a4d-b048-748eb21a416e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:38.744615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47867d42-a90d-4a4d-b048-748eb21a416e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:38.745056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47867d42-a90d-4a4d-b048-748eb21a416e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:38.746491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47867d42-a90d-4a4d-b048-748eb21a416e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:38.746966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47867d42-a90d-4a4d-b048-748eb21a416e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:38.780311 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-47867d42-a90d-4a4d-b048-748eb21a416e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049320 Aug 04 04:44:38.781199 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 329/646] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:38 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:39.183604 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-b0d04ae7-1dd7-46c0-a6dc-d158d76cf222 req-c1680a1c-dc91-45de-9d81-47870bb0ede0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7ee17d5-d905-461c-95ff-9588447cc943", "tag": "ca3160b8-9bcf-4d31-a9a6-db749330c679"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:39.193443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-b0d04ae7-1dd7-46c0-a6dc-d158d76cf222 req-c1680a1c-dc91-45de-9d81-47870bb0ede0 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:39.193989 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-b0d04ae7-1dd7-46c0-a6dc-d158d76cf222 req-c1680a1c-dc91-45de-9d81-47870bb0ede0 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:39.211671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-b0d04ae7-1dd7-46c0-a6dc-d158d76cf222 req-c1680a1c-dc91-45de-9d81-47870bb0ede0 service nova] Creating event network-changed:ca3160b8-9bcf-4d31-a9a6-db749330c679 for instance a7ee17d5-d905-461c-95ff-9588447cc943 on hv-cinder-85127 Aug 04 04:44:39.217777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-b0d04ae7-1dd7-46c0-a6dc-d158d76cf222 req-c1680a1c-dc91-45de-9d81-47870bb0ede0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038381 Aug 04 04:44:39.218448 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 318/647] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:44:39.795021 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c975aa89-2791-4d11-b1d1-2706f29aeb61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:39.797288 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c975aa89-2791-4d11-b1d1-2706f29aeb61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:39.805138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c975aa89-2791-4d11-b1d1-2706f29aeb61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:39.805615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c975aa89-2791-4d11-b1d1-2706f29aeb61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:39.806410 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c975aa89-2791-4d11-b1d1-2706f29aeb61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:39.806849 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c975aa89-2791-4d11-b1d1-2706f29aeb61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:39.838392 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c975aa89-2791-4d11-b1d1-2706f29aeb61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048024 Aug 04 04:44:39.838967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 330/648] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:40.852300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8acaa053-871f-4ef7-a560-3bfd95c2b4f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:40.854628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8acaa053-871f-4ef7-a560-3bfd95c2b4f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:40.860935 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8acaa053-871f-4ef7-a560-3bfd95c2b4f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:40.861387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8acaa053-871f-4ef7-a560-3bfd95c2b4f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:40.862177 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8acaa053-871f-4ef7-a560-3bfd95c2b4f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:40.862612 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8acaa053-871f-4ef7-a560-3bfd95c2b4f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:40.893600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8acaa053-871f-4ef7-a560-3bfd95c2b4f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046025 Aug 04 04:44:40.894170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 319/649] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:40 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:41.233169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-6d650827-44a6-4ad5-80fa-193cbe202dea req-beafd2bc-264e-4141-82d8-5d784b6f1b2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7ee17d5-d905-461c-95ff-9588447cc943", "tag": "ca3160b8-9bcf-4d31-a9a6-db749330c679"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:44:41.237944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:41.243833 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-6d650827-44a6-4ad5-80fa-193cbe202dea req-beafd2bc-264e-4141-82d8-5d784b6f1b2a service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:41.244298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-6d650827-44a6-4ad5-80fa-193cbe202dea req-beafd2bc-264e-4141-82d8-5d784b6f1b2a service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:41.257792 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-6d650827-44a6-4ad5-80fa-193cbe202dea req-beafd2bc-264e-4141-82d8-5d784b6f1b2a service nova] Creating event network-changed:ca3160b8-9bcf-4d31-a9a6-db749330c679 for instance a7ee17d5-d905-461c-95ff-9588447cc943 on hv-cinder-85127 Aug 04 04:44:41.263454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-6d650827-44a6-4ad5-80fa-193cbe202dea req-beafd2bc-264e-4141-82d8-5d784b6f1b2a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034897 Aug 04 04:44:41.264232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 331/650] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:41.906790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-da049198-9ffc-400d-bd02-2dcb23616a56 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:41.909056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-da049198-9ffc-400d-bd02-2dcb23616a56 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:41.915678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-da049198-9ffc-400d-bd02-2dcb23616a56 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:41.916134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-da049198-9ffc-400d-bd02-2dcb23616a56 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:41.918637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-da049198-9ffc-400d-bd02-2dcb23616a56 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:41.918637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-da049198-9ffc-400d-bd02-2dcb23616a56 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:41.947312 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-da049198-9ffc-400d-bd02-2dcb23616a56 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044659 Aug 04 04:44:41.949905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 320/651] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:41 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:42.960550 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-27a5ce5b-3b93-4fa9-8487-6b289157dbe8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:42.962825 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-27a5ce5b-3b93-4fa9-8487-6b289157dbe8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:42.970465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27a5ce5b-3b93-4fa9-8487-6b289157dbe8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:42.970910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27a5ce5b-3b93-4fa9-8487-6b289157dbe8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:42.971684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27a5ce5b-3b93-4fa9-8487-6b289157dbe8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:42.972117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27a5ce5b-3b93-4fa9-8487-6b289157dbe8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:43.001510 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-27a5ce5b-3b93-4fa9-8487-6b289157dbe8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Aug 04 04:44:43.001645 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 332/652] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:42 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:44.012995 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-aa8f30b7-18ba-4aac-8529-2877540e8312 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:44.015158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-aa8f30b7-18ba-4aac-8529-2877540e8312 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:44.021875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa8f30b7-18ba-4aac-8529-2877540e8312 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:44.022327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa8f30b7-18ba-4aac-8529-2877540e8312 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:44.023099 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa8f30b7-18ba-4aac-8529-2877540e8312 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:44.023535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa8f30b7-18ba-4aac-8529-2877540e8312 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:44.055471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-aa8f30b7-18ba-4aac-8529-2877540e8312 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046903 Aug 04 04:44:44.056047 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 321/653] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:44 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:45.075862 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-de109e62-09a4-4c19-8572-4a63df8b2524 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:45.078062 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-de109e62-09a4-4c19-8572-4a63df8b2524 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:45.084632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de109e62-09a4-4c19-8572-4a63df8b2524 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:45.085072 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de109e62-09a4-4c19-8572-4a63df8b2524 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:45.085898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de109e62-09a4-4c19-8572-4a63df8b2524 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:45.086334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de109e62-09a4-4c19-8572-4a63df8b2524 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:45.118858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-de109e62-09a4-4c19-8572-4a63df8b2524 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047047 Aug 04 04:44:45.119420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 333/654] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:45 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:46.131695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6d16a0f2-dd10-40dc-96e4-f8f70c5889c3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:46.133851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6d16a0f2-dd10-40dc-96e4-f8f70c5889c3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:46.141458 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6d16a0f2-dd10-40dc-96e4-f8f70c5889c3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:46.141944 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6d16a0f2-dd10-40dc-96e4-f8f70c5889c3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:46.142746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6d16a0f2-dd10-40dc-96e4-f8f70c5889c3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:46.143187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6d16a0f2-dd10-40dc-96e4-f8f70c5889c3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:46.173796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6d16a0f2-dd10-40dc-96e4-f8f70c5889c3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045980 Aug 04 04:44:46.174379 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 322/655] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:46 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:47.186410 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-327ac1e7-725c-4f37-b78f-87c1ae416563 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:47.188536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-327ac1e7-725c-4f37-b78f-87c1ae416563 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:47.195411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-327ac1e7-725c-4f37-b78f-87c1ae416563 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:47.195878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-327ac1e7-725c-4f37-b78f-87c1ae416563 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:47.196629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-327ac1e7-725c-4f37-b78f-87c1ae416563 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:47.197068 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-327ac1e7-725c-4f37-b78f-87c1ae416563 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:47.227985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-327ac1e7-725c-4f37-b78f-87c1ae416563 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 Aug 04 04:44:47.228552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 334/656] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:47 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:48.240635 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-aeb935bc-4213-49ca-a267-0fe1e39fd0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:48.242803 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-aeb935bc-4213-49ca-a267-0fe1e39fd0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:48.249861 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aeb935bc-4213-49ca-a267-0fe1e39fd0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:48.250312 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aeb935bc-4213-49ca-a267-0fe1e39fd0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:48.251074 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aeb935bc-4213-49ca-a267-0fe1e39fd0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:48.251507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aeb935bc-4213-49ca-a267-0fe1e39fd0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:48.279230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:48.285369 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-aeb935bc-4213-49ca-a267-0fe1e39fd0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048606 Aug 04 04:44:48.285969 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 323/657] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:48 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:49.298920 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ecefbd18-9367-4aec-8f74-c5837a5ac81d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:49.301067 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ecefbd18-9367-4aec-8f74-c5837a5ac81d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:49.308464 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ecefbd18-9367-4aec-8f74-c5837a5ac81d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:49.308918 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ecefbd18-9367-4aec-8f74-c5837a5ac81d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:49.309745 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ecefbd18-9367-4aec-8f74-c5837a5ac81d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:49.310186 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ecefbd18-9367-4aec-8f74-c5837a5ac81d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:49.340948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ecefbd18-9367-4aec-8f74-c5837a5ac81d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Aug 04 04:44:49.341526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 335/658] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:49 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:44:50.354179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-71b80822-b4a4-400d-9857-6539a922ee07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:50.357031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-71b80822-b4a4-400d-9857-6539a922ee07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:50.364881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-71b80822-b4a4-400d-9857-6539a922ee07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:50.365327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-71b80822-b4a4-400d-9857-6539a922ee07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:50.366127 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-71b80822-b4a4-400d-9857-6539a922ee07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:50.366557 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-71b80822-b4a4-400d-9857-6539a922ee07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:50.396037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-71b80822-b4a4-400d-9857-6539a922ee07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046484 Aug 04 04:44:50.396641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 324/659] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:50 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:51.408527 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b50fbbd6-dd29-4dad-a89e-6f8ccda00590 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:51.410733 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b50fbbd6-dd29-4dad-a89e-6f8ccda00590 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:51.417712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b50fbbd6-dd29-4dad-a89e-6f8ccda00590 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:51.418165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b50fbbd6-dd29-4dad-a89e-6f8ccda00590 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:51.418939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b50fbbd6-dd29-4dad-a89e-6f8ccda00590 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:51.419368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b50fbbd6-dd29-4dad-a89e-6f8ccda00590 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:51.459275 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b50fbbd6-dd29-4dad-a89e-6f8ccda00590 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054313 Aug 04 04:44:51.460348 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 336/660] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:51 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:52.472145 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eb6898e8-6739-4e88-9765-e30d2425aeb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:52.474235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eb6898e8-6739-4e88-9765-e30d2425aeb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:52.481154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb6898e8-6739-4e88-9765-e30d2425aeb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:52.481626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb6898e8-6739-4e88-9765-e30d2425aeb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:52.482413 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb6898e8-6739-4e88-9765-e30d2425aeb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:52.482931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb6898e8-6739-4e88-9765-e30d2425aeb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:52.515755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eb6898e8-6739-4e88-9765-e30d2425aeb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047498 Aug 04 04:44:52.516487 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 325/661] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:52 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:53.529636 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-61f13a74-8dfe-43b0-99b5-33423dc2627d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:53.531783 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-61f13a74-8dfe-43b0-99b5-33423dc2627d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:53.538610 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-61f13a74-8dfe-43b0-99b5-33423dc2627d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:53.539056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-61f13a74-8dfe-43b0-99b5-33423dc2627d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:53.540070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-61f13a74-8dfe-43b0-99b5-33423dc2627d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:53.540345 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-61f13a74-8dfe-43b0-99b5-33423dc2627d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:53.571806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-61f13a74-8dfe-43b0-99b5-33423dc2627d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047174 Aug 04 04:44:53.572372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 337/662] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:53 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:54.584041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f7b4e340-b107-426d-ae06-825b2fd75fb7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:54.586113 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f7b4e340-b107-426d-ae06-825b2fd75fb7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:54.593112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7b4e340-b107-426d-ae06-825b2fd75fb7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:54.593584 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7b4e340-b107-426d-ae06-825b2fd75fb7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:54.594348 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7b4e340-b107-426d-ae06-825b2fd75fb7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:54.594782 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7b4e340-b107-426d-ae06-825b2fd75fb7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:54.625590 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f7b4e340-b107-426d-ae06-825b2fd75fb7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045503 Aug 04 04:44:54.626163 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 326/663] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:54 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:44:55.638277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-27320e94-70d7-44c7-a7da-37fc1c554533 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:55.640368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-27320e94-70d7-44c7-a7da-37fc1c554533 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:55.646966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27320e94-70d7-44c7-a7da-37fc1c554533 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:55.647407 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27320e94-70d7-44c7-a7da-37fc1c554533 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:55.648172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27320e94-70d7-44c7-a7da-37fc1c554533 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:55.648601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27320e94-70d7-44c7-a7da-37fc1c554533 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:55.674878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:55.680411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-27320e94-70d7-44c7-a7da-37fc1c554533 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046182 Aug 04 04:44:55.680983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 338/664] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:55 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:56.692805 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-656a1a52-5210-4620-9e1c-3de05adaa12d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:56.694880 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-656a1a52-5210-4620-9e1c-3de05adaa12d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:56.702262 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-656a1a52-5210-4620-9e1c-3de05adaa12d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:56.708826 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-656a1a52-5210-4620-9e1c-3de05adaa12d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:56.708826 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-656a1a52-5210-4620-9e1c-3de05adaa12d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:56.708826 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-656a1a52-5210-4620-9e1c-3de05adaa12d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:56.734330 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-656a1a52-5210-4620-9e1c-3de05adaa12d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045429 Aug 04 04:44:56.734899 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 327/665] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:56 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:57.747936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a8d3dd45-68ec-491e-b50f-1902c61fb68a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:57.750030 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a8d3dd45-68ec-491e-b50f-1902c61fb68a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:57.756662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a8d3dd45-68ec-491e-b50f-1902c61fb68a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:57.757106 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a8d3dd45-68ec-491e-b50f-1902c61fb68a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:57.757899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a8d3dd45-68ec-491e-b50f-1902c61fb68a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:57.758332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a8d3dd45-68ec-491e-b50f-1902c61fb68a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:57.787132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a8d3dd45-68ec-491e-b50f-1902c61fb68a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044268 Aug 04 04:44:57.787690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 339/666] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:57 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:44:58.800316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ed2f5a18-46a2-4465-a8cf-21c2d5c1d3ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:58.802478 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ed2f5a18-46a2-4465-a8cf-21c2d5c1d3ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:58.810023 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ed2f5a18-46a2-4465-a8cf-21c2d5c1d3ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:58.810476 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ed2f5a18-46a2-4465-a8cf-21c2d5c1d3ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:58.811251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ed2f5a18-46a2-4465-a8cf-21c2d5c1d3ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:58.811693 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ed2f5a18-46a2-4465-a8cf-21c2d5c1d3ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:58.842042 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ed2f5a18-46a2-4465-a8cf-21c2d5c1d3ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Aug 04 04:44:58.842610 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 328/667] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:58 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:44:59.854918 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9a8e50e4-c724-4c6d-aafc-a57c4e110de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:44:59.857439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9a8e50e4-c724-4c6d-aafc-a57c4e110de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:44:59.864073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a8e50e4-c724-4c6d-aafc-a57c4e110de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:59.864528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a8e50e4-c724-4c6d-aafc-a57c4e110de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:59.865296 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a8e50e4-c724-4c6d-aafc-a57c4e110de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:44:59.865828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a8e50e4-c724-4c6d-aafc-a57c4e110de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:44:59.898495 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9a8e50e4-c724-4c6d-aafc-a57c4e110de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048267 Aug 04 04:44:59.899063 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 340/668] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:44:59 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:00.911467 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bf00a9dc-492a-4fdb-b885-5f7d2906cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:00.913911 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-bf00a9dc-492a-4fdb-b885-5f7d2906cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:00.920685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bf00a9dc-492a-4fdb-b885-5f7d2906cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:00.921129 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bf00a9dc-492a-4fdb-b885-5f7d2906cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:00.921921 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bf00a9dc-492a-4fdb-b885-5f7d2906cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:00.922356 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bf00a9dc-492a-4fdb-b885-5f7d2906cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:00.953340 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-bf00a9dc-492a-4fdb-b885-5f7d2906cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045812 Aug 04 04:45:00.953936 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 329/669] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:00 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:01.967287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-be5f8d2b-4925-44c5-9f8c-8c60cc8b549a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:01.969428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-be5f8d2b-4925-44c5-9f8c-8c60cc8b549a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:01.976128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-be5f8d2b-4925-44c5-9f8c-8c60cc8b549a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:01.976578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-be5f8d2b-4925-44c5-9f8c-8c60cc8b549a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:01.977350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-be5f8d2b-4925-44c5-9f8c-8c60cc8b549a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:01.977877 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-be5f8d2b-4925-44c5-9f8c-8c60cc8b549a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:02.010516 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-be5f8d2b-4925-44c5-9f8c-8c60cc8b549a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047306 Aug 04 04:45:02.011455 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 341/670] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:01 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:03.022667 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a9fbade5-3d89-448c-8428-3d9c432976ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:03.024735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a9fbade5-3d89-448c-8428-3d9c432976ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:03.031913 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a9fbade5-3d89-448c-8428-3d9c432976ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:03.032362 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a9fbade5-3d89-448c-8428-3d9c432976ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:03.033126 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a9fbade5-3d89-448c-8428-3d9c432976ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:03.033571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a9fbade5-3d89-448c-8428-3d9c432976ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:03.064228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a9fbade5-3d89-448c-8428-3d9c432976ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045482 Aug 04 04:45:03.064802 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 330/671] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:03 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:04.077106 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fdf1ec38-1211-40e0-a608-05d90603f401 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:04.079283 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fdf1ec38-1211-40e0-a608-05d90603f401 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:04.086020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fdf1ec38-1211-40e0-a608-05d90603f401 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:04.086471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fdf1ec38-1211-40e0-a608-05d90603f401 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:04.087247 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fdf1ec38-1211-40e0-a608-05d90603f401 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:04.088185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fdf1ec38-1211-40e0-a608-05d90603f401 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:04.098799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-65c1cb36-51ca-4d60-a4ad-0fce47c864ca tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:04.099416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-65c1cb36-51ca-4d60-a4ad-0fce47c864ca tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:04.106888 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-65c1cb36-51ca-4d60-a4ad-0fce47c864ca tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:04.107340 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-65c1cb36-51ca-4d60-a4ad-0fce47c864ca tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:04.108119 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-65c1cb36-51ca-4d60-a4ad-0fce47c864ca tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:04.108569 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-65c1cb36-51ca-4d60-a4ad-0fce47c864ca tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:04.119890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fdf1ec38-1211-40e0-a608-05d90603f401 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046266 Aug 04 04:45:04.120547 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 342/672] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:04 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:04.133315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-65c1cb36-51ca-4d60-a4ad-0fce47c864ca tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22/ips" status: 200 len: 143 microversion: 2.1 time: 0.038388 Aug 04 04:45:04.133918 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 331/673] 10.222.0.47 () {58 vars in 1248 bytes} [Thu Aug 4 04:45:04 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22/ips => generated 143 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:45:05.131775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-16ef1c94-47ba-496f-b8d9-da37517bff24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:05.135081 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-16ef1c94-47ba-496f-b8d9-da37517bff24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:05.142185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-16ef1c94-47ba-496f-b8d9-da37517bff24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:05.142635 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-16ef1c94-47ba-496f-b8d9-da37517bff24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:05.143420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-16ef1c94-47ba-496f-b8d9-da37517bff24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:05.143859 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-16ef1c94-47ba-496f-b8d9-da37517bff24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:05.174537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-16ef1c94-47ba-496f-b8d9-da37517bff24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046745 Aug 04 04:45:05.175126 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 343/674] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:05 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:06.188501 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dab56dd3-2661-4796-ac05-2f07f8630e1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:06.190794 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dab56dd3-2661-4796-ac05-2f07f8630e1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:06.197800 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dab56dd3-2661-4796-ac05-2f07f8630e1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:06.198321 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dab56dd3-2661-4796-ac05-2f07f8630e1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:06.199100 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dab56dd3-2661-4796-ac05-2f07f8630e1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:06.199545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dab56dd3-2661-4796-ac05-2f07f8630e1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:06.232317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dab56dd3-2661-4796-ac05-2f07f8630e1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047901 Aug 04 04:45:06.232902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 332/675] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:06 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:07.252662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-062b175b-c32d-41f2-b966-b886c98ab8d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:07.256318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-062b175b-c32d-41f2-b966-b886c98ab8d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:07.265348 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-062b175b-c32d-41f2-b966-b886c98ab8d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:07.267725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-062b175b-c32d-41f2-b966-b886c98ab8d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:07.268562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-062b175b-c32d-41f2-b966-b886c98ab8d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:07.269008 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-062b175b-c32d-41f2-b966-b886c98ab8d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:07.307712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-062b175b-c32d-41f2-b966-b886c98ab8d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062627 Aug 04 04:45:07.313632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 344/676] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:07 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:45:08.321354 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-124d5046-787f-4833-802d-997a5cc7ab30 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:08.324444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-124d5046-787f-4833-802d-997a5cc7ab30 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:08.327338 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=32 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:08.332844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-124d5046-787f-4833-802d-997a5cc7ab30 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:08.333322 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-124d5046-787f-4833-802d-997a5cc7ab30 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:08.334140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-124d5046-787f-4833-802d-997a5cc7ab30 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:08.334584 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-124d5046-787f-4833-802d-997a5cc7ab30 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:08.366490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-124d5046-787f-4833-802d-997a5cc7ab30 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048985 Aug 04 04:45:08.367102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 333/677] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:09.379028 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2d27ea94-4cfa-4e60-9036-3f8e969eca85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:09.381200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2d27ea94-4cfa-4e60-9036-3f8e969eca85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:09.388854 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d27ea94-4cfa-4e60-9036-3f8e969eca85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:09.389301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d27ea94-4cfa-4e60-9036-3f8e969eca85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:09.390107 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d27ea94-4cfa-4e60-9036-3f8e969eca85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:09.390628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d27ea94-4cfa-4e60-9036-3f8e969eca85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:09.422227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2d27ea94-4cfa-4e60-9036-3f8e969eca85 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047101 Aug 04 04:45:09.422822 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 345/678] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:09 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:10.435384 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b6feffc6-298b-4c10-9fde-cbfb9ac92452 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:10.437587 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b6feffc6-298b-4c10-9fde-cbfb9ac92452 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:10.444482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6feffc6-298b-4c10-9fde-cbfb9ac92452 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:10.444933 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6feffc6-298b-4c10-9fde-cbfb9ac92452 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:10.445743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6feffc6-298b-4c10-9fde-cbfb9ac92452 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:10.446179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6feffc6-298b-4c10-9fde-cbfb9ac92452 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:10.478316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b6feffc6-298b-4c10-9fde-cbfb9ac92452 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046929 Aug 04 04:45:10.479305 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 334/679] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:11.414447 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4bb80cb0-55e0-497e-9a65-154e3d76a6c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:11.414991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4bb80cb0-55e0-497e-9a65-154e3d76a6c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:11.417717 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=30 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:11.423076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bb80cb0-55e0-497e-9a65-154e3d76a6c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:11.423529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bb80cb0-55e0-497e-9a65-154e3d76a6c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:11.424330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bb80cb0-55e0-497e-9a65-154e3d76a6c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:11.424759 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bb80cb0-55e0-497e-9a65-154e3d76a6c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:11.491108 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dc94b3f0-5a19-43c0-9156-0826d6a574fd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:11.493249 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dc94b3f0-5a19-43c0-9156-0826d6a574fd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:11.501074 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc94b3f0-5a19-43c0-9156-0826d6a574fd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:11.501536 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc94b3f0-5a19-43c0-9156-0826d6a574fd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:11.502361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc94b3f0-5a19-43c0-9156-0826d6a574fd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:11.502803 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc94b3f0-5a19-43c0-9156-0826d6a574fd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:11.527270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.objects.instance [None req-4bb80cb0-55e0-497e-9a65-154e3d76a6c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lazy-loading 'services' on Instance uuid a7ee17d5-d905-461c-95ff-9588447cc943 {{(pid=134884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:45:11.533859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dc94b3f0-5a19-43c0-9156-0826d6a574fd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046585 Aug 04 04:45:11.534450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 335/680] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:11 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:11.605641 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4bb80cb0-55e0-497e-9a65-154e3d76a6c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments/a9fe92c6-0cd5-4edd-9622-790e8befdda9" status: 202 len: 0 microversion: 2.1 time: 0.195017 Aug 04 04:45:11.606152 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 346/681] 10.222.0.47 () {58 vars in 1416 bytes} [Thu Aug 4 04:45:11 2022] DELETE /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments/a9fe92c6-0cd5-4edd-9622-790e8befdda9 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:45:11.614875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ddc51fa0-2de6-4388-b0f4-2eeeee961b09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:11.617084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ddc51fa0-2de6-4388-b0f4-2eeeee961b09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:11.624628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ddc51fa0-2de6-4388-b0f4-2eeeee961b09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:11.625215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ddc51fa0-2de6-4388-b0f4-2eeeee961b09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:11.626085 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ddc51fa0-2de6-4388-b0f4-2eeeee961b09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:11.626616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ddc51fa0-2de6-4388-b0f4-2eeeee961b09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:11.660441 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ddc51fa0-2de6-4388-b0f4-2eeeee961b09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049598 Aug 04 04:45:11.661011 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 336/682] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:11 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:12.547710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-129feddc-cca5-44ac-82df-e3a5a81c7604 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:12.550078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-129feddc-cca5-44ac-82df-e3a5a81c7604 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:12.557203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-129feddc-cca5-44ac-82df-e3a5a81c7604 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:12.557688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-129feddc-cca5-44ac-82df-e3a5a81c7604 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:12.558479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-129feddc-cca5-44ac-82df-e3a5a81c7604 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:12.558914 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-129feddc-cca5-44ac-82df-e3a5a81c7604 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:12.590775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-129feddc-cca5-44ac-82df-e3a5a81c7604 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047917 Aug 04 04:45:12.591354 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 347/683] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:12 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:12.672830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d3185791-1ed7-4698-a50a-f690b98e168d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:12.675021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d3185791-1ed7-4698-a50a-f690b98e168d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:12.681709 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d3185791-1ed7-4698-a50a-f690b98e168d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:12.682164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d3185791-1ed7-4698-a50a-f690b98e168d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:12.682932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d3185791-1ed7-4698-a50a-f690b98e168d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:12.683363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d3185791-1ed7-4698-a50a-f690b98e168d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:12.714550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d3185791-1ed7-4698-a50a-f690b98e168d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045733 Aug 04 04:45:12.715126 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 337/684] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:13.604087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dfd97a46-d82a-4909-81f4-78eea5f6231f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:13.606204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dfd97a46-d82a-4909-81f4-78eea5f6231f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:13.612929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfd97a46-d82a-4909-81f4-78eea5f6231f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:13.613374 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfd97a46-d82a-4909-81f4-78eea5f6231f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:13.614185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfd97a46-d82a-4909-81f4-78eea5f6231f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:13.614619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfd97a46-d82a-4909-81f4-78eea5f6231f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:13.645723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dfd97a46-d82a-4909-81f4-78eea5f6231f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046318 Aug 04 04:45:13.646287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 348/685] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:13 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:13.729928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-56e47d8e-91db-4be8-89b5-6c51ad3e32d2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:13.732216 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-56e47d8e-91db-4be8-89b5-6c51ad3e32d2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:13.739657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56e47d8e-91db-4be8-89b5-6c51ad3e32d2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:13.740135 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56e47d8e-91db-4be8-89b5-6c51ad3e32d2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:13.740996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56e47d8e-91db-4be8-89b5-6c51ad3e32d2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:13.741476 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56e47d8e-91db-4be8-89b5-6c51ad3e32d2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:13.774861 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-56e47d8e-91db-4be8-89b5-6c51ad3e32d2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049951 Aug 04 04:45:13.775432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 338/686] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:13 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:14.658586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ed0f2108-2473-41e5-8312-7b625725d64c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:14.660659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ed0f2108-2473-41e5-8312-7b625725d64c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:14.668021 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ed0f2108-2473-41e5-8312-7b625725d64c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:14.668466 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ed0f2108-2473-41e5-8312-7b625725d64c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:14.669233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ed0f2108-2473-41e5-8312-7b625725d64c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:14.669692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ed0f2108-2473-41e5-8312-7b625725d64c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:14.699782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ed0f2108-2473-41e5-8312-7b625725d64c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045490 Aug 04 04:45:14.700347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 349/687] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:14 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:14.840502 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8200f682-ccd8-4fa3-8644-230cc597d703 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:14.842835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8200f682-ccd8-4fa3-8644-230cc597d703 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:14.848990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8200f682-ccd8-4fa3-8644-230cc597d703 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:14.849432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8200f682-ccd8-4fa3-8644-230cc597d703 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:14.850241 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8200f682-ccd8-4fa3-8644-230cc597d703 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:14.850676 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8200f682-ccd8-4fa3-8644-230cc597d703 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:14.882333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8200f682-ccd8-4fa3-8644-230cc597d703 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098990 Aug 04 04:45:14.882901 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 339/688] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:14 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:15.712818 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e58a4481-05c1-4e3e-a5f2-d59e5f83ef1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:15.715116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e58a4481-05c1-4e3e-a5f2-d59e5f83ef1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:15.721696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e58a4481-05c1-4e3e-a5f2-d59e5f83ef1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:15.722144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e58a4481-05c1-4e3e-a5f2-d59e5f83ef1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:15.722908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e58a4481-05c1-4e3e-a5f2-d59e5f83ef1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:15.723340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e58a4481-05c1-4e3e-a5f2-d59e5f83ef1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:15.753362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e58a4481-05c1-4e3e-a5f2-d59e5f83ef1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045123 Aug 04 04:45:15.753962 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 350/689] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:15 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:15.895518 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-144754e0-06f4-407e-9447-a144d5803be0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:15.897798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-144754e0-06f4-407e-9447-a144d5803be0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:15.904499 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-144754e0-06f4-407e-9447-a144d5803be0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:15.904972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-144754e0-06f4-407e-9447-a144d5803be0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:15.905771 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-144754e0-06f4-407e-9447-a144d5803be0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:15.906211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-144754e0-06f4-407e-9447-a144d5803be0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:15.932792 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:15.938300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-144754e0-06f4-407e-9447-a144d5803be0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046811 Aug 04 04:45:15.938891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 340/690] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:15 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:16.766622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b4462c98-3951-4abd-8f2b-83876d13ac16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:16.768670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b4462c98-3951-4abd-8f2b-83876d13ac16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:16.776466 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b4462c98-3951-4abd-8f2b-83876d13ac16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:16.776912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b4462c98-3951-4abd-8f2b-83876d13ac16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:16.777732 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b4462c98-3951-4abd-8f2b-83876d13ac16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:16.778170 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b4462c98-3951-4abd-8f2b-83876d13ac16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:16.808410 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b4462c98-3951-4abd-8f2b-83876d13ac16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045799 Aug 04 04:45:16.808994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 351/691] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:16 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:16.951630 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-74f1bf8c-5f00-411c-8263-611979559c9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:16.953862 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-74f1bf8c-5f00-411c-8263-611979559c9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:16.962257 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-74f1bf8c-5f00-411c-8263-611979559c9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:16.962705 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-74f1bf8c-5f00-411c-8263-611979559c9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:16.963488 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-74f1bf8c-5f00-411c-8263-611979559c9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:16.963936 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-74f1bf8c-5f00-411c-8263-611979559c9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:16.995083 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-74f1bf8c-5f00-411c-8263-611979559c9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048249 Aug 04 04:45:16.995655 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 341/692] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:17.820889 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b6a799e3-e57a-4e12-bcd3-2901a0a972b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:17.823784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b6a799e3-e57a-4e12-bcd3-2901a0a972b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:17.831271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b6a799e3-e57a-4e12-bcd3-2901a0a972b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:17.831712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b6a799e3-e57a-4e12-bcd3-2901a0a972b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:17.832490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b6a799e3-e57a-4e12-bcd3-2901a0a972b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:17.832934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b6a799e3-e57a-4e12-bcd3-2901a0a972b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:17.863137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b6a799e3-e57a-4e12-bcd3-2901a0a972b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046150 Aug 04 04:45:17.863701 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 352/693] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:17 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:18.008223 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1d55859d-fc49-4d09-80be-52eab4c91bf6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:18.011044 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1d55859d-fc49-4d09-80be-52eab4c91bf6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:18.020936 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d55859d-fc49-4d09-80be-52eab4c91bf6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:18.021395 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d55859d-fc49-4d09-80be-52eab4c91bf6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:18.022378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d55859d-fc49-4d09-80be-52eab4c91bf6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:18.022816 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d55859d-fc49-4d09-80be-52eab4c91bf6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:18.060096 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1d55859d-fc49-4d09-80be-52eab4c91bf6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055900 Aug 04 04:45:18.060576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 342/694] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:18 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:18.875574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a50804c7-2da0-4604-901f-64bb2ba914fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:18.877782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a50804c7-2da0-4604-901f-64bb2ba914fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:18.885096 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a50804c7-2da0-4604-901f-64bb2ba914fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:18.885558 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a50804c7-2da0-4604-901f-64bb2ba914fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:18.886333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a50804c7-2da0-4604-901f-64bb2ba914fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:18.886770 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a50804c7-2da0-4604-901f-64bb2ba914fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:18.916319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a50804c7-2da0-4604-901f-64bb2ba914fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044630 Aug 04 04:45:18.916890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 353/695] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:18 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:19.073122 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d148988c-580e-4845-a941-f784f05a8418 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:19.075335 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d148988c-580e-4845-a941-f784f05a8418 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:19.081992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d148988c-580e-4845-a941-f784f05a8418 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.082443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d148988c-580e-4845-a941-f784f05a8418 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.083218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d148988c-580e-4845-a941-f784f05a8418 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.083648 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d148988c-580e-4845-a941-f784f05a8418 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.113867 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d148988c-580e-4845-a941-f784f05a8418 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045315 Aug 04 04:45:19.114423 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 343/696] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:19.928421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0d74cf59-0c0a-4d28-bc6f-8508eeba0db1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:19.930577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0d74cf59-0c0a-4d28-bc6f-8508eeba0db1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:19.937426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d74cf59-0c0a-4d28-bc6f-8508eeba0db1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.937899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d74cf59-0c0a-4d28-bc6f-8508eeba0db1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.938678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d74cf59-0c0a-4d28-bc6f-8508eeba0db1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:19.939108 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d74cf59-0c0a-4d28-bc6f-8508eeba0db1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:19.965594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:19.970945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0d74cf59-0c0a-4d28-bc6f-8508eeba0db1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046498 Aug 04 04:45:19.971521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 354/697] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:19 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:20.126841 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b7917bce-ee73-48ab-a542-ed9b0cfeb700 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:20.128988 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b7917bce-ee73-48ab-a542-ed9b0cfeb700 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:20.136193 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7917bce-ee73-48ab-a542-ed9b0cfeb700 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:20.136644 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7917bce-ee73-48ab-a542-ed9b0cfeb700 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:20.137412 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7917bce-ee73-48ab-a542-ed9b0cfeb700 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:20.137881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7917bce-ee73-48ab-a542-ed9b0cfeb700 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:20.168902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b7917bce-ee73-48ab-a542-ed9b0cfeb700 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045949 Aug 04 04:45:20.169464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 344/698] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:20.984259 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-43184bb2-0eb6-49a1-8599-884ad70e3ab7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:20.986445 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-43184bb2-0eb6-49a1-8599-884ad70e3ab7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:20.993390 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-43184bb2-0eb6-49a1-8599-884ad70e3ab7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:20.994067 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-43184bb2-0eb6-49a1-8599-884ad70e3ab7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:20.994874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-43184bb2-0eb6-49a1-8599-884ad70e3ab7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:20.995320 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-43184bb2-0eb6-49a1-8599-884ad70e3ab7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:21.026615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-43184bb2-0eb6-49a1-8599-884ad70e3ab7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046882 Aug 04 04:45:21.027191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 355/699] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:20 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:21.182017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-671b5c9b-96a9-4b89-a9ba-e63bfad1ab77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:21.184218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-671b5c9b-96a9-4b89-a9ba-e63bfad1ab77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:21.190784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-671b5c9b-96a9-4b89-a9ba-e63bfad1ab77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:21.191235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-671b5c9b-96a9-4b89-a9ba-e63bfad1ab77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:21.192002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-671b5c9b-96a9-4b89-a9ba-e63bfad1ab77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:21.192432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-671b5c9b-96a9-4b89-a9ba-e63bfad1ab77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:21.223956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-671b5c9b-96a9-4b89-a9ba-e63bfad1ab77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046452 Aug 04 04:45:21.224506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 345/700] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:21 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:22.039368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f58bee0c-47d9-48a9-b24c-d204cc85aafc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:22.041668 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f58bee0c-47d9-48a9-b24c-d204cc85aafc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:22.048343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f58bee0c-47d9-48a9-b24c-d204cc85aafc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:22.048791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f58bee0c-47d9-48a9-b24c-d204cc85aafc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.049571 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f58bee0c-47d9-48a9-b24c-d204cc85aafc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:22.050018 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f58bee0c-47d9-48a9-b24c-d204cc85aafc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.081298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f58bee0c-47d9-48a9-b24c-d204cc85aafc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046095 Aug 04 04:45:22.081908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 356/701] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:22 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:22.237084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-11598650-37a1-48e8-a831-21f9085b9f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:22.239269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-11598650-37a1-48e8-a831-21f9085b9f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:22.247416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-11598650-37a1-48e8-a831-21f9085b9f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:22.247869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-11598650-37a1-48e8-a831-21f9085b9f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.248648 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-11598650-37a1-48e8-a831-21f9085b9f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:22.249113 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-11598650-37a1-48e8-a831-21f9085b9f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:22.280190 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-11598650-37a1-48e8-a831-21f9085b9f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047444 Aug 04 04:45:22.280760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 346/702] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:22 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:45:23.093660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0c55e0a2-c5a9-457c-8b43-c0da8ac711ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:23.095791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0c55e0a2-c5a9-457c-8b43-c0da8ac711ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:23.102772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0c55e0a2-c5a9-457c-8b43-c0da8ac711ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:23.103319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0c55e0a2-c5a9-457c-8b43-c0da8ac711ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:23.104071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0c55e0a2-c5a9-457c-8b43-c0da8ac711ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:23.104504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0c55e0a2-c5a9-457c-8b43-c0da8ac711ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:23.134479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0c55e0a2-c5a9-457c-8b43-c0da8ac711ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044576 Aug 04 04:45:23.135040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 357/703] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:23 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:23.293763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-307cfbe1-30fb-4f7d-b313-afaccdce2925 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:23.295997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-307cfbe1-30fb-4f7d-b313-afaccdce2925 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:23.302539 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-307cfbe1-30fb-4f7d-b313-afaccdce2925 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:23.302990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-307cfbe1-30fb-4f7d-b313-afaccdce2925 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:23.303766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-307cfbe1-30fb-4f7d-b313-afaccdce2925 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:23.304200 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-307cfbe1-30fb-4f7d-b313-afaccdce2925 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:23.334815 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-307cfbe1-30fb-4f7d-b313-afaccdce2925 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045974 Aug 04 04:45:23.335387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 347/704] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:23 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:24.146932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-020f1a15-0eaa-4e36-a54f-98d8e272c0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:24.149094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-020f1a15-0eaa-4e36-a54f-98d8e272c0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:24.155635 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-020f1a15-0eaa-4e36-a54f-98d8e272c0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:24.156077 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-020f1a15-0eaa-4e36-a54f-98d8e272c0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:24.156832 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-020f1a15-0eaa-4e36-a54f-98d8e272c0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:24.157264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-020f1a15-0eaa-4e36-a54f-98d8e272c0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:24.186098 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-020f1a15-0eaa-4e36-a54f-98d8e272c0fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043146 Aug 04 04:45:24.186657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 358/705] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:24 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:24.347831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-19d3584e-c73e-4a99-a0a2-d4f227dc6b9d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:24.350023 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-19d3584e-c73e-4a99-a0a2-d4f227dc6b9d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:24.356505 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-19d3584e-c73e-4a99-a0a2-d4f227dc6b9d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:24.356957 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-19d3584e-c73e-4a99-a0a2-d4f227dc6b9d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:24.357758 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-19d3584e-c73e-4a99-a0a2-d4f227dc6b9d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:24.358198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-19d3584e-c73e-4a99-a0a2-d4f227dc6b9d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:24.388509 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-19d3584e-c73e-4a99-a0a2-d4f227dc6b9d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044663 Aug 04 04:45:24.389088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 348/706] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:24 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:25.200234 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a8c2b105-b50d-4079-9d9f-db669904e7f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:25.202326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a8c2b105-b50d-4079-9d9f-db669904e7f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:25.208782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a8c2b105-b50d-4079-9d9f-db669904e7f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:25.209235 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a8c2b105-b50d-4079-9d9f-db669904e7f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:25.210023 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a8c2b105-b50d-4079-9d9f-db669904e7f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:25.210800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a8c2b105-b50d-4079-9d9f-db669904e7f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:25.240189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a8c2b105-b50d-4079-9d9f-db669904e7f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044566 Aug 04 04:45:25.240743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 359/707] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:25 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:25.400958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-27e09971-37f7-40d5-a6c8-0fa73c5208e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:25.404101 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-27e09971-37f7-40d5-a6c8-0fa73c5208e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:25.410725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27e09971-37f7-40d5-a6c8-0fa73c5208e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:25.411176 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27e09971-37f7-40d5-a6c8-0fa73c5208e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:25.411936 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27e09971-37f7-40d5-a6c8-0fa73c5208e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:25.413455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27e09971-37f7-40d5-a6c8-0fa73c5208e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:25.443118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-27e09971-37f7-40d5-a6c8-0fa73c5208e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046654 Aug 04 04:45:25.443695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 349/708] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:25 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:26.253743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-826abc05-4fd7-4b8b-8ff7-e07a8ef05436 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:26.255890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-826abc05-4fd7-4b8b-8ff7-e07a8ef05436 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:26.262534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-826abc05-4fd7-4b8b-8ff7-e07a8ef05436 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:26.262981 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-826abc05-4fd7-4b8b-8ff7-e07a8ef05436 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:26.263849 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-826abc05-4fd7-4b8b-8ff7-e07a8ef05436 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:26.264286 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-826abc05-4fd7-4b8b-8ff7-e07a8ef05436 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:26.293469 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-826abc05-4fd7-4b8b-8ff7-e07a8ef05436 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Aug 04 04:45:26.294054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 360/709] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:26 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:26.456133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a7c016b6-ef94-4851-a36f-2fd8df1de6ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:26.458446 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a7c016b6-ef94-4851-a36f-2fd8df1de6ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:26.465229 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a7c016b6-ef94-4851-a36f-2fd8df1de6ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:26.465719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a7c016b6-ef94-4851-a36f-2fd8df1de6ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:26.466495 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a7c016b6-ef94-4851-a36f-2fd8df1de6ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:26.466937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a7c016b6-ef94-4851-a36f-2fd8df1de6ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:26.497100 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a7c016b6-ef94-4851-a36f-2fd8df1de6ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 Aug 04 04:45:26.497845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 350/710] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:26 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:27.306372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-403656ad-3767-4a7c-b78b-3dc3353d3f5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:27.308488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-403656ad-3767-4a7c-b78b-3dc3353d3f5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:27.315216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-403656ad-3767-4a7c-b78b-3dc3353d3f5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:27.315654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-403656ad-3767-4a7c-b78b-3dc3353d3f5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:27.316412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-403656ad-3767-4a7c-b78b-3dc3353d3f5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:27.316842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-403656ad-3767-4a7c-b78b-3dc3353d3f5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:27.346078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-403656ad-3767-4a7c-b78b-3dc3353d3f5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044131 Aug 04 04:45:27.346602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 361/711] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:27 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:27.509855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2ceb1e73-3d69-410f-8efc-d5ec20a03a77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:27.512043 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2ceb1e73-3d69-410f-8efc-d5ec20a03a77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:27.519423 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ceb1e73-3d69-410f-8efc-d5ec20a03a77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:27.519878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ceb1e73-3d69-410f-8efc-d5ec20a03a77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:27.520649 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ceb1e73-3d69-410f-8efc-d5ec20a03a77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:27.521081 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ceb1e73-3d69-410f-8efc-d5ec20a03a77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:27.550851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2ceb1e73-3d69-410f-8efc-d5ec20a03a77 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 Aug 04 04:45:27.551416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 351/712] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:27 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:45:28.359045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9b63cf9b-0520-4b71-8a41-879f78d943d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:28.361186 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9b63cf9b-0520-4b71-8a41-879f78d943d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:28.368242 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9b63cf9b-0520-4b71-8a41-879f78d943d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:28.368727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9b63cf9b-0520-4b71-8a41-879f78d943d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:28.369463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9b63cf9b-0520-4b71-8a41-879f78d943d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:28.369915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9b63cf9b-0520-4b71-8a41-879f78d943d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:28.399519 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9b63cf9b-0520-4b71-8a41-879f78d943d8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044298 Aug 04 04:45:28.399977 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 362/713] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:28 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:28.565003 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-745f7563-e376-4e33-b7e3-9ce956587977 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:28.567212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-745f7563-e376-4e33-b7e3-9ce956587977 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:28.573853 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-745f7563-e376-4e33-b7e3-9ce956587977 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:28.574302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-745f7563-e376-4e33-b7e3-9ce956587977 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:28.575094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-745f7563-e376-4e33-b7e3-9ce956587977 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:28.575538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-745f7563-e376-4e33-b7e3-9ce956587977 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:28.605341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-745f7563-e376-4e33-b7e3-9ce956587977 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044298 Aug 04 04:45:28.605926 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 352/714] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:28 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:45:29.411866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-af53271b-2ae0-4e86-a2d8-81f967a46a78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:29.414277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-af53271b-2ae0-4e86-a2d8-81f967a46a78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:29.421512 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af53271b-2ae0-4e86-a2d8-81f967a46a78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:29.421997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af53271b-2ae0-4e86-a2d8-81f967a46a78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:29.422848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af53271b-2ae0-4e86-a2d8-81f967a46a78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:29.423291 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af53271b-2ae0-4e86-a2d8-81f967a46a78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:29.452244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-af53271b-2ae0-4e86-a2d8-81f967a46a78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044411 Aug 04 04:45:29.452812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 363/715] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:29 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:29.618347 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7ec4fec7-85eb-4d42-b3a7-e084da7a3270 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:29.620369 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7ec4fec7-85eb-4d42-b3a7-e084da7a3270 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:29.626951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ec4fec7-85eb-4d42-b3a7-e084da7a3270 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:29.627408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ec4fec7-85eb-4d42-b3a7-e084da7a3270 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:29.628181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ec4fec7-85eb-4d42-b3a7-e084da7a3270 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:29.628625 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7ec4fec7-85eb-4d42-b3a7-e084da7a3270 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:29.658280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7ec4fec7-85eb-4d42-b3a7-e084da7a3270 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044643 Aug 04 04:45:29.658836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 353/716] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:29 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:30.465302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-98a144ce-af28-4532-8960-10a3b95b536e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:30.467501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-98a144ce-af28-4532-8960-10a3b95b536e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:30.474052 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98a144ce-af28-4532-8960-10a3b95b536e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:30.474501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98a144ce-af28-4532-8960-10a3b95b536e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:30.475259 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98a144ce-af28-4532-8960-10a3b95b536e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:30.475696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98a144ce-af28-4532-8960-10a3b95b536e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:30.504184 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-98a144ce-af28-4532-8960-10a3b95b536e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 Aug 04 04:45:30.504743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 364/717] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:30 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:30.671454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bbe8f070-2e75-441f-8a4f-591b382e2987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:30.673604 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-bbe8f070-2e75-441f-8a4f-591b382e2987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:30.680608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bbe8f070-2e75-441f-8a4f-591b382e2987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:30.681071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bbe8f070-2e75-441f-8a4f-591b382e2987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:30.681893 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bbe8f070-2e75-441f-8a4f-591b382e2987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:30.682339 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bbe8f070-2e75-441f-8a4f-591b382e2987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:30.714868 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-bbe8f070-2e75-441f-8a4f-591b382e2987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047422 Aug 04 04:45:30.715459 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 354/718] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:30 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:31.517180 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-aa25e62c-4a80-443d-856d-bbd896a82b6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:31.521309 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-aa25e62c-4a80-443d-856d-bbd896a82b6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:31.528431 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aa25e62c-4a80-443d-856d-bbd896a82b6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:31.528888 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aa25e62c-4a80-443d-856d-bbd896a82b6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:31.529735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aa25e62c-4a80-443d-856d-bbd896a82b6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:31.530172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aa25e62c-4a80-443d-856d-bbd896a82b6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:31.560479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-aa25e62c-4a80-443d-856d-bbd896a82b6f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047520 Aug 04 04:45:31.561241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 365/719] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:31 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:31.727594 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-db380e2c-8cc7-4341-a840-b206f9dd3d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:31.729681 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-db380e2c-8cc7-4341-a840-b206f9dd3d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:31.736250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db380e2c-8cc7-4341-a840-b206f9dd3d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:31.736680 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db380e2c-8cc7-4341-a840-b206f9dd3d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:31.737472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db380e2c-8cc7-4341-a840-b206f9dd3d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:31.737928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db380e2c-8cc7-4341-a840-b206f9dd3d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:31.769093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-db380e2c-8cc7-4341-a840-b206f9dd3d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045464 Aug 04 04:45:31.769746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 355/720] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:31 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:32.573042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5dbf1667-3c64-42b9-9e71-eaf951923854 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:32.575140 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5dbf1667-3c64-42b9-9e71-eaf951923854 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:32.581765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5dbf1667-3c64-42b9-9e71-eaf951923854 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:32.582213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5dbf1667-3c64-42b9-9e71-eaf951923854 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:32.582981 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5dbf1667-3c64-42b9-9e71-eaf951923854 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:32.583412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5dbf1667-3c64-42b9-9e71-eaf951923854 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:32.614140 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5dbf1667-3c64-42b9-9e71-eaf951923854 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045540 Aug 04 04:45:32.614701 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 366/721] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:32 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:32.782037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-163eb7a3-eed5-4d67-8c79-64bf606697a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:32.784215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-163eb7a3-eed5-4d67-8c79-64bf606697a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:32.792153 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-163eb7a3-eed5-4d67-8c79-64bf606697a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:32.792606 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-163eb7a3-eed5-4d67-8c79-64bf606697a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:32.793387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-163eb7a3-eed5-4d67-8c79-64bf606697a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:32.793856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-163eb7a3-eed5-4d67-8c79-64bf606697a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:32.825974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-163eb7a3-eed5-4d67-8c79-64bf606697a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047997 Aug 04 04:45:32.826470 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 356/722] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:32 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:33.627029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6d8cd143-4b4e-4c35-8206-30ba155c8ef3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:33.629214 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6d8cd143-4b4e-4c35-8206-30ba155c8ef3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:33.636035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d8cd143-4b4e-4c35-8206-30ba155c8ef3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:33.636482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d8cd143-4b4e-4c35-8206-30ba155c8ef3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:33.637265 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d8cd143-4b4e-4c35-8206-30ba155c8ef3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:33.637737 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d8cd143-4b4e-4c35-8206-30ba155c8ef3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:33.667945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6d8cd143-4b4e-4c35-8206-30ba155c8ef3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044860 Aug 04 04:45:33.668510 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 367/723] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:33 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:33.838926 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5d1074ee-2598-4854-8052-96737b2dff46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:33.841077 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5d1074ee-2598-4854-8052-96737b2dff46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:33.847790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5d1074ee-2598-4854-8052-96737b2dff46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:33.848475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5d1074ee-2598-4854-8052-96737b2dff46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:33.849964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5d1074ee-2598-4854-8052-96737b2dff46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:33.850525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5d1074ee-2598-4854-8052-96737b2dff46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:33.869997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:33.883961 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5d1074ee-2598-4854-8052-96737b2dff46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049647 Aug 04 04:45:33.884551 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 357/724] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:33 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:34.680828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bba6079f-e45b-4768-99c3-ad22e677bd0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:34.683149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bba6079f-e45b-4768-99c3-ad22e677bd0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:34.689719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bba6079f-e45b-4768-99c3-ad22e677bd0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:34.690169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bba6079f-e45b-4768-99c3-ad22e677bd0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:34.690936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bba6079f-e45b-4768-99c3-ad22e677bd0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:34.691371 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bba6079f-e45b-4768-99c3-ad22e677bd0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:34.721800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bba6079f-e45b-4768-99c3-ad22e677bd0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045540 Aug 04 04:45:34.722367 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 368/725] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:34 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:34.896435 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9c503c6f-7930-420e-9986-629ec0be4aae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:34.898703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9c503c6f-7930-420e-9986-629ec0be4aae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:34.904858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c503c6f-7930-420e-9986-629ec0be4aae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:34.905252 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c503c6f-7930-420e-9986-629ec0be4aae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:34.906064 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c503c6f-7930-420e-9986-629ec0be4aae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:34.906512 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c503c6f-7930-420e-9986-629ec0be4aae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:34.936018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9c503c6f-7930-420e-9986-629ec0be4aae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043718 Aug 04 04:45:34.936596 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 358/726] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:34 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:45:35.734395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-987dae6b-8b8f-454f-aa18-ec70016b3a63 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:35.736479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-987dae6b-8b8f-454f-aa18-ec70016b3a63 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:35.743297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-987dae6b-8b8f-454f-aa18-ec70016b3a63 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:35.743750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-987dae6b-8b8f-454f-aa18-ec70016b3a63 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:35.744516 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-987dae6b-8b8f-454f-aa18-ec70016b3a63 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:35.744955 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-987dae6b-8b8f-454f-aa18-ec70016b3a63 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:35.774231 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-987dae6b-8b8f-454f-aa18-ec70016b3a63 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043082 Aug 04 04:45:35.774599 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 369/727] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:35 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:35.949039 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-360a309f-c5b8-47b4-a0ec-8b4ebb849a90 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:35.951206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-360a309f-c5b8-47b4-a0ec-8b4ebb849a90 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:35.957699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-360a309f-c5b8-47b4-a0ec-8b4ebb849a90 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:35.958145 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-360a309f-c5b8-47b4-a0ec-8b4ebb849a90 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:35.958902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-360a309f-c5b8-47b4-a0ec-8b4ebb849a90 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:35.959331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-360a309f-c5b8-47b4-a0ec-8b4ebb849a90 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:35.989683 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-360a309f-c5b8-47b4-a0ec-8b4ebb849a90 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045219 Aug 04 04:45:35.990164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 359/728] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:35 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:36.786662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ba8514b7-f473-4779-8e13-c8b9f67b3194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:36.789815 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ba8514b7-f473-4779-8e13-c8b9f67b3194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:36.796262 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba8514b7-f473-4779-8e13-c8b9f67b3194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:36.796705 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba8514b7-f473-4779-8e13-c8b9f67b3194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:36.797459 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba8514b7-f473-4779-8e13-c8b9f67b3194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:36.797916 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba8514b7-f473-4779-8e13-c8b9f67b3194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:36.826673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ba8514b7-f473-4779-8e13-c8b9f67b3194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043871 Aug 04 04:45:36.827218 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 370/729] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:36 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:37.002072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9f05df97-f36a-44d4-9561-1c842c13660c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:37.004189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9f05df97-f36a-44d4-9561-1c842c13660c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:37.011459 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f05df97-f36a-44d4-9561-1c842c13660c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:37.011911 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f05df97-f36a-44d4-9561-1c842c13660c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:37.012676 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f05df97-f36a-44d4-9561-1c842c13660c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:37.013110 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f05df97-f36a-44d4-9561-1c842c13660c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:37.048173 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9f05df97-f36a-44d4-9561-1c842c13660c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049883 Aug 04 04:45:37.048653 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 360/730] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:36 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:37.839097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7a8bd37b-c9cb-455c-9038-491df802097c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:37.841247 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7a8bd37b-c9cb-455c-9038-491df802097c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:37.847772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7a8bd37b-c9cb-455c-9038-491df802097c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:37.848216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7a8bd37b-c9cb-455c-9038-491df802097c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:37.848973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7a8bd37b-c9cb-455c-9038-491df802097c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:37.849403 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7a8bd37b-c9cb-455c-9038-491df802097c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:37.866246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:37.879399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7a8bd37b-c9cb-455c-9038-491df802097c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Aug 04 04:45:37.879947 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 371/731] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:37 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:38.061040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-229281cf-4187-4fa6-ae2c-e7fadb8878a4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:38.063282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-229281cf-4187-4fa6-ae2c-e7fadb8878a4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:38.069862 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-229281cf-4187-4fa6-ae2c-e7fadb8878a4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.070351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-229281cf-4187-4fa6-ae2c-e7fadb8878a4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:38.071126 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-229281cf-4187-4fa6-ae2c-e7fadb8878a4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.071565 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-229281cf-4187-4fa6-ae2c-e7fadb8878a4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:38.100928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-229281cf-4187-4fa6-ae2c-e7fadb8878a4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043695 Aug 04 04:45:38.101997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 361/732] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:38 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:38.892135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8caf7956-2c75-4727-98ec-ee292d66333e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:38.894285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8caf7956-2c75-4727-98ec-ee292d66333e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:38.901208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8caf7956-2c75-4727-98ec-ee292d66333e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.901719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8caf7956-2c75-4727-98ec-ee292d66333e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:38.902488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8caf7956-2c75-4727-98ec-ee292d66333e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:38.902930 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8caf7956-2c75-4727-98ec-ee292d66333e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:38.932227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8caf7956-2c75-4727-98ec-ee292d66333e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 Aug 04 04:45:38.932784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 372/733] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:38 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:39.113755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bb0a1193-c3da-4c8e-b566-fdcceb195777 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:39.115877 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-bb0a1193-c3da-4c8e-b566-fdcceb195777 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:39.118327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=58 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:39.123512 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bb0a1193-c3da-4c8e-b566-fdcceb195777 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:39.123959 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bb0a1193-c3da-4c8e-b566-fdcceb195777 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:39.124911 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bb0a1193-c3da-4c8e-b566-fdcceb195777 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:39.125342 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bb0a1193-c3da-4c8e-b566-fdcceb195777 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:39.155382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-bb0a1193-c3da-4c8e-b566-fdcceb195777 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045475 Aug 04 04:45:39.155851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 362/734] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:39 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:39.944742 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a885b1d3-1407-4f52-a8aa-e34ee837778e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:39.947719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a885b1d3-1407-4f52-a8aa-e34ee837778e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:39.954453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a885b1d3-1407-4f52-a8aa-e34ee837778e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:39.954897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a885b1d3-1407-4f52-a8aa-e34ee837778e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:39.955661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a885b1d3-1407-4f52-a8aa-e34ee837778e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:39.956104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a885b1d3-1407-4f52-a8aa-e34ee837778e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:39.985585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a885b1d3-1407-4f52-a8aa-e34ee837778e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044808 Aug 04 04:45:39.986143 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 373/735] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:40.168409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d6efff41-281b-4903-be86-b71fb7a7ec0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:40.170607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d6efff41-281b-4903-be86-b71fb7a7ec0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:40.176998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d6efff41-281b-4903-be86-b71fb7a7ec0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:40.177445 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d6efff41-281b-4903-be86-b71fb7a7ec0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:40.178236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d6efff41-281b-4903-be86-b71fb7a7ec0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:40.178668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d6efff41-281b-4903-be86-b71fb7a7ec0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:40.208621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d6efff41-281b-4903-be86-b71fb7a7ec0f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044480 Aug 04 04:45:40.209099 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 363/736] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:40 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:40.998807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2b469496-3551-4060-affe-50da14ffbf53 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:41.000954 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2b469496-3551-4060-affe-50da14ffbf53 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:41.007176 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b469496-3551-4060-affe-50da14ffbf53 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:41.007830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b469496-3551-4060-affe-50da14ffbf53 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:41.008591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b469496-3551-4060-affe-50da14ffbf53 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:41.009066 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b469496-3551-4060-affe-50da14ffbf53 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:41.041152 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2b469496-3551-4060-affe-50da14ffbf53 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046209 Aug 04 04:45:41.041745 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 374/737] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:40 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:41.221614 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1a6dc6f2-b609-4553-9d1e-55710482106c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:41.223773 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1a6dc6f2-b609-4553-9d1e-55710482106c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:41.231053 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1a6dc6f2-b609-4553-9d1e-55710482106c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:41.231507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1a6dc6f2-b609-4553-9d1e-55710482106c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:41.232271 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1a6dc6f2-b609-4553-9d1e-55710482106c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:41.232705 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1a6dc6f2-b609-4553-9d1e-55710482106c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:41.262753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1a6dc6f2-b609-4553-9d1e-55710482106c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044987 Aug 04 04:45:41.263217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 364/738] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:41 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:42.053536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-645c9d2a-ebf6-4257-a866-a15d38bb6375 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:42.056637 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-645c9d2a-ebf6-4257-a866-a15d38bb6375 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:42.059019 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=58 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:42.064823 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-645c9d2a-ebf6-4257-a866-a15d38bb6375 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:42.065270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-645c9d2a-ebf6-4257-a866-a15d38bb6375 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:42.066091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-645c9d2a-ebf6-4257-a866-a15d38bb6375 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:42.066528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-645c9d2a-ebf6-4257-a866-a15d38bb6375 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:42.103973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-645c9d2a-ebf6-4257-a866-a15d38bb6375 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053911 Aug 04 04:45:42.105044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 375/739] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:42 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:42.276031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-319e8698-d359-4bac-bba9-78aa04f31b6c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:42.278293 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-319e8698-d359-4bac-bba9-78aa04f31b6c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:42.284874 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-319e8698-d359-4bac-bba9-78aa04f31b6c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:42.285327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-319e8698-d359-4bac-bba9-78aa04f31b6c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:42.286176 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-319e8698-d359-4bac-bba9-78aa04f31b6c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:42.286618 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-319e8698-d359-4bac-bba9-78aa04f31b6c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:42.317713 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-319e8698-d359-4bac-bba9-78aa04f31b6c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046697 Aug 04 04:45:42.318188 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 365/740] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:42 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:45:43.116473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fc735b86-d6f8-4f3d-b285-fa727087bfa9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:43.119428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fc735b86-d6f8-4f3d-b285-fa727087bfa9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:43.125997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc735b86-d6f8-4f3d-b285-fa727087bfa9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:43.126443 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc735b86-d6f8-4f3d-b285-fa727087bfa9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:43.127209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc735b86-d6f8-4f3d-b285-fa727087bfa9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:43.127646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc735b86-d6f8-4f3d-b285-fa727087bfa9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:43.156488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fc735b86-d6f8-4f3d-b285-fa727087bfa9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044055 Aug 04 04:45:43.157036 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 376/741] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:43 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:45:43.330178 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-db7cb690-22f7-41a3-bece-82de85756c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:43.332349 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-db7cb690-22f7-41a3-bece-82de85756c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:43.339034 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db7cb690-22f7-41a3-bece-82de85756c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:43.339483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db7cb690-22f7-41a3-bece-82de85756c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:43.340242 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db7cb690-22f7-41a3-bece-82de85756c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:43.340675 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db7cb690-22f7-41a3-bece-82de85756c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:43.372561 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-db7cb690-22f7-41a3-bece-82de85756c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046218 Aug 04 04:45:43.373050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 366/742] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:43 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:44.169631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a1882e75-4990-4702-aacd-f7d006d069d5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:44.171887 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a1882e75-4990-4702-aacd-f7d006d069d5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:44.178482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1882e75-4990-4702-aacd-f7d006d069d5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:44.178932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1882e75-4990-4702-aacd-f7d006d069d5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:44.179744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1882e75-4990-4702-aacd-f7d006d069d5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:44.180181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1882e75-4990-4702-aacd-f7d006d069d5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:44.209627 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a1882e75-4990-4702-aacd-f7d006d069d5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043948 Aug 04 04:45:44.210373 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 377/743] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:44 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:44.385342 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-878c31a6-aaeb-43db-b98d-a267138500c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:44.387567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-878c31a6-aaeb-43db-b98d-a267138500c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:44.394211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-878c31a6-aaeb-43db-b98d-a267138500c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:44.394645 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-878c31a6-aaeb-43db-b98d-a267138500c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:44.395439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-878c31a6-aaeb-43db-b98d-a267138500c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:44.395987 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-878c31a6-aaeb-43db-b98d-a267138500c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:44.426289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-878c31a6-aaeb-43db-b98d-a267138500c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045768 Aug 04 04:45:44.426761 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 367/744] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:44 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:45.222281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2bbdb078-fa8e-4de7-9cac-cf6583e74027 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:45.224403 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2bbdb078-fa8e-4de7-9cac-cf6583e74027 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:45.231785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2bbdb078-fa8e-4de7-9cac-cf6583e74027 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:45.232240 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2bbdb078-fa8e-4de7-9cac-cf6583e74027 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:45.233012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2bbdb078-fa8e-4de7-9cac-cf6583e74027 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:45.233530 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2bbdb078-fa8e-4de7-9cac-cf6583e74027 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:45.262723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2bbdb078-fa8e-4de7-9cac-cf6583e74027 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044341 Aug 04 04:45:45.263343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 378/745] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:45 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:45.439477 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e6cb9422-fcdf-424a-a2a4-4a9656297c74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:45.441683 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e6cb9422-fcdf-424a-a2a4-4a9656297c74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:45.449007 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6cb9422-fcdf-424a-a2a4-4a9656297c74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:45.449458 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6cb9422-fcdf-424a-a2a4-4a9656297c74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:45.450250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6cb9422-fcdf-424a-a2a4-4a9656297c74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:45.450687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6cb9422-fcdf-424a-a2a4-4a9656297c74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:45.481428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e6cb9422-fcdf-424a-a2a4-4a9656297c74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 Aug 04 04:45:45.481948 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 368/746] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:45 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:46.276880 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-920729f1-4214-4472-b3fb-ff90655fc7bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:46.279046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-920729f1-4214-4472-b3fb-ff90655fc7bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:46.285703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-920729f1-4214-4472-b3fb-ff90655fc7bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:46.286152 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-920729f1-4214-4472-b3fb-ff90655fc7bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:46.287192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-920729f1-4214-4472-b3fb-ff90655fc7bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:46.287624 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-920729f1-4214-4472-b3fb-ff90655fc7bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:46.320690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-920729f1-4214-4472-b3fb-ff90655fc7bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047752 Aug 04 04:45:46.321291 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 379/747] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:46 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:46.495328 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0e33c01d-07cc-4099-8fb7-3bfceb5c3e20 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:46.497405 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0e33c01d-07cc-4099-8fb7-3bfceb5c3e20 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:46.504169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e33c01d-07cc-4099-8fb7-3bfceb5c3e20 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:46.504622 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e33c01d-07cc-4099-8fb7-3bfceb5c3e20 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:46.505797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e33c01d-07cc-4099-8fb7-3bfceb5c3e20 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:46.505900 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e33c01d-07cc-4099-8fb7-3bfceb5c3e20 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:46.535425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0e33c01d-07cc-4099-8fb7-3bfceb5c3e20 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Aug 04 04:45:46.535983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 369/748] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:46 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:47.333368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e493f5f5-1dbf-4217-ad72-da55cb115c07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:47.336542 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e493f5f5-1dbf-4217-ad72-da55cb115c07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:47.343081 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e493f5f5-1dbf-4217-ad72-da55cb115c07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:47.343531 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e493f5f5-1dbf-4217-ad72-da55cb115c07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:47.344300 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e493f5f5-1dbf-4217-ad72-da55cb115c07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:47.344732 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e493f5f5-1dbf-4217-ad72-da55cb115c07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:47.376974 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e493f5f5-1dbf-4217-ad72-da55cb115c07 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047611 Aug 04 04:45:47.377563 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 380/749] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:47 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:47.549158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8b376b70-d145-420d-8606-42bad1979396 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:47.551390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8b376b70-d145-420d-8606-42bad1979396 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:47.558338 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8b376b70-d145-420d-8606-42bad1979396 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:47.558792 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8b376b70-d145-420d-8606-42bad1979396 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:47.559568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8b376b70-d145-420d-8606-42bad1979396 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:47.560012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8b376b70-d145-420d-8606-42bad1979396 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:47.592088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8b376b70-d145-420d-8606-42bad1979396 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046785 Aug 04 04:45:47.592582 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 370/750] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:47 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:48.389364 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-21785a42-5a08-416f-a6f8-2e17ca7c299d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:48.391583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-21785a42-5a08-416f-a6f8-2e17ca7c299d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:48.399357 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21785a42-5a08-416f-a6f8-2e17ca7c299d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:48.399875 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21785a42-5a08-416f-a6f8-2e17ca7c299d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:48.400831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21785a42-5a08-416f-a6f8-2e17ca7c299d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:48.401334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21785a42-5a08-416f-a6f8-2e17ca7c299d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:48.438340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-21785a42-5a08-416f-a6f8-2e17ca7c299d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053153 Aug 04 04:45:48.438919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 381/751] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:48 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:48.604404 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b6655b14-5978-4afd-aa6d-60cb5c3ba25d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:48.606626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b6655b14-5978-4afd-aa6d-60cb5c3ba25d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:48.613222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6655b14-5978-4afd-aa6d-60cb5c3ba25d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:48.613710 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6655b14-5978-4afd-aa6d-60cb5c3ba25d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:48.614488 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6655b14-5978-4afd-aa6d-60cb5c3ba25d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:48.614931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6655b14-5978-4afd-aa6d-60cb5c3ba25d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:48.649158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b6655b14-5978-4afd-aa6d-60cb5c3ba25d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049562 Aug 04 04:45:48.649875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 371/752] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:48 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:49.450326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0d8163d2-0c82-4cee-82af-5f02b6a14a74 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:49.452438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0d8163d2-0c82-4cee-82af-5f02b6a14a74 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:49.458972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d8163d2-0c82-4cee-82af-5f02b6a14a74 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:49.459421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d8163d2-0c82-4cee-82af-5f02b6a14a74 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:49.460197 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d8163d2-0c82-4cee-82af-5f02b6a14a74 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:49.460784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d8163d2-0c82-4cee-82af-5f02b6a14a74 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:49.489803 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0d8163d2-0c82-4cee-82af-5f02b6a14a74 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043336 Aug 04 04:45:49.490363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 382/753] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:49 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:49.663001 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c25fc522-9b14-4827-9dd4-33fa4227227b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:49.666337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c25fc522-9b14-4827-9dd4-33fa4227227b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:49.674422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c25fc522-9b14-4827-9dd4-33fa4227227b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:49.674874 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c25fc522-9b14-4827-9dd4-33fa4227227b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:49.675658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c25fc522-9b14-4827-9dd4-33fa4227227b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:49.676096 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c25fc522-9b14-4827-9dd4-33fa4227227b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:49.708433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c25fc522-9b14-4827-9dd4-33fa4227227b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050408 Aug 04 04:45:49.709002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 372/754] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:49 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:50.503411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ff5f6355-4078-4cc8-8ef6-d466df8e9f05 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:50.506593 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ff5f6355-4078-4cc8-8ef6-d466df8e9f05 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:50.513317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ff5f6355-4078-4cc8-8ef6-d466df8e9f05 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:50.513874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ff5f6355-4078-4cc8-8ef6-d466df8e9f05 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:50.514650 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ff5f6355-4078-4cc8-8ef6-d466df8e9f05 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:50.515086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ff5f6355-4078-4cc8-8ef6-d466df8e9f05 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:50.545143 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ff5f6355-4078-4cc8-8ef6-d466df8e9f05 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045740 Aug 04 04:45:50.545719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 383/755] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:50 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:50.721201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-39b90476-6932-45e5-a22e-735b475b6c1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:50.723389 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-39b90476-6932-45e5-a22e-735b475b6c1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:50.730804 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-39b90476-6932-45e5-a22e-735b475b6c1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:50.731262 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-39b90476-6932-45e5-a22e-735b475b6c1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:50.732032 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-39b90476-6932-45e5-a22e-735b475b6c1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:50.732475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-39b90476-6932-45e5-a22e-735b475b6c1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:50.763480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-39b90476-6932-45e5-a22e-735b475b6c1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046123 Aug 04 04:45:50.763992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 373/756] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:50 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:51.557604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b64c67e8-dac8-4b23-8c9c-e88976b5cbb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:51.559902 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b64c67e8-dac8-4b23-8c9c-e88976b5cbb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:51.566735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b64c67e8-dac8-4b23-8c9c-e88976b5cbb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:51.567230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b64c67e8-dac8-4b23-8c9c-e88976b5cbb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:51.568066 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b64c67e8-dac8-4b23-8c9c-e88976b5cbb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:51.568509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b64c67e8-dac8-4b23-8c9c-e88976b5cbb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:51.598972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b64c67e8-dac8-4b23-8c9c-e88976b5cbb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045394 Aug 04 04:45:51.599529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 384/757] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:51 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:51.776756 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5907a71a-79f2-43a4-a247-b512cc005617 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:51.778852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5907a71a-79f2-43a4-a247-b512cc005617 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:51.785338 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5907a71a-79f2-43a4-a247-b512cc005617 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:51.785821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5907a71a-79f2-43a4-a247-b512cc005617 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:51.786588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5907a71a-79f2-43a4-a247-b512cc005617 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:51.787281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5907a71a-79f2-43a4-a247-b512cc005617 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:51.791494 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:51.817871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5907a71a-79f2-43a4-a247-b512cc005617 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046013 Aug 04 04:45:51.818433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 374/758] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:51 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:52.611756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dda93650-509d-47a6-b016-edf6b171d8f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:52.614134 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dda93650-509d-47a6-b016-edf6b171d8f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:52.621894 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dda93650-509d-47a6-b016-edf6b171d8f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:52.622344 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dda93650-509d-47a6-b016-edf6b171d8f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:52.623118 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dda93650-509d-47a6-b016-edf6b171d8f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:52.623557 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dda93650-509d-47a6-b016-edf6b171d8f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:52.653302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dda93650-509d-47a6-b016-edf6b171d8f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045495 Aug 04 04:45:52.653902 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 385/759] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:52 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:45:52.830994 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-99dc25b6-3a58-4d35-aba1-e53d0c2202a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:52.833140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-99dc25b6-3a58-4d35-aba1-e53d0c2202a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:52.840312 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99dc25b6-3a58-4d35-aba1-e53d0c2202a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:52.840770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99dc25b6-3a58-4d35-aba1-e53d0c2202a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:52.841536 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99dc25b6-3a58-4d35-aba1-e53d0c2202a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:52.842005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99dc25b6-3a58-4d35-aba1-e53d0c2202a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:52.871077 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-99dc25b6-3a58-4d35-aba1-e53d0c2202a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Aug 04 04:45:52.871637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 375/760] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:52 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:53.769251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9d5e625d-6d6c-40cc-bf4d-821bdb98161c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:53.771533 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9d5e625d-6d6c-40cc-bf4d-821bdb98161c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:53.778226 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9d5e625d-6d6c-40cc-bf4d-821bdb98161c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:53.778672 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9d5e625d-6d6c-40cc-bf4d-821bdb98161c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:53.779433 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9d5e625d-6d6c-40cc-bf4d-821bdb98161c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:53.779866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9d5e625d-6d6c-40cc-bf4d-821bdb98161c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:53.810197 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9d5e625d-6d6c-40cc-bf4d-821bdb98161c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148484 Aug 04 04:45:53.810754 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 386/761] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:53 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:53.883877 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f8f4ab04-a64e-454e-96f1-91ddc35117b9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:53.886031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f8f4ab04-a64e-454e-96f1-91ddc35117b9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:53.892576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8f4ab04-a64e-454e-96f1-91ddc35117b9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:53.893030 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8f4ab04-a64e-454e-96f1-91ddc35117b9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:53.893820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8f4ab04-a64e-454e-96f1-91ddc35117b9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:53.894258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8f4ab04-a64e-454e-96f1-91ddc35117b9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:53.924286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f8f4ab04-a64e-454e-96f1-91ddc35117b9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044662 Aug 04 04:45:53.924764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 376/762] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:53 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:54.823070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-80e190df-67cc-446d-a7a4-8f94c2e69a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:54.825216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-80e190df-67cc-446d-a7a4-8f94c2e69a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:54.831787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-80e190df-67cc-446d-a7a4-8f94c2e69a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:54.832239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-80e190df-67cc-446d-a7a4-8f94c2e69a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:54.833035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-80e190df-67cc-446d-a7a4-8f94c2e69a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:54.833472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-80e190df-67cc-446d-a7a4-8f94c2e69a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:54.862350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-80e190df-67cc-446d-a7a4-8f94c2e69a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043824 Aug 04 04:45:54.863061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 387/763] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:54 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:54.935769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-61e5af71-3c66-4688-857e-327acef71ba4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:54.937953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-61e5af71-3c66-4688-857e-327acef71ba4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:54.945466 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-61e5af71-3c66-4688-857e-327acef71ba4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:54.946086 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-61e5af71-3c66-4688-857e-327acef71ba4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:54.946856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-61e5af71-3c66-4688-857e-327acef71ba4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:54.947298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-61e5af71-3c66-4688-857e-327acef71ba4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:54.976607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-61e5af71-3c66-4688-857e-327acef71ba4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 Aug 04 04:45:54.977166 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 377/764] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:54 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:55.875720 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cedc8f37-f672-4222-83d3-5379d3474672 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:55.877912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cedc8f37-f672-4222-83d3-5379d3474672 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:55.885215 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cedc8f37-f672-4222-83d3-5379d3474672 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:55.885707 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cedc8f37-f672-4222-83d3-5379d3474672 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:55.886471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cedc8f37-f672-4222-83d3-5379d3474672 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:55.886905 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cedc8f37-f672-4222-83d3-5379d3474672 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:55.890452 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:55.915580 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cedc8f37-f672-4222-83d3-5379d3474672 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043866 Aug 04 04:45:55.916129 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 388/765] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:55 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:55.988310 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eabb16bc-4cba-479f-8e0e-52be55afd1ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:55.990453 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eabb16bc-4cba-479f-8e0e-52be55afd1ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:55.997766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eabb16bc-4cba-479f-8e0e-52be55afd1ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:55.998215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eabb16bc-4cba-479f-8e0e-52be55afd1ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:55.998971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eabb16bc-4cba-479f-8e0e-52be55afd1ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:55.999402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eabb16bc-4cba-479f-8e0e-52be55afd1ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:56.029055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eabb16bc-4cba-479f-8e0e-52be55afd1ae tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044639 Aug 04 04:45:56.029621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 378/766] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:55 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:56.928024 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3289e326-0314-474a-91b5-032b30c6825c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:56.930949 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3289e326-0314-474a-91b5-032b30c6825c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:56.937403 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3289e326-0314-474a-91b5-032b30c6825c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:56.937886 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3289e326-0314-474a-91b5-032b30c6825c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:56.938653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3289e326-0314-474a-91b5-032b30c6825c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:56.939088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3289e326-0314-474a-91b5-032b30c6825c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:56.967174 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3289e326-0314-474a-91b5-032b30c6825c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043168 Aug 04 04:45:56.967727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 389/767] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:56 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:57.041973 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2bd2654b-a4e8-4f23-802c-436d33b14675 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:57.044082 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2bd2654b-a4e8-4f23-802c-436d33b14675 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:57.050560 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2bd2654b-a4e8-4f23-802c-436d33b14675 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:57.051010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2bd2654b-a4e8-4f23-802c-436d33b14675 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:57.051763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2bd2654b-a4e8-4f23-802c-436d33b14675 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:57.052195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2bd2654b-a4e8-4f23-802c-436d33b14675 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:57.081135 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2bd2654b-a4e8-4f23-802c-436d33b14675 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043652 Aug 04 04:45:57.081782 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 379/768] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:57 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:57.979426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4dc458bd-ebdd-49d5-9d3a-c4f5ec41678c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:57.981565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4dc458bd-ebdd-49d5-9d3a-c4f5ec41678c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:57.988056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4dc458bd-ebdd-49d5-9d3a-c4f5ec41678c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:57.988505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4dc458bd-ebdd-49d5-9d3a-c4f5ec41678c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:57.989271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4dc458bd-ebdd-49d5-9d3a-c4f5ec41678c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:57.989741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4dc458bd-ebdd-49d5-9d3a-c4f5ec41678c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.018915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4dc458bd-ebdd-49d5-9d3a-c4f5ec41678c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043621 Aug 04 04:45:58.019462 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 390/769] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:57 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:58.094042 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f1836684-8860-4c07-a128-8c0a5208cc0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:58.096146 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f1836684-8860-4c07-a128-8c0a5208cc0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:58.102949 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1836684-8860-4c07-a128-8c0a5208cc0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.103400 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1836684-8860-4c07-a128-8c0a5208cc0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.104161 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1836684-8860-4c07-a128-8c0a5208cc0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:58.104594 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1836684-8860-4c07-a128-8c0a5208cc0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:58.134602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f1836684-8860-4c07-a128-8c0a5208cc0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044341 Aug 04 04:45:58.135081 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 380/770] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:58 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:59.030229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ce65623d-26fb-4a5a-b4a0-303c4d937cb2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:59.032356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ce65623d-26fb-4a5a-b4a0-303c4d937cb2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:59.039656 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce65623d-26fb-4a5a-b4a0-303c4d937cb2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:59.040096 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce65623d-26fb-4a5a-b4a0-303c4d937cb2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:59.040848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce65623d-26fb-4a5a-b4a0-303c4d937cb2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:59.041276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ce65623d-26fb-4a5a-b4a0-303c4d937cb2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:59.069536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ce65623d-26fb-4a5a-b4a0-303c4d937cb2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043139 Aug 04 04:45:59.070088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 391/771] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:59 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:45:59.147017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9df61e49-ffbb-4122-8940-9bcb2a2de121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:45:59.149345 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9df61e49-ffbb-4122-8940-9bcb2a2de121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:45:59.155865 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9df61e49-ffbb-4122-8940-9bcb2a2de121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:59.156315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9df61e49-ffbb-4122-8940-9bcb2a2de121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:59.157079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9df61e49-ffbb-4122-8940-9bcb2a2de121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:45:59.157518 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9df61e49-ffbb-4122-8940-9bcb2a2de121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:45:59.187217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9df61e49-ffbb-4122-8940-9bcb2a2de121 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Aug 04 04:45:59.187766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 381/772] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:45:59 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:00.081685 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-13dc1681-a733-4d58-a4f9-ad65bb7ea5ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:00.083808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-13dc1681-a733-4d58-a4f9-ad65bb7ea5ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:00.090981 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-13dc1681-a733-4d58-a4f9-ad65bb7ea5ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:00.091429 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-13dc1681-a733-4d58-a4f9-ad65bb7ea5ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:00.092187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-13dc1681-a733-4d58-a4f9-ad65bb7ea5ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:00.092623 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-13dc1681-a733-4d58-a4f9-ad65bb7ea5ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:00.121609 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-13dc1681-a733-4d58-a4f9-ad65bb7ea5ba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 Aug 04 04:46:00.122171 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 392/773] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:00 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:00.199985 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c79a1998-e237-475b-b0a6-5c4c3dcbd792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:00.202056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c79a1998-e237-475b-b0a6-5c4c3dcbd792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:00.208851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c79a1998-e237-475b-b0a6-5c4c3dcbd792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:00.209297 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c79a1998-e237-475b-b0a6-5c4c3dcbd792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:00.210384 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c79a1998-e237-475b-b0a6-5c4c3dcbd792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:00.210821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c79a1998-e237-475b-b0a6-5c4c3dcbd792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:00.239832 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c79a1998-e237-475b-b0a6-5c4c3dcbd792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043704 Aug 04 04:46:00.240452 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 382/774] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:00 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:46:01.135678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f909458c-b38b-4128-9c1a-d4a80afaa7b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:01.137850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f909458c-b38b-4128-9c1a-d4a80afaa7b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:01.144354 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f909458c-b38b-4128-9c1a-d4a80afaa7b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:01.144797 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f909458c-b38b-4128-9c1a-d4a80afaa7b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:01.145570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f909458c-b38b-4128-9c1a-d4a80afaa7b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:01.146015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f909458c-b38b-4128-9c1a-d4a80afaa7b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:01.175813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f909458c-b38b-4128-9c1a-d4a80afaa7b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044520 Aug 04 04:46:01.176363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 393/775] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:01 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:01.252582 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5593ab28-4bc0-4887-9c8c-7127a5b28994 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:01.255031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5593ab28-4bc0-4887-9c8c-7127a5b28994 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:01.262219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5593ab28-4bc0-4887-9c8c-7127a5b28994 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:01.262667 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5593ab28-4bc0-4887-9c8c-7127a5b28994 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:01.263425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5593ab28-4bc0-4887-9c8c-7127a5b28994 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:01.263864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5593ab28-4bc0-4887-9c8c-7127a5b28994 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:01.294152 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5593ab28-4bc0-4887-9c8c-7127a5b28994 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045495 Aug 04 04:46:01.294763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 383/776] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:01 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:02.188224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-39372bb8-de1d-4ba6-adac-f310dc1767a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:02.190381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-39372bb8-de1d-4ba6-adac-f310dc1767a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:02.197565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39372bb8-de1d-4ba6-adac-f310dc1767a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:02.198013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39372bb8-de1d-4ba6-adac-f310dc1767a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:02.198772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39372bb8-de1d-4ba6-adac-f310dc1767a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:02.199200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39372bb8-de1d-4ba6-adac-f310dc1767a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:02.229154 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-39372bb8-de1d-4ba6-adac-f310dc1767a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Aug 04 04:46:02.229742 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 394/777] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:02 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:02.307586 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1100e3ab-591a-48d0-b344-736b8f2e3250 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:02.309785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1100e3ab-591a-48d0-b344-736b8f2e3250 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:02.316267 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1100e3ab-591a-48d0-b344-736b8f2e3250 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:02.316723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1100e3ab-591a-48d0-b344-736b8f2e3250 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:02.317485 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1100e3ab-591a-48d0-b344-736b8f2e3250 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:02.317950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1100e3ab-591a-48d0-b344-736b8f2e3250 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:02.347916 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1100e3ab-591a-48d0-b344-736b8f2e3250 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045073 Aug 04 04:46:02.348480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 384/778] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:02 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:03.243457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-787e37ce-38f8-4a48-9b11-864ff017ca6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:03.245627 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-787e37ce-38f8-4a48-9b11-864ff017ca6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:03.252150 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-787e37ce-38f8-4a48-9b11-864ff017ca6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:03.252596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-787e37ce-38f8-4a48-9b11-864ff017ca6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:03.253362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-787e37ce-38f8-4a48-9b11-864ff017ca6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:03.253833 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-787e37ce-38f8-4a48-9b11-864ff017ca6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:03.283907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-787e37ce-38f8-4a48-9b11-864ff017ca6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046138 Aug 04 04:46:03.284468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 395/779] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:03 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:03.360365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ea0a8cc7-f46e-4531-acc2-ecf5e8c73bdd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:03.362530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ea0a8cc7-f46e-4531-acc2-ecf5e8c73bdd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:03.369955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea0a8cc7-f46e-4531-acc2-ecf5e8c73bdd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:03.370409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea0a8cc7-f46e-4531-acc2-ecf5e8c73bdd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:03.371183 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea0a8cc7-f46e-4531-acc2-ecf5e8c73bdd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:03.371622 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea0a8cc7-f46e-4531-acc2-ecf5e8c73bdd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:03.401569 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ea0a8cc7-f46e-4531-acc2-ecf5e8c73bdd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045047 Aug 04 04:46:03.402149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 385/780] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:03 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:04.296594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9007a3a2-5f7f-457b-8cbb-0c48f1e1a264 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:04.298976 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9007a3a2-5f7f-457b-8cbb-0c48f1e1a264 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:04.305776 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9007a3a2-5f7f-457b-8cbb-0c48f1e1a264 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:04.306221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9007a3a2-5f7f-457b-8cbb-0c48f1e1a264 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:04.306979 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9007a3a2-5f7f-457b-8cbb-0c48f1e1a264 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:04.307406 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9007a3a2-5f7f-457b-8cbb-0c48f1e1a264 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:04.337937 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9007a3a2-5f7f-457b-8cbb-0c48f1e1a264 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045363 Aug 04 04:46:04.339092 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 396/781] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:04 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:04.414331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-26fe79e8-64f4-49e4-ae8a-1f448d3fee3a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:04.416489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-26fe79e8-64f4-49e4-ae8a-1f448d3fee3a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:04.423114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26fe79e8-64f4-49e4-ae8a-1f448d3fee3a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:04.423576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26fe79e8-64f4-49e4-ae8a-1f448d3fee3a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:04.424394 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26fe79e8-64f4-49e4-ae8a-1f448d3fee3a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:04.424834 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26fe79e8-64f4-49e4-ae8a-1f448d3fee3a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:04.455208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-26fe79e8-64f4-49e4-ae8a-1f448d3fee3a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 Aug 04 04:46:04.455768 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 386/782] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:04 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:05.349976 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dfcc8d17-f232-402f-9edb-c9494d972288 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:05.352181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dfcc8d17-f232-402f-9edb-c9494d972288 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:05.358598 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfcc8d17-f232-402f-9edb-c9494d972288 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:05.359041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfcc8d17-f232-402f-9edb-c9494d972288 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:05.359795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfcc8d17-f232-402f-9edb-c9494d972288 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:05.360226 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfcc8d17-f232-402f-9edb-c9494d972288 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:05.390166 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dfcc8d17-f232-402f-9edb-c9494d972288 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044214 Aug 04 04:46:05.390725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 397/783] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:05 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:05.468362 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dbdafb49-6d68-4c78-9765-7fdf5a8ca339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:05.470516 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dbdafb49-6d68-4c78-9765-7fdf5a8ca339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:05.476983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dbdafb49-6d68-4c78-9765-7fdf5a8ca339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:05.477497 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dbdafb49-6d68-4c78-9765-7fdf5a8ca339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:05.478302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dbdafb49-6d68-4c78-9765-7fdf5a8ca339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:05.478745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dbdafb49-6d68-4c78-9765-7fdf5a8ca339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:05.508646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dbdafb49-6d68-4c78-9765-7fdf5a8ca339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044234 Aug 04 04:46:05.509218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 387/784] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:05 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:06.402653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f1c1c497-d6ce-44c5-aaf0-e5ae651b4f8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:06.404764 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f1c1c497-d6ce-44c5-aaf0-e5ae651b4f8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:06.414442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1c1c497-d6ce-44c5-aaf0-e5ae651b4f8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:06.414442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1c1c497-d6ce-44c5-aaf0-e5ae651b4f8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:06.414912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1c1c497-d6ce-44c5-aaf0-e5ae651b4f8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:06.415662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1c1c497-d6ce-44c5-aaf0-e5ae651b4f8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:06.445765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f1c1c497-d6ce-44c5-aaf0-e5ae651b4f8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047050 Aug 04 04:46:06.446363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 398/785] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:06 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:06.520567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1a925cf4-2bba-43e4-ad78-9537f03ffe2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:06.523068 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1a925cf4-2bba-43e4-ad78-9537f03ffe2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:06.529580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1a925cf4-2bba-43e4-ad78-9537f03ffe2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:06.530041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1a925cf4-2bba-43e4-ad78-9537f03ffe2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:06.530864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1a925cf4-2bba-43e4-ad78-9537f03ffe2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:06.531302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1a925cf4-2bba-43e4-ad78-9537f03ffe2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:06.562798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1a925cf4-2bba-43e4-ad78-9537f03ffe2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046195 Aug 04 04:46:06.563362 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 388/786] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:06 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:07.458093 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-99cc5a30-3893-4f80-bcd4-f591d60739cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:07.460797 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-99cc5a30-3893-4f80-bcd4-f591d60739cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:07.467312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99cc5a30-3893-4f80-bcd4-f591d60739cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:07.467750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99cc5a30-3893-4f80-bcd4-f591d60739cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:07.468514 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99cc5a30-3893-4f80-bcd4-f591d60739cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:07.468945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99cc5a30-3893-4f80-bcd4-f591d60739cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:07.498537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-99cc5a30-3893-4f80-bcd4-f591d60739cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044650 Aug 04 04:46:07.499131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 399/787] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:07 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:46:07.576447 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c133d148-dd3f-410a-b17d-f6b52b695c2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:07.578822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c133d148-dd3f-410a-b17d-f6b52b695c2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:07.586297 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c133d148-dd3f-410a-b17d-f6b52b695c2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:07.586977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c133d148-dd3f-410a-b17d-f6b52b695c2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:07.588050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c133d148-dd3f-410a-b17d-f6b52b695c2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:07.588438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c133d148-dd3f-410a-b17d-f6b52b695c2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:07.625163 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c133d148-dd3f-410a-b17d-f6b52b695c2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053065 Aug 04 04:46:07.625665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 389/788] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:07 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:08.512031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-eb631ec0-4911-4711-bf90-9986e957814b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:08.514229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-eb631ec0-4911-4711-bf90-9986e957814b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:08.520910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-eb631ec0-4911-4711-bf90-9986e957814b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:08.521391 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-eb631ec0-4911-4711-bf90-9986e957814b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:08.522586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-eb631ec0-4911-4711-bf90-9986e957814b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:08.523024 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-eb631ec0-4911-4711-bf90-9986e957814b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:08.552454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-eb631ec0-4911-4711-bf90-9986e957814b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044377 Aug 04 04:46:08.553634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 400/789] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:46:08.639008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e7c496ca-8998-4248-92ef-2d4ba97f154b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:08.641281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e7c496ca-8998-4248-92ef-2d4ba97f154b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:08.648354 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e7c496ca-8998-4248-92ef-2d4ba97f154b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:08.648735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e7c496ca-8998-4248-92ef-2d4ba97f154b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:08.649535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e7c496ca-8998-4248-92ef-2d4ba97f154b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:08.650377 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e7c496ca-8998-4248-92ef-2d4ba97f154b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:08.677251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:08.683642 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e7c496ca-8998-4248-92ef-2d4ba97f154b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048598 Aug 04 04:46:08.684222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 390/790] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:08 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:09.567651 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f1a00625-5bbd-41c7-b335-22fb5a760188 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:09.570439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f1a00625-5bbd-41c7-b335-22fb5a760188 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:09.577133 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1a00625-5bbd-41c7-b335-22fb5a760188 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:09.577602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1a00625-5bbd-41c7-b335-22fb5a760188 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:09.578369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1a00625-5bbd-41c7-b335-22fb5a760188 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:09.578804 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1a00625-5bbd-41c7-b335-22fb5a760188 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:09.611686 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f1a00625-5bbd-41c7-b335-22fb5a760188 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050163 Aug 04 04:46:09.612494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 401/791] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:09 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:09.697021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0a4edc52-278d-4632-901a-9991b74742e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:09.699437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0a4edc52-278d-4632-901a-9991b74742e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:09.701960 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=58 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:09.707664 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a4edc52-278d-4632-901a-9991b74742e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:09.708150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a4edc52-278d-4632-901a-9991b74742e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:09.709696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a4edc52-278d-4632-901a-9991b74742e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:09.710271 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a4edc52-278d-4632-901a-9991b74742e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:09.742441 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0a4edc52-278d-4632-901a-9991b74742e2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050529 Aug 04 04:46:09.742990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 391/792] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:09 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:10.626737 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-868791c0-29a7-42a3-b77a-e59b48afe2a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:10.628771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-868791c0-29a7-42a3-b77a-e59b48afe2a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:10.635750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-868791c0-29a7-42a3-b77a-e59b48afe2a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:10.636194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-868791c0-29a7-42a3-b77a-e59b48afe2a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:10.636949 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-868791c0-29a7-42a3-b77a-e59b48afe2a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:10.637377 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-868791c0-29a7-42a3-b77a-e59b48afe2a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:10.666076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-868791c0-29a7-42a3-b77a-e59b48afe2a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043723 Aug 04 04:46:10.666631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 402/793] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:10.755049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0a422756-7a9e-4111-ac99-6c0fc3318214 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:10.758281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0a422756-7a9e-4111-ac99-6c0fc3318214 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:10.765568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a422756-7a9e-4111-ac99-6c0fc3318214 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:10.766238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a422756-7a9e-4111-ac99-6c0fc3318214 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:10.767006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a422756-7a9e-4111-ac99-6c0fc3318214 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:10.767444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a422756-7a9e-4111-ac99-6c0fc3318214 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:10.801138 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0a422756-7a9e-4111-ac99-6c0fc3318214 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050004 Aug 04 04:46:10.801715 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 392/794] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:10 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:11.679175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0e7c8a4c-fe37-4bc7-b101-3c8521335ece tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:11.681209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0e7c8a4c-fe37-4bc7-b101-3c8521335ece tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:11.687663 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0e7c8a4c-fe37-4bc7-b101-3c8521335ece tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:11.688111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0e7c8a4c-fe37-4bc7-b101-3c8521335ece tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:11.688876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0e7c8a4c-fe37-4bc7-b101-3c8521335ece tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:11.689310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0e7c8a4c-fe37-4bc7-b101-3c8521335ece tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:11.719285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0e7c8a4c-fe37-4bc7-b101-3c8521335ece tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 Aug 04 04:46:11.719841 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 403/795] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:11 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:11.813982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e0912686-c2b0-4291-877e-a11d09dcf15b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:11.816103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e0912686-c2b0-4291-877e-a11d09dcf15b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:11.823049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e0912686-c2b0-4291-877e-a11d09dcf15b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:11.823484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e0912686-c2b0-4291-877e-a11d09dcf15b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:11.824241 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e0912686-c2b0-4291-877e-a11d09dcf15b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:11.824671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e0912686-c2b0-4291-877e-a11d09dcf15b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:11.856370 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e0912686-c2b0-4291-877e-a11d09dcf15b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046302 Aug 04 04:46:11.856924 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 393/796] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:11 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:12.732058 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-72a4fc10-e1f6-4072-9ffb-c4ffed825f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:12.734241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-72a4fc10-e1f6-4072-9ffb-c4ffed825f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:12.736657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=58 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:12.744076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72a4fc10-e1f6-4072-9ffb-c4ffed825f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:12.744526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72a4fc10-e1f6-4072-9ffb-c4ffed825f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:12.745453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72a4fc10-e1f6-4072-9ffb-c4ffed825f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:12.745800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72a4fc10-e1f6-4072-9ffb-c4ffed825f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:12.772808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:12.778529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-72a4fc10-e1f6-4072-9ffb-c4ffed825f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050452 Aug 04 04:46:12.778984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 404/797] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:12 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:12.868446 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0eaa4413-56fc-4bec-9778-b79e46e4c772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:12.870688 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0eaa4413-56fc-4bec-9778-b79e46e4c772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:12.877345 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0eaa4413-56fc-4bec-9778-b79e46e4c772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:12.877831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0eaa4413-56fc-4bec-9778-b79e46e4c772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:12.878606 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0eaa4413-56fc-4bec-9778-b79e46e4c772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:12.879048 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0eaa4413-56fc-4bec-9778-b79e46e4c772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:12.910738 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0eaa4413-56fc-4bec-9778-b79e46e4c772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046433 Aug 04 04:46:12.911584 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 394/798] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:13.791557 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-baaa18df-6bbb-4dca-8aec-783b7e9ec6a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:13.793919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-baaa18df-6bbb-4dca-8aec-783b7e9ec6a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:13.800714 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-baaa18df-6bbb-4dca-8aec-783b7e9ec6a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:13.801167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-baaa18df-6bbb-4dca-8aec-783b7e9ec6a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:13.801993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-baaa18df-6bbb-4dca-8aec-783b7e9ec6a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:13.802978 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-baaa18df-6bbb-4dca-8aec-783b7e9ec6a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:13.834349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-baaa18df-6bbb-4dca-8aec-783b7e9ec6a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046768 Aug 04 04:46:13.835046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 405/799] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:13 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:46:13.925411 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cdae527e-b69a-4cb9-9f33-f78d37e96687 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:13.928153 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cdae527e-b69a-4cb9-9f33-f78d37e96687 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:13.936086 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cdae527e-b69a-4cb9-9f33-f78d37e96687 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:13.936636 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cdae527e-b69a-4cb9-9f33-f78d37e96687 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:13.937463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cdae527e-b69a-4cb9-9f33-f78d37e96687 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:13.938030 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cdae527e-b69a-4cb9-9f33-f78d37e96687 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:13.976840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cdae527e-b69a-4cb9-9f33-f78d37e96687 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056298 Aug 04 04:46:13.977566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 395/800] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:13 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:14.847097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2fc9e438-864d-4a89-9929-df6400427a15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:14.849742 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2fc9e438-864d-4a89-9929-df6400427a15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:14.857177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2fc9e438-864d-4a89-9929-df6400427a15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:14.857788 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2fc9e438-864d-4a89-9929-df6400427a15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:14.858556 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2fc9e438-864d-4a89-9929-df6400427a15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:14.858987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2fc9e438-864d-4a89-9929-df6400427a15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:14.894089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2fc9e438-864d-4a89-9929-df6400427a15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050832 Aug 04 04:46:14.894703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 406/801] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:14 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:14.990894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-76b7ac5a-0b2d-4941-8a79-c7ad789d8915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:14.993068 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-76b7ac5a-0b2d-4941-8a79-c7ad789d8915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:15.007621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-76b7ac5a-0b2d-4941-8a79-c7ad789d8915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:15.007621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-76b7ac5a-0b2d-4941-8a79-c7ad789d8915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:15.007621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-76b7ac5a-0b2d-4941-8a79-c7ad789d8915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:15.007621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-76b7ac5a-0b2d-4941-8a79-c7ad789d8915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:15.032355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-76b7ac5a-0b2d-4941-8a79-c7ad789d8915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Aug 04 04:46:15.032919 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 396/802] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:14 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:15.907941 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-53a2d59b-17d6-4c08-84ff-a490a8651bdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:15.910323 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-53a2d59b-17d6-4c08-84ff-a490a8651bdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:15.918143 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53a2d59b-17d6-4c08-84ff-a490a8651bdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:15.918607 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53a2d59b-17d6-4c08-84ff-a490a8651bdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:15.919413 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53a2d59b-17d6-4c08-84ff-a490a8651bdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:15.919929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53a2d59b-17d6-4c08-84ff-a490a8651bdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:15.951119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-53a2d59b-17d6-4c08-84ff-a490a8651bdc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047637 Aug 04 04:46:15.951708 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 407/803] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:15 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:16.047396 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-aa160019-c469-4070-ac31-51321af99981 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:16.050095 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-aa160019-c469-4070-ac31-51321af99981 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:16.058639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa160019-c469-4070-ac31-51321af99981 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:16.059256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa160019-c469-4070-ac31-51321af99981 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:16.060186 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa160019-c469-4070-ac31-51321af99981 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:16.060753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa160019-c469-4070-ac31-51321af99981 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:16.091764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-aa160019-c469-4070-ac31-51321af99981 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049376 Aug 04 04:46:16.092097 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 397/804] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:16.964643 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cb7f68df-5cef-45cb-ba02-471a85bcedf4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:16.967106 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cb7f68df-5cef-45cb-ba02-471a85bcedf4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:16.973736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb7f68df-5cef-45cb-ba02-471a85bcedf4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:16.974759 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb7f68df-5cef-45cb-ba02-471a85bcedf4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:16.975542 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb7f68df-5cef-45cb-ba02-471a85bcedf4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:16.975989 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb7f68df-5cef-45cb-ba02-471a85bcedf4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:17.006563 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cb7f68df-5cef-45cb-ba02-471a85bcedf4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045909 Aug 04 04:46:17.007138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 408/805] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:16 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:17.105106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d5f1f96c-945a-435b-98f1-eb8a916624d3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:17.107187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d5f1f96c-945a-435b-98f1-eb8a916624d3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:17.113797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5f1f96c-945a-435b-98f1-eb8a916624d3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:17.114254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5f1f96c-945a-435b-98f1-eb8a916624d3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:17.116220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5f1f96c-945a-435b-98f1-eb8a916624d3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:17.116660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5f1f96c-945a-435b-98f1-eb8a916624d3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:17.147034 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d5f1f96c-945a-435b-98f1-eb8a916624d3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045350 Aug 04 04:46:17.147630 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 398/806] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:17 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:46:18.018820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8ebed06c-1cc6-411f-ad85-314aa5fc5b29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:18.021611 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8ebed06c-1cc6-411f-ad85-314aa5fc5b29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:18.028091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ebed06c-1cc6-411f-ad85-314aa5fc5b29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:18.028534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ebed06c-1cc6-411f-ad85-314aa5fc5b29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:18.029284 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ebed06c-1cc6-411f-ad85-314aa5fc5b29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:18.029741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ebed06c-1cc6-411f-ad85-314aa5fc5b29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:18.058271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8ebed06c-1cc6-411f-ad85-314aa5fc5b29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Aug 04 04:46:18.058827 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 409/807] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:18 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:18.159783 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ed8539ce-a4c2-48a4-8014-b3856d9976e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:18.162578 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ed8539ce-a4c2-48a4-8014-b3856d9976e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:18.169217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ed8539ce-a4c2-48a4-8014-b3856d9976e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:18.169702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ed8539ce-a4c2-48a4-8014-b3856d9976e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:18.170473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ed8539ce-a4c2-48a4-8014-b3856d9976e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:18.170909 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ed8539ce-a4c2-48a4-8014-b3856d9976e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:18.203679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ed8539ce-a4c2-48a4-8014-b3856d9976e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047770 Aug 04 04:46:18.204250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 399/808] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:18 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:19.071056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e0032fa8-7980-46c3-a627-36f9880aed65 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:19.073201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e0032fa8-7980-46c3-a627-36f9880aed65 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:19.079900 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e0032fa8-7980-46c3-a627-36f9880aed65 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:19.080343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e0032fa8-7980-46c3-a627-36f9880aed65 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:19.081102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e0032fa8-7980-46c3-a627-36f9880aed65 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:19.081533 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e0032fa8-7980-46c3-a627-36f9880aed65 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:19.111160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e0032fa8-7980-46c3-a627-36f9880aed65 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Aug 04 04:46:19.111707 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 410/809] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:19 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:19.216467 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-24b0d8ca-3225-4c45-b10e-679ee4f7652a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:19.218616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-24b0d8ca-3225-4c45-b10e-679ee4f7652a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:19.225463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24b0d8ca-3225-4c45-b10e-679ee4f7652a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:19.225937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24b0d8ca-3225-4c45-b10e-679ee4f7652a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:19.226696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24b0d8ca-3225-4c45-b10e-679ee4f7652a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:19.227129 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24b0d8ca-3225-4c45-b10e-679ee4f7652a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:19.256638 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-24b0d8ca-3225-4c45-b10e-679ee4f7652a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044121 Aug 04 04:46:19.257191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 400/810] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:20.123810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a9089b95-5e0b-446f-b1c7-f28812339904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:20.126261 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a9089b95-5e0b-446f-b1c7-f28812339904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:20.133372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a9089b95-5e0b-446f-b1c7-f28812339904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:20.133969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a9089b95-5e0b-446f-b1c7-f28812339904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:20.135012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a9089b95-5e0b-446f-b1c7-f28812339904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:20.135577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a9089b95-5e0b-446f-b1c7-f28812339904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:20.164973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a9089b95-5e0b-446f-b1c7-f28812339904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045363 Aug 04 04:46:20.165522 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 411/811] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:20 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:20.268296 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9f1c3828-cfa5-406d-8c96-30fc49a99408 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:20.270443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9f1c3828-cfa5-406d-8c96-30fc49a99408 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:20.276952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f1c3828-cfa5-406d-8c96-30fc49a99408 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:20.277399 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f1c3828-cfa5-406d-8c96-30fc49a99408 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:20.278187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f1c3828-cfa5-406d-8c96-30fc49a99408 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:20.278624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f1c3828-cfa5-406d-8c96-30fc49a99408 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:20.308222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9f1c3828-cfa5-406d-8c96-30fc49a99408 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Aug 04 04:46:20.308764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 401/812] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:21.178385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4ba9ee3a-8ab9-48cd-b7ee-b3040df4fa9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:21.180522 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4ba9ee3a-8ab9-48cd-b7ee-b3040df4fa9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:21.187072 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4ba9ee3a-8ab9-48cd-b7ee-b3040df4fa9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:21.187521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4ba9ee3a-8ab9-48cd-b7ee-b3040df4fa9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:21.188293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4ba9ee3a-8ab9-48cd-b7ee-b3040df4fa9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:21.188725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4ba9ee3a-8ab9-48cd-b7ee-b3040df4fa9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:21.219084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4ba9ee3a-8ab9-48cd-b7ee-b3040df4fa9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Aug 04 04:46:21.219657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 412/813] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:21 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:21.320769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-aa38416c-4105-48fc-9926-5a47d70b85a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:21.322967 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-aa38416c-4105-48fc-9926-5a47d70b85a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:21.329666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa38416c-4105-48fc-9926-5a47d70b85a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:21.330123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa38416c-4105-48fc-9926-5a47d70b85a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:21.330896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa38416c-4105-48fc-9926-5a47d70b85a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:21.331336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa38416c-4105-48fc-9926-5a47d70b85a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:21.362883 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-aa38416c-4105-48fc-9926-5a47d70b85a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046354 Aug 04 04:46:21.363449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 402/814] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:21 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:22.232013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-640556ab-7949-4235-bce8-725c9ec20bbd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:22.234216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-640556ab-7949-4235-bce8-725c9ec20bbd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:22.240975 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-640556ab-7949-4235-bce8-725c9ec20bbd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:22.241420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-640556ab-7949-4235-bce8-725c9ec20bbd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:22.242222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-640556ab-7949-4235-bce8-725c9ec20bbd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:22.242659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-640556ab-7949-4235-bce8-725c9ec20bbd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:22.271611 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-640556ab-7949-4235-bce8-725c9ec20bbd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042939 Aug 04 04:46:22.272108 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 413/815] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:22 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:22.375155 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-28684105-a87d-4b8e-8b8f-bf82c68716a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:22.377271 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-28684105-a87d-4b8e-8b8f-bf82c68716a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:22.384196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-28684105-a87d-4b8e-8b8f-bf82c68716a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:22.384637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-28684105-a87d-4b8e-8b8f-bf82c68716a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:22.385390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-28684105-a87d-4b8e-8b8f-bf82c68716a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:22.385847 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-28684105-a87d-4b8e-8b8f-bf82c68716a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:22.414799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-28684105-a87d-4b8e-8b8f-bf82c68716a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043646 Aug 04 04:46:22.415346 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 403/816] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:22 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:23.284133 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2c6880f8-c4b3-4f35-88ea-1e59a474cd6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:23.287274 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2c6880f8-c4b3-4f35-88ea-1e59a474cd6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:23.294052 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2c6880f8-c4b3-4f35-88ea-1e59a474cd6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:23.294509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2c6880f8-c4b3-4f35-88ea-1e59a474cd6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:23.295666 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2c6880f8-c4b3-4f35-88ea-1e59a474cd6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:23.295781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2c6880f8-c4b3-4f35-88ea-1e59a474cd6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:23.325928 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2c6880f8-c4b3-4f35-88ea-1e59a474cd6c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045710 Aug 04 04:46:23.326598 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 414/817] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:23 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:23.427217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-05cc5943-a5f6-44d2-8742-8e7067729b5a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:23.429348 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-05cc5943-a5f6-44d2-8742-8e7067729b5a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:23.435944 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-05cc5943-a5f6-44d2-8742-8e7067729b5a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:23.436386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-05cc5943-a5f6-44d2-8742-8e7067729b5a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:23.437156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-05cc5943-a5f6-44d2-8742-8e7067729b5a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:23.437610 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-05cc5943-a5f6-44d2-8742-8e7067729b5a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:23.468820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-05cc5943-a5f6-44d2-8742-8e7067729b5a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045688 Aug 04 04:46:23.469388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 404/818] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:23 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:24.340639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0b255c28-6dd3-40c1-9e04-1ba9687b6dcf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:24.342855 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0b255c28-6dd3-40c1-9e04-1ba9687b6dcf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:24.350974 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b255c28-6dd3-40c1-9e04-1ba9687b6dcf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:24.351429 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b255c28-6dd3-40c1-9e04-1ba9687b6dcf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:24.352204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b255c28-6dd3-40c1-9e04-1ba9687b6dcf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:24.352641 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b255c28-6dd3-40c1-9e04-1ba9687b6dcf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:24.382002 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0b255c28-6dd3-40c1-9e04-1ba9687b6dcf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045247 Aug 04 04:46:24.382566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 415/819] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:24 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:24.480443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6ae7368b-6b01-4c07-bc48-3648dfa98235 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:24.482645 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6ae7368b-6b01-4c07-bc48-3648dfa98235 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:24.489180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6ae7368b-6b01-4c07-bc48-3648dfa98235 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:24.489860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6ae7368b-6b01-4c07-bc48-3648dfa98235 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:24.490636 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6ae7368b-6b01-4c07-bc48-3648dfa98235 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:24.491072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6ae7368b-6b01-4c07-bc48-3648dfa98235 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:24.522941 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6ae7368b-6b01-4c07-bc48-3648dfa98235 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046396 Aug 04 04:46:24.523509 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 405/820] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:24 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:25.394003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7da98655-5567-4fb6-a6cc-ad8b12fe41a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:25.397015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7da98655-5567-4fb6-a6cc-ad8b12fe41a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:25.403723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7da98655-5567-4fb6-a6cc-ad8b12fe41a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:25.404170 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7da98655-5567-4fb6-a6cc-ad8b12fe41a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:25.404973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7da98655-5567-4fb6-a6cc-ad8b12fe41a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:25.405412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7da98655-5567-4fb6-a6cc-ad8b12fe41a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:25.435080 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7da98655-5567-4fb6-a6cc-ad8b12fe41a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044987 Aug 04 04:46:25.435653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 416/821] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:25 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:25.535224 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c3857fd1-9d3f-4f9d-a47d-8d54741db301 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:25.537696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c3857fd1-9d3f-4f9d-a47d-8d54741db301 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:25.544204 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3857fd1-9d3f-4f9d-a47d-8d54741db301 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:25.544651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3857fd1-9d3f-4f9d-a47d-8d54741db301 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:25.545428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3857fd1-9d3f-4f9d-a47d-8d54741db301 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:25.545890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3857fd1-9d3f-4f9d-a47d-8d54741db301 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:25.574802 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c3857fd1-9d3f-4f9d-a47d-8d54741db301 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043341 Aug 04 04:46:25.575236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 406/822] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:25 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:26.448787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-086841a3-747d-4291-b277-1af2bd9cd929 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:26.450985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-086841a3-747d-4291-b277-1af2bd9cd929 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:26.457618 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-086841a3-747d-4291-b277-1af2bd9cd929 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:26.458720 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-086841a3-747d-4291-b277-1af2bd9cd929 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:26.459500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-086841a3-747d-4291-b277-1af2bd9cd929 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:26.459936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-086841a3-747d-4291-b277-1af2bd9cd929 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:26.489192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-086841a3-747d-4291-b277-1af2bd9cd929 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045096 Aug 04 04:46:26.489922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 417/823] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:26 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:26.588085 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fd87ef86-b280-4ccf-8dac-99b9040d9339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:26.590308 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fd87ef86-b280-4ccf-8dac-99b9040d9339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:26.596871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fd87ef86-b280-4ccf-8dac-99b9040d9339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:26.597324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fd87ef86-b280-4ccf-8dac-99b9040d9339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:26.598246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fd87ef86-b280-4ccf-8dac-99b9040d9339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:26.599729 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fd87ef86-b280-4ccf-8dac-99b9040d9339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:26.617533 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:26.632261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fd87ef86-b280-4ccf-8dac-99b9040d9339 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049268 Aug 04 04:46:26.632822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 407/824] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:26 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:27.501196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-92e53d02-c38e-4aab-855b-8713ccb3e4d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:27.503385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-92e53d02-c38e-4aab-855b-8713ccb3e4d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:27.510711 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-92e53d02-c38e-4aab-855b-8713ccb3e4d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:27.511162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-92e53d02-c38e-4aab-855b-8713ccb3e4d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:27.511949 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-92e53d02-c38e-4aab-855b-8713ccb3e4d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:27.512388 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-92e53d02-c38e-4aab-855b-8713ccb3e4d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:27.544069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-92e53d02-c38e-4aab-855b-8713ccb3e4d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046778 Aug 04 04:46:27.544634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 418/825] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:27 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:27.644627 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-08be60e6-5882-4c6d-8957-a1f5a4faa46b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:27.647415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-08be60e6-5882-4c6d-8957-a1f5a4faa46b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:27.653974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-08be60e6-5882-4c6d-8957-a1f5a4faa46b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:27.654425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-08be60e6-5882-4c6d-8957-a1f5a4faa46b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:27.655187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-08be60e6-5882-4c6d-8957-a1f5a4faa46b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:27.655622 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-08be60e6-5882-4c6d-8957-a1f5a4faa46b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:27.686485 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-08be60e6-5882-4c6d-8957-a1f5a4faa46b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Aug 04 04:46:27.687200 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 408/826] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:27 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:28.557776 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-224fca7e-53aa-4a25-9eb1-7b57f872cecc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:28.559887 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-224fca7e-53aa-4a25-9eb1-7b57f872cecc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:28.566683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-224fca7e-53aa-4a25-9eb1-7b57f872cecc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:28.567157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-224fca7e-53aa-4a25-9eb1-7b57f872cecc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:28.568557 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-224fca7e-53aa-4a25-9eb1-7b57f872cecc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:28.569078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-224fca7e-53aa-4a25-9eb1-7b57f872cecc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:28.600583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-224fca7e-53aa-4a25-9eb1-7b57f872cecc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047196 Aug 04 04:46:28.601148 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 419/827] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:28 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:28.699306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e6a80906-860b-434e-a148-83012d7d188c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:28.701520 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e6a80906-860b-434e-a148-83012d7d188c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:28.708582 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6a80906-860b-434e-a148-83012d7d188c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:28.709037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6a80906-860b-434e-a148-83012d7d188c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:28.709860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6a80906-860b-434e-a148-83012d7d188c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:28.710314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6a80906-860b-434e-a148-83012d7d188c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:28.748967 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e6a80906-860b-434e-a148-83012d7d188c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053657 Aug 04 04:46:28.749768 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 409/828] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:28 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:29.613222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-047982b9-48a0-4802-8390-b05512e3d69c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:29.615910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-047982b9-48a0-4802-8390-b05512e3d69c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:29.622383 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-047982b9-48a0-4802-8390-b05512e3d69c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:29.622838 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-047982b9-48a0-4802-8390-b05512e3d69c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:29.623596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-047982b9-48a0-4802-8390-b05512e3d69c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:29.624033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-047982b9-48a0-4802-8390-b05512e3d69c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:29.653112 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-047982b9-48a0-4802-8390-b05512e3d69c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043735 Aug 04 04:46:29.653597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 420/829] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:29 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:29.763272 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-031d23c8-c863-4af7-84d7-0bf0c05d22e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:29.765451 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-031d23c8-c863-4af7-84d7-0bf0c05d22e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:29.772311 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-031d23c8-c863-4af7-84d7-0bf0c05d22e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:29.772756 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-031d23c8-c863-4af7-84d7-0bf0c05d22e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:29.773515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-031d23c8-c863-4af7-84d7-0bf0c05d22e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:29.773993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-031d23c8-c863-4af7-84d7-0bf0c05d22e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:29.804072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-031d23c8-c863-4af7-84d7-0bf0c05d22e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 Aug 04 04:46:29.804615 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 410/830] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:29 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:30.665719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a83d13f9-189c-4172-a6fd-c4743530d33c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:30.667749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a83d13f9-189c-4172-a6fd-c4743530d33c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:30.674314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a83d13f9-189c-4172-a6fd-c4743530d33c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:30.674795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a83d13f9-189c-4172-a6fd-c4743530d33c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:30.675561 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a83d13f9-189c-4172-a6fd-c4743530d33c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:30.676004 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a83d13f9-189c-4172-a6fd-c4743530d33c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:30.693913 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:30.706412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a83d13f9-189c-4172-a6fd-c4743530d33c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045528 Aug 04 04:46:30.706971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 421/831] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:30 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:30.816633 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b84cc0f1-4388-49c9-baf5-8476101fc401 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:30.819017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b84cc0f1-4388-49c9-baf5-8476101fc401 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:30.825629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b84cc0f1-4388-49c9-baf5-8476101fc401 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:30.826079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b84cc0f1-4388-49c9-baf5-8476101fc401 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:30.826846 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b84cc0f1-4388-49c9-baf5-8476101fc401 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:30.827281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b84cc0f1-4388-49c9-baf5-8476101fc401 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:30.856754 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b84cc0f1-4388-49c9-baf5-8476101fc401 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044119 Aug 04 04:46:30.857305 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 411/832] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:30 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:31.719012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9829cad8-0c6a-49ba-b194-7db7be20ffb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:31.721084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9829cad8-0c6a-49ba-b194-7db7be20ffb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:31.728653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9829cad8-0c6a-49ba-b194-7db7be20ffb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:31.729103 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9829cad8-0c6a-49ba-b194-7db7be20ffb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:31.729898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9829cad8-0c6a-49ba-b194-7db7be20ffb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:31.730332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9829cad8-0c6a-49ba-b194-7db7be20ffb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:31.758790 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9829cad8-0c6a-49ba-b194-7db7be20ffb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Aug 04 04:46:31.759354 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 422/833] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:31 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:31.868748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bcc73553-7393-4fc3-97ad-a6e0922347b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:31.870923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-bcc73553-7393-4fc3-97ad-a6e0922347b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:31.877527 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bcc73553-7393-4fc3-97ad-a6e0922347b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:31.878047 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bcc73553-7393-4fc3-97ad-a6e0922347b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:31.878801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bcc73553-7393-4fc3-97ad-a6e0922347b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:31.879235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bcc73553-7393-4fc3-97ad-a6e0922347b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:31.908860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-bcc73553-7393-4fc3-97ad-a6e0922347b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044260 Aug 04 04:46:31.909403 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 412/834] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:31 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:32.770268 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f52eb188-81fb-46b0-95cd-abc4044d7534 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:32.772282 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f52eb188-81fb-46b0-95cd-abc4044d7534 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:32.778740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f52eb188-81fb-46b0-95cd-abc4044d7534 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:32.779184 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f52eb188-81fb-46b0-95cd-abc4044d7534 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:32.779941 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f52eb188-81fb-46b0-95cd-abc4044d7534 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:32.780492 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f52eb188-81fb-46b0-95cd-abc4044d7534 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:32.809617 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f52eb188-81fb-46b0-95cd-abc4044d7534 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043326 Aug 04 04:46:32.810159 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 423/835] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:32 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:32.921120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a6886038-dfac-46f7-a971-e229048525ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:32.923288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a6886038-dfac-46f7-a971-e229048525ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:32.930949 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a6886038-dfac-46f7-a971-e229048525ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:32.931399 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a6886038-dfac-46f7-a971-e229048525ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:32.932172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a6886038-dfac-46f7-a971-e229048525ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:32.932617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a6886038-dfac-46f7-a971-e229048525ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:32.962106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a6886038-dfac-46f7-a971-e229048525ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Aug 04 04:46:32.962659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 413/836] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:32 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:33.822882 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e2660811-0e06-4447-992d-7e8ec499e38c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:33.825003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e2660811-0e06-4447-992d-7e8ec499e38c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:33.831580 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e2660811-0e06-4447-992d-7e8ec499e38c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:33.832035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e2660811-0e06-4447-992d-7e8ec499e38c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:33.833673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e2660811-0e06-4447-992d-7e8ec499e38c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:33.834116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e2660811-0e06-4447-992d-7e8ec499e38c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:33.867869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e2660811-0e06-4447-992d-7e8ec499e38c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049255 Aug 04 04:46:33.868436 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 424/837] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:33 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:33.974813 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ea5516bc-404d-458c-a9d7-73e77daff232 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:33.976947 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ea5516bc-404d-458c-a9d7-73e77daff232 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:33.983468 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea5516bc-404d-458c-a9d7-73e77daff232 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:33.983923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea5516bc-404d-458c-a9d7-73e77daff232 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:33.984685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea5516bc-404d-458c-a9d7-73e77daff232 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:33.985123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea5516bc-404d-458c-a9d7-73e77daff232 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:34.017852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ea5516bc-404d-458c-a9d7-73e77daff232 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047441 Aug 04 04:46:34.018409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 414/838] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:33 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:34.881089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a6ba56df-c552-4297-9a31-d8ed2c8a13fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:34.883230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a6ba56df-c552-4297-9a31-d8ed2c8a13fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:34.889796 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a6ba56df-c552-4297-9a31-d8ed2c8a13fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:34.890245 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a6ba56df-c552-4297-9a31-d8ed2c8a13fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:34.891009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a6ba56df-c552-4297-9a31-d8ed2c8a13fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:34.891445 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a6ba56df-c552-4297-9a31-d8ed2c8a13fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:34.919484 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a6ba56df-c552-4297-9a31-d8ed2c8a13fb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043051 Aug 04 04:46:34.920036 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 425/839] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:34 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:35.030926 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6a2fe336-7ed0-4c14-bc6c-e57c81a511d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:35.033081 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6a2fe336-7ed0-4c14-bc6c-e57c81a511d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:35.040633 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6a2fe336-7ed0-4c14-bc6c-e57c81a511d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:35.041089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6a2fe336-7ed0-4c14-bc6c-e57c81a511d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:35.041879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6a2fe336-7ed0-4c14-bc6c-e57c81a511d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:35.042317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6a2fe336-7ed0-4c14-bc6c-e57c81a511d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:35.071440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6a2fe336-7ed0-4c14-bc6c-e57c81a511d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044570 Aug 04 04:46:35.071981 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 415/840] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:35 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:35.932894 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-04e08242-80dc-478f-aaca-b40017e65072 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:35.935078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-04e08242-80dc-478f-aaca-b40017e65072 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:35.941895 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-04e08242-80dc-478f-aaca-b40017e65072 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:35.942715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-04e08242-80dc-478f-aaca-b40017e65072 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:35.943529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-04e08242-80dc-478f-aaca-b40017e65072 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:35.943964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-04e08242-80dc-478f-aaca-b40017e65072 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:35.974511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-04e08242-80dc-478f-aaca-b40017e65072 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 Aug 04 04:46:35.975046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 426/841] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:35 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:36.085170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d82cf751-0644-4038-ae14-5bd644e032b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:36.087414 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d82cf751-0644-4038-ae14-5bd644e032b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:36.095384 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d82cf751-0644-4038-ae14-5bd644e032b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:36.095838 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d82cf751-0644-4038-ae14-5bd644e032b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:36.096611 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d82cf751-0644-4038-ae14-5bd644e032b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:36.097048 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d82cf751-0644-4038-ae14-5bd644e032b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:36.128521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d82cf751-0644-4038-ae14-5bd644e032b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047988 Aug 04 04:46:36.129093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 416/842] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:36 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:36.986849 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cf3e6f15-60d6-48ca-9891-cb4a2702fd0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:36.989715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cf3e6f15-60d6-48ca-9891-cb4a2702fd0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:36.996441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cf3e6f15-60d6-48ca-9891-cb4a2702fd0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:36.996885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cf3e6f15-60d6-48ca-9891-cb4a2702fd0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:36.997684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cf3e6f15-60d6-48ca-9891-cb4a2702fd0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:36.998123 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cf3e6f15-60d6-48ca-9891-cb4a2702fd0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:37.031058 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cf3e6f15-60d6-48ca-9891-cb4a2702fd0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048114 Aug 04 04:46:37.031643 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 427/843] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:36 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:37.141678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c1ec47f2-b61e-4ae8-bd36-0c7730aa106a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:37.143838 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c1ec47f2-b61e-4ae8-bd36-0c7730aa106a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:37.150737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c1ec47f2-b61e-4ae8-bd36-0c7730aa106a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:37.151253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c1ec47f2-b61e-4ae8-bd36-0c7730aa106a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:37.152064 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c1ec47f2-b61e-4ae8-bd36-0c7730aa106a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:37.152550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c1ec47f2-b61e-4ae8-bd36-0c7730aa106a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:37.182740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c1ec47f2-b61e-4ae8-bd36-0c7730aa106a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045267 Aug 04 04:46:37.183301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 417/844] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:37 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:38.044589 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2763cfc7-fd7e-43d8-a4af-ec8ad1e1398c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:38.046727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2763cfc7-fd7e-43d8-a4af-ec8ad1e1398c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:38.054249 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2763cfc7-fd7e-43d8-a4af-ec8ad1e1398c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:38.054694 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2763cfc7-fd7e-43d8-a4af-ec8ad1e1398c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:38.055462 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2763cfc7-fd7e-43d8-a4af-ec8ad1e1398c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:38.055894 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2763cfc7-fd7e-43d8-a4af-ec8ad1e1398c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:38.085681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2763cfc7-fd7e-43d8-a4af-ec8ad1e1398c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045006 Aug 04 04:46:38.086261 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 428/845] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:38 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:38.194853 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-603ba949-2938-4e59-b9e0-33f3da794a7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:38.197016 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-603ba949-2938-4e59-b9e0-33f3da794a7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:38.203636 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-603ba949-2938-4e59-b9e0-33f3da794a7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:38.204084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-603ba949-2938-4e59-b9e0-33f3da794a7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:38.204845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-603ba949-2938-4e59-b9e0-33f3da794a7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:38.205273 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-603ba949-2938-4e59-b9e0-33f3da794a7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:38.235283 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-603ba949-2938-4e59-b9e0-33f3da794a7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044341 Aug 04 04:46:38.235844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 418/846] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:38 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:39.098843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ef0f443c-049a-455c-b43a-d296e811e25c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:39.100944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ef0f443c-049a-455c-b43a-d296e811e25c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:39.108366 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef0f443c-049a-455c-b43a-d296e811e25c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:39.108818 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef0f443c-049a-455c-b43a-d296e811e25c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:39.109614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef0f443c-049a-455c-b43a-d296e811e25c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:39.110053 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef0f443c-049a-455c-b43a-d296e811e25c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:39.141055 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ef0f443c-049a-455c-b43a-d296e811e25c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046614 Aug 04 04:46:39.141055 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 429/847] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:39.249094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-93d5457a-d505-4603-9bdb-653fd620dabc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:39.251258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-93d5457a-d505-4603-9bdb-653fd620dabc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:39.258955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93d5457a-d505-4603-9bdb-653fd620dabc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:39.259401 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93d5457a-d505-4603-9bdb-653fd620dabc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:39.260180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93d5457a-d505-4603-9bdb-653fd620dabc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:39.260618 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93d5457a-d505-4603-9bdb-653fd620dabc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:39.291430 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-93d5457a-d505-4603-9bdb-653fd620dabc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046501 Aug 04 04:46:39.292000 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 419/848] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:39 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:40.154112 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fdbcda4e-c94e-40d1-acd6-76b89ede141f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:40.156313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fdbcda4e-c94e-40d1-acd6-76b89ede141f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:40.163796 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fdbcda4e-c94e-40d1-acd6-76b89ede141f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:40.164251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fdbcda4e-c94e-40d1-acd6-76b89ede141f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:40.165039 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fdbcda4e-c94e-40d1-acd6-76b89ede141f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:40.165480 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fdbcda4e-c94e-40d1-acd6-76b89ede141f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:40.195316 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fdbcda4e-c94e-40d1-acd6-76b89ede141f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045148 Aug 04 04:46:40.195888 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 430/849] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:40 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:40.303137 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ab8a761f-446b-47e0-aeef-bfbaefa8ef35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:40.305299 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ab8a761f-446b-47e0-aeef-bfbaefa8ef35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:40.307707 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=58 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:40.313843 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab8a761f-446b-47e0-aeef-bfbaefa8ef35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:40.314294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab8a761f-446b-47e0-aeef-bfbaefa8ef35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:40.315063 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab8a761f-446b-47e0-aeef-bfbaefa8ef35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:40.315503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab8a761f-446b-47e0-aeef-bfbaefa8ef35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:40.347367 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ab8a761f-446b-47e0-aeef-bfbaefa8ef35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048390 Aug 04 04:46:40.348017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 420/850] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:40 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:41.207180 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-be45f3a5-c008-4ac4-b0a4-8bfd9dfe38b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:41.209566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-be45f3a5-c008-4ac4-b0a4-8bfd9dfe38b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:41.218215 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-be45f3a5-c008-4ac4-b0a4-8bfd9dfe38b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:41.218665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-be45f3a5-c008-4ac4-b0a4-8bfd9dfe38b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:41.219451 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-be45f3a5-c008-4ac4-b0a4-8bfd9dfe38b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:41.219894 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-be45f3a5-c008-4ac4-b0a4-8bfd9dfe38b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:41.251205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-be45f3a5-c008-4ac4-b0a4-8bfd9dfe38b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048241 Aug 04 04:46:41.251780 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 431/851] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:41 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:41.360519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-aee54d29-28e7-4c3b-a4b7-cff9dd8068c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:41.362692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-aee54d29-28e7-4c3b-a4b7-cff9dd8068c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:41.369235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aee54d29-28e7-4c3b-a4b7-cff9dd8068c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:41.369723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aee54d29-28e7-4c3b-a4b7-cff9dd8068c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:41.370516 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aee54d29-28e7-4c3b-a4b7-cff9dd8068c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:41.370946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aee54d29-28e7-4c3b-a4b7-cff9dd8068c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:41.403140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-aee54d29-28e7-4c3b-a4b7-cff9dd8068c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045149 Aug 04 04:46:41.403140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 421/852] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:41 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:42.264281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-06cf6707-721f-42d9-b2c4-009e5acbd46e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:42.266460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-06cf6707-721f-42d9-b2c4-009e5acbd46e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:42.275707 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-06cf6707-721f-42d9-b2c4-009e5acbd46e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:42.276492 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-06cf6707-721f-42d9-b2c4-009e5acbd46e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:42.277871 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-06cf6707-721f-42d9-b2c4-009e5acbd46e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:42.278634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-06cf6707-721f-42d9-b2c4-009e5acbd46e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:42.317870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-06cf6707-721f-42d9-b2c4-009e5acbd46e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057357 Aug 04 04:46:42.318567 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 432/853] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:42 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:42.415235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3894c2b9-bca5-404e-b4d8-a0cb45f0446f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:42.417356 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3894c2b9-bca5-404e-b4d8-a0cb45f0446f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:42.424050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3894c2b9-bca5-404e-b4d8-a0cb45f0446f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:42.424497 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3894c2b9-bca5-404e-b4d8-a0cb45f0446f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:42.425251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3894c2b9-bca5-404e-b4d8-a0cb45f0446f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:42.426211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3894c2b9-bca5-404e-b4d8-a0cb45f0446f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:42.456269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3894c2b9-bca5-404e-b4d8-a0cb45f0446f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044893 Aug 04 04:46:42.456820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 422/854] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:42 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:46:43.330400 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-20ae3d21-78dd-46cd-94ee-2e2c85d37708 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:43.333503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-20ae3d21-78dd-46cd-94ee-2e2c85d37708 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:43.335898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=58 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:43.341515 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20ae3d21-78dd-46cd-94ee-2e2c85d37708 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:43.341988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20ae3d21-78dd-46cd-94ee-2e2c85d37708 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:43.342760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20ae3d21-78dd-46cd-94ee-2e2c85d37708 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:43.343196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20ae3d21-78dd-46cd-94ee-2e2c85d37708 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:43.373199 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-20ae3d21-78dd-46cd-94ee-2e2c85d37708 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046791 Aug 04 04:46:43.373793 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 433/855] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:43 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:43.468796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-848aabc5-e334-4934-8d39-3a99dd552cdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:43.470952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-848aabc5-e334-4934-8d39-3a99dd552cdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:43.478020 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-848aabc5-e334-4934-8d39-3a99dd552cdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:43.478498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-848aabc5-e334-4934-8d39-3a99dd552cdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:43.479349 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-848aabc5-e334-4934-8d39-3a99dd552cdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:43.479809 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-848aabc5-e334-4934-8d39-3a99dd552cdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:43.512522 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-848aabc5-e334-4934-8d39-3a99dd552cdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047559 Aug 04 04:46:43.513100 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 423/856] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:43 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:44.385959 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-aaf5ecaa-12d9-49f5-b48d-2825672b1647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:44.388105 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-aaf5ecaa-12d9-49f5-b48d-2825672b1647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:44.394541 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aaf5ecaa-12d9-49f5-b48d-2825672b1647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:44.394995 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aaf5ecaa-12d9-49f5-b48d-2825672b1647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:44.395770 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aaf5ecaa-12d9-49f5-b48d-2825672b1647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:44.396744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aaf5ecaa-12d9-49f5-b48d-2825672b1647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:44.427952 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-aaf5ecaa-12d9-49f5-b48d-2825672b1647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045952 Aug 04 04:46:44.428524 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 434/857] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:44 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:44.525057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3bc0ac4c-047e-4300-b4ce-9b2ed59bc4ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:44.527289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3bc0ac4c-047e-4300-b4ce-9b2ed59bc4ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:44.534080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3bc0ac4c-047e-4300-b4ce-9b2ed59bc4ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:44.534530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3bc0ac4c-047e-4300-b4ce-9b2ed59bc4ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:44.535371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3bc0ac4c-047e-4300-b4ce-9b2ed59bc4ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:44.536295 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3bc0ac4c-047e-4300-b4ce-9b2ed59bc4ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:44.540207 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:44.568006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3bc0ac4c-047e-4300-b4ce-9b2ed59bc4ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046884 Aug 04 04:46:44.568567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 424/858] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:44 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:45.440297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-65953a54-c797-49c4-9afe-6219e2769965 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:45.443585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-65953a54-c797-49c4-9afe-6219e2769965 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:45.450043 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-65953a54-c797-49c4-9afe-6219e2769965 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:45.450495 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-65953a54-c797-49c4-9afe-6219e2769965 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:45.451258 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-65953a54-c797-49c4-9afe-6219e2769965 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:45.451726 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-65953a54-c797-49c4-9afe-6219e2769965 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:45.481476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-65953a54-c797-49c4-9afe-6219e2769965 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Aug 04 04:46:45.482056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 435/859] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:45 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:45.580113 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8c8ec2d8-498b-4558-92f1-bbe774653112 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:45.582958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8c8ec2d8-498b-4558-92f1-bbe774653112 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:45.589510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8c8ec2d8-498b-4558-92f1-bbe774653112 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:45.589984 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8c8ec2d8-498b-4558-92f1-bbe774653112 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:45.590743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8c8ec2d8-498b-4558-92f1-bbe774653112 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:45.591176 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8c8ec2d8-498b-4558-92f1-bbe774653112 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:45.620035 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8c8ec2d8-498b-4558-92f1-bbe774653112 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Aug 04 04:46:45.620584 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 425/860] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:45 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:46.495078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8918de53-8817-4d1b-9116-c14d82842a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:46.497132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8918de53-8817-4d1b-9116-c14d82842a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:46.503874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8918de53-8817-4d1b-9116-c14d82842a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:46.504443 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8918de53-8817-4d1b-9116-c14d82842a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:46.505290 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8918de53-8817-4d1b-9116-c14d82842a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:46.505821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8918de53-8817-4d1b-9116-c14d82842a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:46.540254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8918de53-8817-4d1b-9116-c14d82842a8d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049159 Aug 04 04:46:46.541032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 436/861] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:46 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:46.633772 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-73204ff9-16a7-46b5-8e7b-ac1fa2ac0f8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:46.635951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-73204ff9-16a7-46b5-8e7b-ac1fa2ac0f8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:46.642684 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73204ff9-16a7-46b5-8e7b-ac1fa2ac0f8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:46.643210 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73204ff9-16a7-46b5-8e7b-ac1fa2ac0f8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:46.644040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73204ff9-16a7-46b5-8e7b-ac1fa2ac0f8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:46.645310 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73204ff9-16a7-46b5-8e7b-ac1fa2ac0f8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:46.677244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-73204ff9-16a7-46b5-8e7b-ac1fa2ac0f8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048592 Aug 04 04:46:46.677851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 426/862] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:46 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:47.552989 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a29933c8-c0f0-49f3-b682-a133800b11e6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:47.555189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a29933c8-c0f0-49f3-b682-a133800b11e6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:47.562447 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a29933c8-c0f0-49f3-b682-a133800b11e6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:47.562900 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a29933c8-c0f0-49f3-b682-a133800b11e6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:47.563699 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a29933c8-c0f0-49f3-b682-a133800b11e6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:47.564139 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a29933c8-c0f0-49f3-b682-a133800b11e6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:47.596723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a29933c8-c0f0-49f3-b682-a133800b11e6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048097 Aug 04 04:46:47.598302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 437/863] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:47 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:47.689359 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-28f2480c-23e4-42ba-95e9-7056ae77db9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:47.692134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-28f2480c-23e4-42ba-95e9-7056ae77db9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:47.698974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-28f2480c-23e4-42ba-95e9-7056ae77db9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:47.699429 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-28f2480c-23e4-42ba-95e9-7056ae77db9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:47.700223 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-28f2480c-23e4-42ba-95e9-7056ae77db9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:47.700663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-28f2480c-23e4-42ba-95e9-7056ae77db9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:47.731814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-28f2480c-23e4-42ba-95e9-7056ae77db9c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046412 Aug 04 04:46:47.732389 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 427/864] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:47 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:48.610626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7d20face-403f-4e1c-beaf-5420108a201a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:48.612989 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7d20face-403f-4e1c-beaf-5420108a201a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:48.620429 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d20face-403f-4e1c-beaf-5420108a201a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:48.621044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d20face-403f-4e1c-beaf-5420108a201a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:48.621912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d20face-403f-4e1c-beaf-5420108a201a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:48.622439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d20face-403f-4e1c-beaf-5420108a201a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:48.626904 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:48.656715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7d20face-403f-4e1c-beaf-5420108a201a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050204 Aug 04 04:46:48.657336 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 438/865] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:48 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:48.744253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c118f69f-ad97-4b32-94e0-c14bdf0f7706 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:48.746409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c118f69f-ad97-4b32-94e0-c14bdf0f7706 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:48.753106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c118f69f-ad97-4b32-94e0-c14bdf0f7706 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:48.754148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c118f69f-ad97-4b32-94e0-c14bdf0f7706 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:48.755260 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c118f69f-ad97-4b32-94e0-c14bdf0f7706 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:48.755671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c118f69f-ad97-4b32-94e0-c14bdf0f7706 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:48.789435 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c118f69f-ad97-4b32-94e0-c14bdf0f7706 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049080 Aug 04 04:46:48.790068 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 428/866] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:48 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:49.669917 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-409ad32a-8db5-4dbf-ae5b-ba190e764621 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:49.672069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-409ad32a-8db5-4dbf-ae5b-ba190e764621 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:49.679358 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-409ad32a-8db5-4dbf-ae5b-ba190e764621 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:49.679813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-409ad32a-8db5-4dbf-ae5b-ba190e764621 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:49.680596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-409ad32a-8db5-4dbf-ae5b-ba190e764621 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:49.681040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-409ad32a-8db5-4dbf-ae5b-ba190e764621 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:49.711576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-409ad32a-8db5-4dbf-ae5b-ba190e764621 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045790 Aug 04 04:46:49.712139 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 439/867] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:49 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:49.802983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-25f25531-ec74-4953-8d29-ee60b096812b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:49.805150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-25f25531-ec74-4953-8d29-ee60b096812b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:49.812298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25f25531-ec74-4953-8d29-ee60b096812b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:49.812751 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25f25531-ec74-4953-8d29-ee60b096812b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:49.813529 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25f25531-ec74-4953-8d29-ee60b096812b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:49.813985 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25f25531-ec74-4953-8d29-ee60b096812b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:49.846244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-25f25531-ec74-4953-8d29-ee60b096812b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048015 Aug 04 04:46:49.846831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 429/868] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:49 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:50.724860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-40bd12cc-5e12-4d9c-8981-a13714752454 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:50.727009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-40bd12cc-5e12-4d9c-8981-a13714752454 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:50.733842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-40bd12cc-5e12-4d9c-8981-a13714752454 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:50.734305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-40bd12cc-5e12-4d9c-8981-a13714752454 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:50.735119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-40bd12cc-5e12-4d9c-8981-a13714752454 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:50.735559 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-40bd12cc-5e12-4d9c-8981-a13714752454 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:50.767689 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-40bd12cc-5e12-4d9c-8981-a13714752454 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047541 Aug 04 04:46:50.768276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 440/869] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:50 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:50.858997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-11184bae-ae43-466d-9a2e-95af41f912b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:50.861160 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-11184bae-ae43-466d-9a2e-95af41f912b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:50.868517 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-11184bae-ae43-466d-9a2e-95af41f912b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:50.868971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-11184bae-ae43-466d-9a2e-95af41f912b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:50.869786 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-11184bae-ae43-466d-9a2e-95af41f912b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:50.870220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-11184bae-ae43-466d-9a2e-95af41f912b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:50.899215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-11184bae-ae43-466d-9a2e-95af41f912b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044198 Aug 04 04:46:50.899766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 430/870] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:50 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:51.780596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d27f9950-4c9d-4738-814d-39201e0fb441 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:51.782620 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d27f9950-4c9d-4738-814d-39201e0fb441 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:51.790488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d27f9950-4c9d-4738-814d-39201e0fb441 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:51.790936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d27f9950-4c9d-4738-814d-39201e0fb441 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:51.791703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d27f9950-4c9d-4738-814d-39201e0fb441 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:51.792138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d27f9950-4c9d-4738-814d-39201e0fb441 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:51.821743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d27f9950-4c9d-4738-814d-39201e0fb441 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Aug 04 04:46:51.822388 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 441/871] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:51 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:51.912501 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cb726034-c7ad-4a90-9319-7a30528ef780 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:51.914651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cb726034-c7ad-4a90-9319-7a30528ef780 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:51.921071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb726034-c7ad-4a90-9319-7a30528ef780 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:51.921520 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb726034-c7ad-4a90-9319-7a30528ef780 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:51.922308 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb726034-c7ad-4a90-9319-7a30528ef780 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:51.922745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb726034-c7ad-4a90-9319-7a30528ef780 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:51.951612 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cb726034-c7ad-4a90-9319-7a30528ef780 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043969 Aug 04 04:46:51.952160 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 431/872] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:51 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:52.833629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ea5ed56d-00d0-4330-ad12-ac764ed0e6ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:52.835741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ea5ed56d-00d0-4330-ad12-ac764ed0e6ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:52.842165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ea5ed56d-00d0-4330-ad12-ac764ed0e6ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:52.842606 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ea5ed56d-00d0-4330-ad12-ac764ed0e6ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:52.843358 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ea5ed56d-00d0-4330-ad12-ac764ed0e6ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:52.843786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ea5ed56d-00d0-4330-ad12-ac764ed0e6ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:52.871719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ea5ed56d-00d0-4330-ad12-ac764ed0e6ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042314 Aug 04 04:46:52.872254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 442/873] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:52 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:52.963825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e535d3f7-b185-4dbd-bb1b-36fa3b5e583a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:52.966052 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e535d3f7-b185-4dbd-bb1b-36fa3b5e583a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:52.973268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e535d3f7-b185-4dbd-bb1b-36fa3b5e583a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:52.973746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e535d3f7-b185-4dbd-bb1b-36fa3b5e583a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:52.974505 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e535d3f7-b185-4dbd-bb1b-36fa3b5e583a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:52.974941 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e535d3f7-b185-4dbd-bb1b-36fa3b5e583a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:53.003971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e535d3f7-b185-4dbd-bb1b-36fa3b5e583a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044006 Aug 04 04:46:53.004526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 432/874] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:52 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:53.884115 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5be79fe2-2694-424d-b147-e392c3fcaf15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:53.886264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5be79fe2-2694-424d-b147-e392c3fcaf15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:53.892713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5be79fe2-2694-424d-b147-e392c3fcaf15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:53.893159 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5be79fe2-2694-424d-b147-e392c3fcaf15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:53.894266 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5be79fe2-2694-424d-b147-e392c3fcaf15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:53.894602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5be79fe2-2694-424d-b147-e392c3fcaf15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:53.922902 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5be79fe2-2694-424d-b147-e392c3fcaf15 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042778 Aug 04 04:46:53.923437 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 443/875] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:53 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:54.016386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2fd2c031-dea5-433b-83fa-b5530236d6ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:54.018534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2fd2c031-dea5-433b-83fa-b5530236d6ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:54.025228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2fd2c031-dea5-433b-83fa-b5530236d6ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:54.025719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2fd2c031-dea5-433b-83fa-b5530236d6ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:54.026487 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2fd2c031-dea5-433b-83fa-b5530236d6ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:54.026923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2fd2c031-dea5-433b-83fa-b5530236d6ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:54.056719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2fd2c031-dea5-433b-83fa-b5530236d6ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044217 Aug 04 04:46:54.057280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 433/876] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:54 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:54.935746 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-072d297e-aef9-48e2-b33b-639d7da7cc19 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:54.937883 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-072d297e-aef9-48e2-b33b-639d7da7cc19 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:54.944842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-072d297e-aef9-48e2-b33b-639d7da7cc19 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:54.945284 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-072d297e-aef9-48e2-b33b-639d7da7cc19 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:54.946071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-072d297e-aef9-48e2-b33b-639d7da7cc19 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:54.946504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-072d297e-aef9-48e2-b33b-639d7da7cc19 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:54.985991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-072d297e-aef9-48e2-b33b-639d7da7cc19 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054112 Aug 04 04:46:54.986537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 444/877] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:54 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:55.069101 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e99b4007-ea29-47ae-9846-ac9815098213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:55.071230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e99b4007-ea29-47ae-9846-ac9815098213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:55.077639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e99b4007-ea29-47ae-9846-ac9815098213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:55.078092 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e99b4007-ea29-47ae-9846-ac9815098213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:55.078846 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e99b4007-ea29-47ae-9846-ac9815098213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:55.079280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e99b4007-ea29-47ae-9846-ac9815098213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:55.108943 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e99b4007-ea29-47ae-9846-ac9815098213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044065 Aug 04 04:46:55.109515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 434/878] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:55 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:55.998562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ac148a93-041c-4fc7-b462-5144077a4976 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:56.000710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ac148a93-041c-4fc7-b462-5144077a4976 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:56.007316 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac148a93-041c-4fc7-b462-5144077a4976 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:56.007759 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac148a93-041c-4fc7-b462-5144077a4976 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:56.008514 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac148a93-041c-4fc7-b462-5144077a4976 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:56.008941 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac148a93-041c-4fc7-b462-5144077a4976 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:56.037190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ac148a93-041c-4fc7-b462-5144077a4976 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Aug 04 04:46:56.037746 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 445/879] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:55 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:56.121154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7c691834-6da5-4ef0-aff5-f3798f20b89f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:56.124366 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7c691834-6da5-4ef0-aff5-f3798f20b89f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:56.131060 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7c691834-6da5-4ef0-aff5-f3798f20b89f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:56.131507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7c691834-6da5-4ef0-aff5-f3798f20b89f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:56.132265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7c691834-6da5-4ef0-aff5-f3798f20b89f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:56.132698 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7c691834-6da5-4ef0-aff5-f3798f20b89f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:56.161565 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7c691834-6da5-4ef0-aff5-f3798f20b89f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Aug 04 04:46:56.162118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 435/880] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:56 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:57.049509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-81342d72-8e8d-4538-b477-5164d8431d2f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:57.051746 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-81342d72-8e8d-4538-b477-5164d8431d2f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:57.058262 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-81342d72-8e8d-4538-b477-5164d8431d2f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:57.058709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-81342d72-8e8d-4538-b477-5164d8431d2f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:57.059466 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-81342d72-8e8d-4538-b477-5164d8431d2f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:57.059902 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-81342d72-8e8d-4538-b477-5164d8431d2f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:57.088619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-81342d72-8e8d-4538-b477-5164d8431d2f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043054 Aug 04 04:46:57.089170 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 446/881] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:57 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:57.173764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-432cb8e7-7bf9-46bd-a6a4-cb3bfec974fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:57.176425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-432cb8e7-7bf9-46bd-a6a4-cb3bfec974fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:57.183013 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-432cb8e7-7bf9-46bd-a6a4-cb3bfec974fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:57.183459 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-432cb8e7-7bf9-46bd-a6a4-cb3bfec974fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:57.184215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-432cb8e7-7bf9-46bd-a6a4-cb3bfec974fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:57.184651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-432cb8e7-7bf9-46bd-a6a4-cb3bfec974fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:57.213278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-432cb8e7-7bf9-46bd-a6a4-cb3bfec974fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Aug 04 04:46:57.213856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 436/882] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:57 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:58.100943 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f30c3be9-8105-42f5-a75f-8a1a41d3c9bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:58.103109 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f30c3be9-8105-42f5-a75f-8a1a41d3c9bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:58.109625 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f30c3be9-8105-42f5-a75f-8a1a41d3c9bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:58.110079 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f30c3be9-8105-42f5-a75f-8a1a41d3c9bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:58.110841 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f30c3be9-8105-42f5-a75f-8a1a41d3c9bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:58.111274 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f30c3be9-8105-42f5-a75f-8a1a41d3c9bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:58.140301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f30c3be9-8105-42f5-a75f-8a1a41d3c9bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043595 Aug 04 04:46:58.140842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 447/883] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:58 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:58.225858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ba17d37f-8276-45cd-ba1d-06cb5387a1be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:58.228021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ba17d37f-8276-45cd-ba1d-06cb5387a1be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:58.234416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ba17d37f-8276-45cd-ba1d-06cb5387a1be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:58.234869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ba17d37f-8276-45cd-ba1d-06cb5387a1be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:58.235630 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ba17d37f-8276-45cd-ba1d-06cb5387a1be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:58.236068 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ba17d37f-8276-45cd-ba1d-06cb5387a1be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:58.264981 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ba17d37f-8276-45cd-ba1d-06cb5387a1be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043564 Aug 04 04:46:58.265525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 437/884] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:58 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:59.152835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7a96a8fd-efb8-430f-b7b0-c0d7c98615f7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:59.154996 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7a96a8fd-efb8-430f-b7b0-c0d7c98615f7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:59.161711 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7a96a8fd-efb8-430f-b7b0-c0d7c98615f7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:59.162155 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7a96a8fd-efb8-430f-b7b0-c0d7c98615f7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:59.162948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7a96a8fd-efb8-430f-b7b0-c0d7c98615f7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:59.163375 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7a96a8fd-efb8-430f-b7b0-c0d7c98615f7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:59.191102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7a96a8fd-efb8-430f-b7b0-c0d7c98615f7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041632 Aug 04 04:46:59.191568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 448/885] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:59 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:46:59.277603 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-11deb849-939c-46d6-923d-44d3c1537a68 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:46:59.279763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-11deb849-939c-46d6-923d-44d3c1537a68 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:46:59.286857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-11deb849-939c-46d6-923d-44d3c1537a68 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:59.287315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-11deb849-939c-46d6-923d-44d3c1537a68 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:59.288085 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-11deb849-939c-46d6-923d-44d3c1537a68 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:46:59.288529 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-11deb849-939c-46d6-923d-44d3c1537a68 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:46:59.317720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-11deb849-939c-46d6-923d-44d3c1537a68 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044102 Aug 04 04:46:59.318283 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 438/886] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:46:59 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:00.203448 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4361ad55-0a9a-4a72-8158-3602463652c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:00.205618 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4361ad55-0a9a-4a72-8158-3602463652c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:00.212831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4361ad55-0a9a-4a72-8158-3602463652c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:00.213283 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4361ad55-0a9a-4a72-8158-3602463652c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:00.214169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4361ad55-0a9a-4a72-8158-3602463652c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:00.214605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4361ad55-0a9a-4a72-8158-3602463652c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:00.243460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4361ad55-0a9a-4a72-8158-3602463652c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Aug 04 04:47:00.244012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 449/887] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:00 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:00.329567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0816857e-f62e-4064-9669-a334b1269bd6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:00.332752 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0816857e-f62e-4064-9669-a334b1269bd6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:00.339461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0816857e-f62e-4064-9669-a334b1269bd6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:00.339918 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0816857e-f62e-4064-9669-a334b1269bd6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:00.340977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0816857e-f62e-4064-9669-a334b1269bd6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:00.341450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0816857e-f62e-4064-9669-a334b1269bd6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:00.372249 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0816857e-f62e-4064-9669-a334b1269bd6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046596 Aug 04 04:47:00.372806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 439/888] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:00 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:01.256459 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-02be233c-ad0f-4ee3-8302-d907e7aa0d90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:01.258559 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-02be233c-ad0f-4ee3-8302-d907e7aa0d90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:01.265054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02be233c-ad0f-4ee3-8302-d907e7aa0d90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:01.265505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02be233c-ad0f-4ee3-8302-d907e7aa0d90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:01.266301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02be233c-ad0f-4ee3-8302-d907e7aa0d90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:01.266743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02be233c-ad0f-4ee3-8302-d907e7aa0d90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:01.295623 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-02be233c-ad0f-4ee3-8302-d907e7aa0d90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043884 Aug 04 04:47:01.296169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 450/889] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:01 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:01.384945 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c0e60239-beac-4d2c-9902-4a656ebbbe7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:01.387134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c0e60239-beac-4d2c-9902-4a656ebbbe7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:01.394140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c0e60239-beac-4d2c-9902-4a656ebbbe7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:01.394750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c0e60239-beac-4d2c-9902-4a656ebbbe7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:01.395510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c0e60239-beac-4d2c-9902-4a656ebbbe7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:01.396117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c0e60239-beac-4d2c-9902-4a656ebbbe7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:01.421464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:01.426605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c0e60239-beac-4d2c-9902-4a656ebbbe7b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045633 Aug 04 04:47:01.427169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 440/890] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:01 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:02.307950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1827ae19-f08e-4949-b6b4-0c480a4a0024 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:02.310095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1827ae19-f08e-4949-b6b4-0c480a4a0024 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:02.317580 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1827ae19-f08e-4949-b6b4-0c480a4a0024 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:02.318031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1827ae19-f08e-4949-b6b4-0c480a4a0024 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:02.318796 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1827ae19-f08e-4949-b6b4-0c480a4a0024 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:02.319229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1827ae19-f08e-4949-b6b4-0c480a4a0024 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:02.347778 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1827ae19-f08e-4949-b6b4-0c480a4a0024 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043776 Aug 04 04:47:02.348314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 451/891] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:02 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:02.438926 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-18313d80-f768-4064-a01f-cd315b324be6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:02.441114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-18313d80-f768-4064-a01f-cd315b324be6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:02.447973 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-18313d80-f768-4064-a01f-cd315b324be6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:02.448422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-18313d80-f768-4064-a01f-cd315b324be6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:02.449206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-18313d80-f768-4064-a01f-cd315b324be6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:02.449670 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-18313d80-f768-4064-a01f-cd315b324be6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:02.477680 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-18313d80-f768-4064-a01f-cd315b324be6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042929 Aug 04 04:47:02.478227 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 441/892] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:02 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:03.359881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-98c360b9-27d3-4a49-9f0b-e9ccbf9a5f64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:03.362590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-98c360b9-27d3-4a49-9f0b-e9ccbf9a5f64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:03.368872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98c360b9-27d3-4a49-9f0b-e9ccbf9a5f64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:03.369317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98c360b9-27d3-4a49-9f0b-e9ccbf9a5f64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:03.370114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98c360b9-27d3-4a49-9f0b-e9ccbf9a5f64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:03.370548 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98c360b9-27d3-4a49-9f0b-e9ccbf9a5f64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:03.399404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-98c360b9-27d3-4a49-9f0b-e9ccbf9a5f64 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043405 Aug 04 04:47:03.399967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 452/893] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:03 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:03.490432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4fb33d62-f2f3-400d-a059-74c70fd807bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:03.492554 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4fb33d62-f2f3-400d-a059-74c70fd807bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:03.499062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fb33d62-f2f3-400d-a059-74c70fd807bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:03.499424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fb33d62-f2f3-400d-a059-74c70fd807bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:03.500181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fb33d62-f2f3-400d-a059-74c70fd807bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:03.500615 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fb33d62-f2f3-400d-a059-74c70fd807bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:03.529599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4fb33d62-f2f3-400d-a059-74c70fd807bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043670 Aug 04 04:47:03.530156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 442/894] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:03 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:04.412203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-74ea7b9b-ddbd-43e5-9beb-6deb470cd3f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:04.414461 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-74ea7b9b-ddbd-43e5-9beb-6deb470cd3f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:04.421016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-74ea7b9b-ddbd-43e5-9beb-6deb470cd3f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:04.421464 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-74ea7b9b-ddbd-43e5-9beb-6deb470cd3f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:04.422261 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-74ea7b9b-ddbd-43e5-9beb-6deb470cd3f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:04.422698 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-74ea7b9b-ddbd-43e5-9beb-6deb470cd3f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:04.452744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-74ea7b9b-ddbd-43e5-9beb-6deb470cd3f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045085 Aug 04 04:47:04.453295 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 453/895] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:04 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:04.542231 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-190c87be-507b-4bd8-a950-17718576a129 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:04.544372 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-190c87be-507b-4bd8-a950-17718576a129 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:04.551025 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-190c87be-507b-4bd8-a950-17718576a129 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:04.551485 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-190c87be-507b-4bd8-a950-17718576a129 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:04.552279 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-190c87be-507b-4bd8-a950-17718576a129 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:04.552718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-190c87be-507b-4bd8-a950-17718576a129 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:04.582394 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-190c87be-507b-4bd8-a950-17718576a129 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 Aug 04 04:47:04.582950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 443/896] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:04 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:05.466030 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-600bfc83-61d7-4767-8f56-3c609a343a54 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:05.468175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-600bfc83-61d7-4767-8f56-3c609a343a54 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:05.475367 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-600bfc83-61d7-4767-8f56-3c609a343a54 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:05.475815 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-600bfc83-61d7-4767-8f56-3c609a343a54 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:05.476575 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-600bfc83-61d7-4767-8f56-3c609a343a54 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:05.477009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-600bfc83-61d7-4767-8f56-3c609a343a54 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:05.501253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:05.506776 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-600bfc83-61d7-4767-8f56-3c609a343a54 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 Aug 04 04:47:05.507348 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 454/897] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:05 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:05.594461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-96ff6b54-3b0c-4d61-a773-1ce815db2209 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:05.596942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-96ff6b54-3b0c-4d61-a773-1ce815db2209 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:05.603092 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-96ff6b54-3b0c-4d61-a773-1ce815db2209 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:05.603541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-96ff6b54-3b0c-4d61-a773-1ce815db2209 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:05.604291 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-96ff6b54-3b0c-4d61-a773-1ce815db2209 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:05.604726 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-96ff6b54-3b0c-4d61-a773-1ce815db2209 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:05.634290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-96ff6b54-3b0c-4d61-a773-1ce815db2209 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Aug 04 04:47:05.634840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 444/898] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:05 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:06.519195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cd969654-3511-45b3-904d-c3416330adfd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:06.521368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cd969654-3511-45b3-904d-c3416330adfd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:06.527870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cd969654-3511-45b3-904d-c3416330adfd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:06.528326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cd969654-3511-45b3-904d-c3416330adfd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:06.529095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cd969654-3511-45b3-904d-c3416330adfd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:06.529534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cd969654-3511-45b3-904d-c3416330adfd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:06.558330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cd969654-3511-45b3-904d-c3416330adfd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Aug 04 04:47:06.558876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 455/899] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:06 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:06.646817 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fe8c18e5-e141-4423-a79b-4f79c0eb3ed8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:06.648955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fe8c18e5-e141-4423-a79b-4f79c0eb3ed8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:06.655454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fe8c18e5-e141-4423-a79b-4f79c0eb3ed8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:06.655904 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fe8c18e5-e141-4423-a79b-4f79c0eb3ed8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:06.656668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fe8c18e5-e141-4423-a79b-4f79c0eb3ed8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:06.657102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fe8c18e5-e141-4423-a79b-4f79c0eb3ed8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:06.687253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fe8c18e5-e141-4423-a79b-4f79c0eb3ed8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Aug 04 04:47:06.687808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 445/900] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:06 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:07.573302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-304119b0-d0f7-448b-9ad1-3ca39d851d76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:07.575529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-304119b0-d0f7-448b-9ad1-3ca39d851d76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:07.582994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-304119b0-d0f7-448b-9ad1-3ca39d851d76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:07.583449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-304119b0-d0f7-448b-9ad1-3ca39d851d76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:07.584233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-304119b0-d0f7-448b-9ad1-3ca39d851d76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:07.584668 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-304119b0-d0f7-448b-9ad1-3ca39d851d76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:07.614319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-304119b0-d0f7-448b-9ad1-3ca39d851d76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047446 Aug 04 04:47:07.614872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 456/901] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:07 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:07.698764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-177380fc-2022-4c39-9447-1c71a19d0655 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:07.700812 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-177380fc-2022-4c39-9447-1c71a19d0655 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:07.707806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-177380fc-2022-4c39-9447-1c71a19d0655 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:07.708256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-177380fc-2022-4c39-9447-1c71a19d0655 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:07.709014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-177380fc-2022-4c39-9447-1c71a19d0655 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:07.709453 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-177380fc-2022-4c39-9447-1c71a19d0655 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:07.743937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-177380fc-2022-4c39-9447-1c71a19d0655 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049155 Aug 04 04:47:07.744490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 446/902] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:07 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:47:08.626648 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dfff0d40-99bc-4e2e-a362-cc53c97f8475 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:08.628940 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dfff0d40-99bc-4e2e-a362-cc53c97f8475 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:08.635478 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfff0d40-99bc-4e2e-a362-cc53c97f8475 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:08.635923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfff0d40-99bc-4e2e-a362-cc53c97f8475 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:08.636679 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfff0d40-99bc-4e2e-a362-cc53c97f8475 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:08.637112 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dfff0d40-99bc-4e2e-a362-cc53c97f8475 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:08.668658 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dfff0d40-99bc-4e2e-a362-cc53c97f8475 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045893 Aug 04 04:47:08.669220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 457/903] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:08.757199 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-56c92f5a-91cd-4b13-88af-94112af5db3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:08.759254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-56c92f5a-91cd-4b13-88af-94112af5db3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:08.765202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56c92f5a-91cd-4b13-88af-94112af5db3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:08.765679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56c92f5a-91cd-4b13-88af-94112af5db3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:08.766434 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56c92f5a-91cd-4b13-88af-94112af5db3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:08.766864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56c92f5a-91cd-4b13-88af-94112af5db3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:08.799985 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-56c92f5a-91cd-4b13-88af-94112af5db3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047215 Aug 04 04:47:08.800524 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 447/904] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:08 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:09.681085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c793c15b-b20d-466d-8229-3a82a651218c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:09.683164 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c793c15b-b20d-466d-8229-3a82a651218c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:09.690177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c793c15b-b20d-466d-8229-3a82a651218c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:09.690851 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c793c15b-b20d-466d-8229-3a82a651218c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:09.691465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c793c15b-b20d-466d-8229-3a82a651218c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:09.691904 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c793c15b-b20d-466d-8229-3a82a651218c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:09.720218 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c793c15b-b20d-466d-8229-3a82a651218c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Aug 04 04:47:09.720760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 458/905] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:09 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:09.811989 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-db66c821-288a-4356-bfa3-bcd0a7b01d31 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:09.814131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-db66c821-288a-4356-bfa3-bcd0a7b01d31 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:09.821157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db66c821-288a-4356-bfa3-bcd0a7b01d31 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:09.821642 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db66c821-288a-4356-bfa3-bcd0a7b01d31 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:09.822400 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db66c821-288a-4356-bfa3-bcd0a7b01d31 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:09.822859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db66c821-288a-4356-bfa3-bcd0a7b01d31 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:09.851985 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-db66c821-288a-4356-bfa3-bcd0a7b01d31 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043899 Aug 04 04:47:09.852528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 448/906] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:09 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:10.732774 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a5aa7614-3513-4d3b-bb5e-6f11948c9f55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:10.734879 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a5aa7614-3513-4d3b-bb5e-6f11948c9f55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:10.741007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a5aa7614-3513-4d3b-bb5e-6f11948c9f55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:10.741457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a5aa7614-3513-4d3b-bb5e-6f11948c9f55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:10.742252 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a5aa7614-3513-4d3b-bb5e-6f11948c9f55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:10.742689 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a5aa7614-3513-4d3b-bb5e-6f11948c9f55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:10.771533 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a5aa7614-3513-4d3b-bb5e-6f11948c9f55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042941 Aug 04 04:47:10.772088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 459/907] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:10.864332 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-801d42c3-aae7-4b94-8437-d62699231a64 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:10.866508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-801d42c3-aae7-4b94-8437-d62699231a64 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:10.868841 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=58 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:10.874069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-801d42c3-aae7-4b94-8437-d62699231a64 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:10.874513 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-801d42c3-aae7-4b94-8437-d62699231a64 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:10.875298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-801d42c3-aae7-4b94-8437-d62699231a64 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:10.875728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-801d42c3-aae7-4b94-8437-d62699231a64 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:10.904237 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-801d42c3-aae7-4b94-8437-d62699231a64 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043961 Aug 04 04:47:10.904769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 449/908] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:10 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:11.784347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cfb20ff5-ee6a-4422-b83d-1cb74ea90f72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:11.786781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cfb20ff5-ee6a-4422-b83d-1cb74ea90f72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:11.793243 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cfb20ff5-ee6a-4422-b83d-1cb74ea90f72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:11.793733 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cfb20ff5-ee6a-4422-b83d-1cb74ea90f72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:11.794505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cfb20ff5-ee6a-4422-b83d-1cb74ea90f72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:11.794945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cfb20ff5-ee6a-4422-b83d-1cb74ea90f72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:11.823700 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cfb20ff5-ee6a-4422-b83d-1cb74ea90f72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Aug 04 04:47:11.824244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 460/909] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:11 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:11.916945 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-046d9fcd-3856-4d0f-b86a-affd93c87644 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:11.919091 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-046d9fcd-3856-4d0f-b86a-affd93c87644 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:11.925922 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-046d9fcd-3856-4d0f-b86a-affd93c87644 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:11.926447 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-046d9fcd-3856-4d0f-b86a-affd93c87644 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:11.927217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-046d9fcd-3856-4d0f-b86a-affd93c87644 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:11.927661 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-046d9fcd-3856-4d0f-b86a-affd93c87644 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:11.957356 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-046d9fcd-3856-4d0f-b86a-affd93c87644 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Aug 04 04:47:11.957930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 450/910] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:11 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:12.835918 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-83f91304-f682-4fd5-bcae-2c225c37307e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:12.838187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-83f91304-f682-4fd5-bcae-2c225c37307e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:12.844586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-83f91304-f682-4fd5-bcae-2c225c37307e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:12.845028 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-83f91304-f682-4fd5-bcae-2c225c37307e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:12.846394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-83f91304-f682-4fd5-bcae-2c225c37307e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:12.846860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-83f91304-f682-4fd5-bcae-2c225c37307e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:12.874183 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-83f91304-f682-4fd5-bcae-2c225c37307e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042362 Aug 04 04:47:12.875041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 461/911] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:12 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:12.969289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9f8736ed-bef5-47b7-8891-9b1a8b77d415 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:12.971543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9f8736ed-bef5-47b7-8891-9b1a8b77d415 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:12.978299 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f8736ed-bef5-47b7-8891-9b1a8b77d415 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:12.978747 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f8736ed-bef5-47b7-8891-9b1a8b77d415 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:12.979506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f8736ed-bef5-47b7-8891-9b1a8b77d415 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:12.979938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f8736ed-bef5-47b7-8891-9b1a8b77d415 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:13.007795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9f8736ed-bef5-47b7-8891-9b1a8b77d415 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042343 Aug 04 04:47:13.008343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 451/912] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:13.886804 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5b3edacc-f697-4319-8c95-901e32169d6e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:13.888945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5b3edacc-f697-4319-8c95-901e32169d6e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:13.891241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=58 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:13.896828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5b3edacc-f697-4319-8c95-901e32169d6e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:13.897271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5b3edacc-f697-4319-8c95-901e32169d6e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:13.898081 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5b3edacc-f697-4319-8c95-901e32169d6e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:13.898768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5b3edacc-f697-4319-8c95-901e32169d6e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:13.927448 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5b3edacc-f697-4319-8c95-901e32169d6e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Aug 04 04:47:13.927993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 462/913] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:13 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:14.020105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-deeaa773-aa38-4d19-8dec-70d8b870b4ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:14.022266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-deeaa773-aa38-4d19-8dec-70d8b870b4ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:14.028665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-deeaa773-aa38-4d19-8dec-70d8b870b4ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:14.029171 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-deeaa773-aa38-4d19-8dec-70d8b870b4ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:14.029904 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-deeaa773-aa38-4d19-8dec-70d8b870b4ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:14.030339 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-deeaa773-aa38-4d19-8dec-70d8b870b4ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:14.060191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-deeaa773-aa38-4d19-8dec-70d8b870b4ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 Aug 04 04:47:14.060730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 452/914] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:14 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:14.939822 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5a3ea9ce-2e4b-4105-9a01-f636449d7ed1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:14.942003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5a3ea9ce-2e4b-4105-9a01-f636449d7ed1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:14.948384 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a3ea9ce-2e4b-4105-9a01-f636449d7ed1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:14.948824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a3ea9ce-2e4b-4105-9a01-f636449d7ed1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:14.949596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a3ea9ce-2e4b-4105-9a01-f636449d7ed1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:14.950030 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a3ea9ce-2e4b-4105-9a01-f636449d7ed1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:14.977864 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5a3ea9ce-2e4b-4105-9a01-f636449d7ed1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042085 Aug 04 04:47:14.978398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 463/915] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:14 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:15.071550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-51fec20b-2e74-4cdf-a1dd-312b3a46bd2a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:15.073699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-51fec20b-2e74-4cdf-a1dd-312b3a46bd2a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:15.080600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-51fec20b-2e74-4cdf-a1dd-312b3a46bd2a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:15.081065 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-51fec20b-2e74-4cdf-a1dd-312b3a46bd2a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:15.081932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-51fec20b-2e74-4cdf-a1dd-312b3a46bd2a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:15.082363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-51fec20b-2e74-4cdf-a1dd-312b3a46bd2a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:15.111092 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-51fec20b-2e74-4cdf-a1dd-312b3a46bd2a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043406 Aug 04 04:47:15.111691 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 453/916] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:15 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:15.991285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e6920265-49d1-4114-a1df-a3fa1f080f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:15.993394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e6920265-49d1-4114-a1df-a3fa1f080f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:15.999363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e6920265-49d1-4114-a1df-a3fa1f080f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:15.999811 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e6920265-49d1-4114-a1df-a3fa1f080f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:16.000568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e6920265-49d1-4114-a1df-a3fa1f080f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:16.001002 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e6920265-49d1-4114-a1df-a3fa1f080f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:16.029952 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e6920265-49d1-4114-a1df-a3fa1f080f7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043749 Aug 04 04:47:16.030505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 464/917] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:15 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:47:16.123442 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9b71682a-faf8-49ef-aa2f-552dece99fd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:16.125659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9b71682a-faf8-49ef-aa2f-552dece99fd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:16.132931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9b71682a-faf8-49ef-aa2f-552dece99fd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:16.133409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9b71682a-faf8-49ef-aa2f-552dece99fd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:16.134192 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9b71682a-faf8-49ef-aa2f-552dece99fd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:16.134624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9b71682a-faf8-49ef-aa2f-552dece99fd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:16.163906 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9b71682a-faf8-49ef-aa2f-552dece99fd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Aug 04 04:47:16.164513 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 454/918] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:17.042245 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cb3ec320-75d2-4a83-925a-6312061646d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:17.044361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cb3ec320-75d2-4a83-925a-6312061646d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:17.051582 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb3ec320-75d2-4a83-925a-6312061646d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:17.052031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb3ec320-75d2-4a83-925a-6312061646d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:17.052790 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb3ec320-75d2-4a83-925a-6312061646d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:17.053229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb3ec320-75d2-4a83-925a-6312061646d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:17.080815 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cb3ec320-75d2-4a83-925a-6312061646d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042384 Aug 04 04:47:17.081362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 465/919] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:17 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:17.176743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fe4addbb-9174-43dc-b3b2-08e22dd762ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:17.178947 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fe4addbb-9174-43dc-b3b2-08e22dd762ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:17.185340 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fe4addbb-9174-43dc-b3b2-08e22dd762ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:17.185821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fe4addbb-9174-43dc-b3b2-08e22dd762ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:17.186576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fe4addbb-9174-43dc-b3b2-08e22dd762ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:17.187008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fe4addbb-9174-43dc-b3b2-08e22dd762ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:17.215914 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fe4addbb-9174-43dc-b3b2-08e22dd762ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043802 Aug 04 04:47:17.216453 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 455/920] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:17 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:18.092966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e4609ef3-7958-447b-b90f-d56b546d490e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:18.095128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e4609ef3-7958-447b-b90f-d56b546d490e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:18.101631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e4609ef3-7958-447b-b90f-d56b546d490e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:18.102079 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e4609ef3-7958-447b-b90f-d56b546d490e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:18.102833 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e4609ef3-7958-447b-b90f-d56b546d490e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:18.103264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e4609ef3-7958-447b-b90f-d56b546d490e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:18.132363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e4609ef3-7958-447b-b90f-d56b546d490e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Aug 04 04:47:18.132924 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 466/921] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:18 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:18.228773 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4572d71b-2b58-4c15-87d4-ec14b23be288 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:18.230959 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4572d71b-2b58-4c15-87d4-ec14b23be288 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:18.238116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4572d71b-2b58-4c15-87d4-ec14b23be288 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:18.238568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4572d71b-2b58-4c15-87d4-ec14b23be288 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:18.239362 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4572d71b-2b58-4c15-87d4-ec14b23be288 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:18.239796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4572d71b-2b58-4c15-87d4-ec14b23be288 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:18.269443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4572d71b-2b58-4c15-87d4-ec14b23be288 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 Aug 04 04:47:18.270125 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 456/922] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:18 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:19.144692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c6d90d70-15ad-4815-a9aa-d63719e7bd45 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:19.146849 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c6d90d70-15ad-4815-a9aa-d63719e7bd45 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:19.153368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6d90d70-15ad-4815-a9aa-d63719e7bd45 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:19.153845 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6d90d70-15ad-4815-a9aa-d63719e7bd45 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:19.154609 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6d90d70-15ad-4815-a9aa-d63719e7bd45 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:19.155044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6d90d70-15ad-4815-a9aa-d63719e7bd45 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:19.184078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c6d90d70-15ad-4815-a9aa-d63719e7bd45 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043466 Aug 04 04:47:19.184621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 467/923] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:19 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:19.281294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f7498046-75b1-425a-acee-29c19b670f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:19.284051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f7498046-75b1-425a-acee-29c19b670f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:19.290931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7498046-75b1-425a-acee-29c19b670f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:19.291382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7498046-75b1-425a-acee-29c19b670f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:19.292148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7498046-75b1-425a-acee-29c19b670f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:19.292585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7498046-75b1-425a-acee-29c19b670f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:19.309724 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:19.323875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f7498046-75b1-425a-acee-29c19b670f22 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046468 Aug 04 04:47:19.324436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 457/924] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:19.751290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:47:19.751483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 04:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:47:20.196292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a59e50aa-d9b9-4c15-9498-d9fdbfb70106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:20.198472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a59e50aa-d9b9-4c15-9498-d9fdbfb70106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:20.205468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a59e50aa-d9b9-4c15-9498-d9fdbfb70106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:20.205938 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a59e50aa-d9b9-4c15-9498-d9fdbfb70106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:20.206885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a59e50aa-d9b9-4c15-9498-d9fdbfb70106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:20.207317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a59e50aa-d9b9-4c15-9498-d9fdbfb70106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:20.234730 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a59e50aa-d9b9-4c15-9498-d9fdbfb70106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 Aug 04 04:47:20.235274 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 468/925] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:20 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:20.336587 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e079719b-f40c-4fbd-b9e9-c7d103be6d0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:20.338791 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e079719b-f40c-4fbd-b9e9-c7d103be6d0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:20.347667 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e079719b-f40c-4fbd-b9e9-c7d103be6d0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:20.348299 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e079719b-f40c-4fbd-b9e9-c7d103be6d0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:20.349305 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e079719b-f40c-4fbd-b9e9-c7d103be6d0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:20.349852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e079719b-f40c-4fbd-b9e9-c7d103be6d0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:20.380298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e079719b-f40c-4fbd-b9e9-c7d103be6d0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047669 Aug 04 04:47:20.380844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 458/926] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:21.246506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dd52d7b7-181d-451e-862b-5af2250d85c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:21.248615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dd52d7b7-181d-451e-862b-5af2250d85c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:21.255194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd52d7b7-181d-451e-862b-5af2250d85c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:21.255634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd52d7b7-181d-451e-862b-5af2250d85c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:21.256386 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd52d7b7-181d-451e-862b-5af2250d85c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:21.256816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd52d7b7-181d-451e-862b-5af2250d85c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:21.286415 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dd52d7b7-181d-451e-862b-5af2250d85c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043846 Aug 04 04:47:21.286965 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 469/927] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:21 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:21.392966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-80ace907-aa2d-41fa-bde1-9b0818eddcca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:21.395464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-80ace907-aa2d-41fa-bde1-9b0818eddcca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:21.402034 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80ace907-aa2d-41fa-bde1-9b0818eddcca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:21.402484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80ace907-aa2d-41fa-bde1-9b0818eddcca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:21.403247 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80ace907-aa2d-41fa-bde1-9b0818eddcca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:21.403684 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80ace907-aa2d-41fa-bde1-9b0818eddcca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:21.433275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-80ace907-aa2d-41fa-bde1-9b0818eddcca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044840 Aug 04 04:47:21.433850 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 459/928] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:21 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:22.299291 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0768a0d8-eff8-47cd-b7e3-d69dbd3512df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:22.301711 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0768a0d8-eff8-47cd-b7e3-d69dbd3512df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:22.308153 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0768a0d8-eff8-47cd-b7e3-d69dbd3512df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:22.308596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0768a0d8-eff8-47cd-b7e3-d69dbd3512df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:22.309347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0768a0d8-eff8-47cd-b7e3-d69dbd3512df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:22.309806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0768a0d8-eff8-47cd-b7e3-d69dbd3512df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:22.340939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0768a0d8-eff8-47cd-b7e3-d69dbd3512df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046237 Aug 04 04:47:22.341486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 470/929] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:22 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:22.446628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d94ff22b-0293-4c29-bc62-9347bf366597 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:22.448769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d94ff22b-0293-4c29-bc62-9347bf366597 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:22.456918 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d94ff22b-0293-4c29-bc62-9347bf366597 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:22.457361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d94ff22b-0293-4c29-bc62-9347bf366597 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:22.458156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d94ff22b-0293-4c29-bc62-9347bf366597 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:22.458593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d94ff22b-0293-4c29-bc62-9347bf366597 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:22.487722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d94ff22b-0293-4c29-bc62-9347bf366597 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045697 Aug 04 04:47:22.488263 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 460/930] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:22 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:23.352791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-68bf8d60-6e63-42a6-afa8-1b9d6ae3b714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:23.355010 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-68bf8d60-6e63-42a6-afa8-1b9d6ae3b714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:23.361534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68bf8d60-6e63-42a6-afa8-1b9d6ae3b714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:23.362009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68bf8d60-6e63-42a6-afa8-1b9d6ae3b714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:23.362771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68bf8d60-6e63-42a6-afa8-1b9d6ae3b714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:23.363196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68bf8d60-6e63-42a6-afa8-1b9d6ae3b714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:23.380001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:23.393250 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-68bf8d60-6e63-42a6-afa8-1b9d6ae3b714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044469 Aug 04 04:47:23.393837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 471/931] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:23 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:23.500192 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fb32768a-de45-4aa4-8831-783774d2a460 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:23.502402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fb32768a-de45-4aa4-8831-783774d2a460 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:23.509107 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fb32768a-de45-4aa4-8831-783774d2a460 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:23.509590 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fb32768a-de45-4aa4-8831-783774d2a460 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:23.510370 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fb32768a-de45-4aa4-8831-783774d2a460 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:23.510812 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fb32768a-de45-4aa4-8831-783774d2a460 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:23.540989 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fb32768a-de45-4aa4-8831-783774d2a460 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Aug 04 04:47:23.541533 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 461/932] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:23 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:24.405490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5063829b-681d-4a88-a62b-a53032ada18b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:24.408234 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5063829b-681d-4a88-a62b-a53032ada18b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:24.415078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5063829b-681d-4a88-a62b-a53032ada18b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:24.415533 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5063829b-681d-4a88-a62b-a53032ada18b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:24.416298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5063829b-681d-4a88-a62b-a53032ada18b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:24.416735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5063829b-681d-4a88-a62b-a53032ada18b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:24.445094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5063829b-681d-4a88-a62b-a53032ada18b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043668 Aug 04 04:47:24.445670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 472/933] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:24 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:24.552407 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d184c9be-5e2f-47b1-817a-22db0e9c0ac0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:24.554534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d184c9be-5e2f-47b1-817a-22db0e9c0ac0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:24.560981 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d184c9be-5e2f-47b1-817a-22db0e9c0ac0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:24.561425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d184c9be-5e2f-47b1-817a-22db0e9c0ac0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:24.562209 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d184c9be-5e2f-47b1-817a-22db0e9c0ac0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:24.562640 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d184c9be-5e2f-47b1-817a-22db0e9c0ac0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:24.591814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d184c9be-5e2f-47b1-817a-22db0e9c0ac0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043369 Aug 04 04:47:24.592281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 462/934] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:24 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:24.612920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:47:24.613080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 04:47:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:47:25.458912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4712d636-5d9c-4d0d-bf54-5bbffdfb3c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:25.461126 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4712d636-5d9c-4d0d-bf54-5bbffdfb3c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:25.467565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4712d636-5d9c-4d0d-bf54-5bbffdfb3c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:25.468016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4712d636-5d9c-4d0d-bf54-5bbffdfb3c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:25.468775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4712d636-5d9c-4d0d-bf54-5bbffdfb3c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:25.469207 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4712d636-5d9c-4d0d-bf54-5bbffdfb3c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:25.497224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4712d636-5d9c-4d0d-bf54-5bbffdfb3c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043089 Aug 04 04:47:25.497800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 473/935] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:25 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:25.603867 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2aaa8935-d8f1-4df4-810c-d33d6944e736 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:25.606016 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2aaa8935-d8f1-4df4-810c-d33d6944e736 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:25.612990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2aaa8935-d8f1-4df4-810c-d33d6944e736 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:25.613438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2aaa8935-d8f1-4df4-810c-d33d6944e736 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:25.614238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2aaa8935-d8f1-4df4-810c-d33d6944e736 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:25.614675 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2aaa8935-d8f1-4df4-810c-d33d6944e736 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:25.645115 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2aaa8935-d8f1-4df4-810c-d33d6944e736 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Aug 04 04:47:25.645688 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 463/936] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:25 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:26.509141 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a32f8679-e74a-4152-a4ea-1a1cdea9c657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:26.511695 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a32f8679-e74a-4152-a4ea-1a1cdea9c657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:26.518795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a32f8679-e74a-4152-a4ea-1a1cdea9c657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:26.519255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a32f8679-e74a-4152-a4ea-1a1cdea9c657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:26.520153 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a32f8679-e74a-4152-a4ea-1a1cdea9c657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:26.520459 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a32f8679-e74a-4152-a4ea-1a1cdea9c657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:26.549937 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a32f8679-e74a-4152-a4ea-1a1cdea9c657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Aug 04 04:47:26.550494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 474/937] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:26 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:26.657281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7e381f25-80cf-458b-89a4-db63e3d79b78 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:26.659662 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7e381f25-80cf-458b-89a4-db63e3d79b78 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:26.666368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7e381f25-80cf-458b-89a4-db63e3d79b78 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:26.666810 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7e381f25-80cf-458b-89a4-db63e3d79b78 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:26.667563 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7e381f25-80cf-458b-89a4-db63e3d79b78 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:26.668020 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7e381f25-80cf-458b-89a4-db63e3d79b78 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:26.697196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7e381f25-80cf-458b-89a4-db63e3d79b78 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043874 Aug 04 04:47:26.697880 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 464/938] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:26 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:27.562265 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-062bf85a-8ecb-4da2-866a-397d0eac28bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:27.564540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-062bf85a-8ecb-4da2-866a-397d0eac28bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:27.571000 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-062bf85a-8ecb-4da2-866a-397d0eac28bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:27.571457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-062bf85a-8ecb-4da2-866a-397d0eac28bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:27.572225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-062bf85a-8ecb-4da2-866a-397d0eac28bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:27.572662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-062bf85a-8ecb-4da2-866a-397d0eac28bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:27.601303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-062bf85a-8ecb-4da2-866a-397d0eac28bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043048 Aug 04 04:47:27.601878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 475/939] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:27 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:27.709746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-63314940-2f46-4bb0-96ec-18933333c454 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:27.711802 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-63314940-2f46-4bb0-96ec-18933333c454 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:27.718316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-63314940-2f46-4bb0-96ec-18933333c454 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:27.718770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-63314940-2f46-4bb0-96ec-18933333c454 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:27.719526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-63314940-2f46-4bb0-96ec-18933333c454 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:27.719960 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-63314940-2f46-4bb0-96ec-18933333c454 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:27.749187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-63314940-2f46-4bb0-96ec-18933333c454 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043449 Aug 04 04:47:27.749746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 465/940] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:27 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:28.215044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:47:28.215233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 04:47:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:47:28.614872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-72d23787-4d87-488d-b7af-e1ace976903f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:28.617053 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-72d23787-4d87-488d-b7af-e1ace976903f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:28.623644 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72d23787-4d87-488d-b7af-e1ace976903f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:28.624093 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72d23787-4d87-488d-b7af-e1ace976903f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:28.624851 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72d23787-4d87-488d-b7af-e1ace976903f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:28.625285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72d23787-4d87-488d-b7af-e1ace976903f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:28.660723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-72d23787-4d87-488d-b7af-e1ace976903f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050769 Aug 04 04:47:28.661299 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 476/941] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:28 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:28.761159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-513a954e-4eae-4a7f-822b-832eca749e55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:28.763233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-513a954e-4eae-4a7f-822b-832eca749e55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:28.769952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-513a954e-4eae-4a7f-822b-832eca749e55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:28.770405 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-513a954e-4eae-4a7f-822b-832eca749e55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:28.771162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-513a954e-4eae-4a7f-822b-832eca749e55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:28.771596 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-513a954e-4eae-4a7f-822b-832eca749e55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:28.800892 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-513a954e-4eae-4a7f-822b-832eca749e55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Aug 04 04:47:28.801428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 466/942] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:28 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:29.672474 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-96184bae-5bef-4f58-82dc-4071926b1608 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:29.675093 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-96184bae-5bef-4f58-82dc-4071926b1608 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:29.681561 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96184bae-5bef-4f58-82dc-4071926b1608 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:29.682016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96184bae-5bef-4f58-82dc-4071926b1608 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:29.682768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96184bae-5bef-4f58-82dc-4071926b1608 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:29.683200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96184bae-5bef-4f58-82dc-4071926b1608 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:29.710912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-96184bae-5bef-4f58-82dc-4071926b1608 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042466 Aug 04 04:47:29.711444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 477/943] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:29 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:29.812888 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-db650201-1bf6-45e3-add9-64974634e80c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:29.815371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-db650201-1bf6-45e3-add9-64974634e80c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:29.821789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db650201-1bf6-45e3-add9-64974634e80c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:29.822239 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db650201-1bf6-45e3-add9-64974634e80c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:29.822996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db650201-1bf6-45e3-add9-64974634e80c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:29.823435 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db650201-1bf6-45e3-add9-64974634e80c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:29.852610 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-db650201-1bf6-45e3-add9-64974634e80c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043658 Aug 04 04:47:29.853146 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 467/944] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:29 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:30.723797 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a1555d45-cd96-4b67-95b0-808bfe788d51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:30.725959 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a1555d45-cd96-4b67-95b0-808bfe788d51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:30.732420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1555d45-cd96-4b67-95b0-808bfe788d51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:30.732871 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1555d45-cd96-4b67-95b0-808bfe788d51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:30.733667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1555d45-cd96-4b67-95b0-808bfe788d51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:30.734107 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1555d45-cd96-4b67-95b0-808bfe788d51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:30.762464 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a1555d45-cd96-4b67-95b0-808bfe788d51 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043177 Aug 04 04:47:30.762930 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 478/945] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:30 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:30.864657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-766498cc-10fc-445b-9334-b8d6fb1aa7ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:30.866798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-766498cc-10fc-445b-9334-b8d6fb1aa7ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:30.873158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-766498cc-10fc-445b-9334-b8d6fb1aa7ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:30.873642 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-766498cc-10fc-445b-9334-b8d6fb1aa7ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:30.874402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-766498cc-10fc-445b-9334-b8d6fb1aa7ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:30.874841 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-766498cc-10fc-445b-9334-b8d6fb1aa7ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:30.903718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-766498cc-10fc-445b-9334-b8d6fb1aa7ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042991 Aug 04 04:47:30.904249 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 468/946] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:30 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:47:31.774777 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e9f76b1d-1ce0-44a0-8f46-42eeed44d062 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:31.776800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e9f76b1d-1ce0-44a0-8f46-42eeed44d062 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:31.783533 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e9f76b1d-1ce0-44a0-8f46-42eeed44d062 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:31.783978 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e9f76b1d-1ce0-44a0-8f46-42eeed44d062 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:31.784740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e9f76b1d-1ce0-44a0-8f46-42eeed44d062 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:31.785436 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e9f76b1d-1ce0-44a0-8f46-42eeed44d062 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:31.814785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e9f76b1d-1ce0-44a0-8f46-42eeed44d062 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043392 Aug 04 04:47:31.815469 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 479/947] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:31 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:31.916797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4fd1e227-8684-49fa-be4d-35628447b08b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:31.918924 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4fd1e227-8684-49fa-be4d-35628447b08b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:31.926280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fd1e227-8684-49fa-be4d-35628447b08b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:31.926724 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fd1e227-8684-49fa-be4d-35628447b08b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:31.927475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fd1e227-8684-49fa-be4d-35628447b08b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:31.927907 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fd1e227-8684-49fa-be4d-35628447b08b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:31.957002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4fd1e227-8684-49fa-be4d-35628447b08b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044084 Aug 04 04:47:31.957539 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 469/948] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:31 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:32.826695 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5a1d2923-cea7-4ce6-b142-ed10e629cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:32.828817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5a1d2923-cea7-4ce6-b142-ed10e629cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:32.835376 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a1d2923-cea7-4ce6-b142-ed10e629cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:32.835821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a1d2923-cea7-4ce6-b142-ed10e629cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:32.836576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a1d2923-cea7-4ce6-b142-ed10e629cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:32.837006 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a1d2923-cea7-4ce6-b142-ed10e629cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:32.865587 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5a1d2923-cea7-4ce6-b142-ed10e629cbad tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042781 Aug 04 04:47:32.866118 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 480/949] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:32 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:32.969144 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-86afa0ff-4f77-4a12-83d5-ceb85786e504 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:32.972091 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-86afa0ff-4f77-4a12-83d5-ceb85786e504 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:32.978578 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86afa0ff-4f77-4a12-83d5-ceb85786e504 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:32.979026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86afa0ff-4f77-4a12-83d5-ceb85786e504 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:32.979795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86afa0ff-4f77-4a12-83d5-ceb85786e504 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:32.980236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86afa0ff-4f77-4a12-83d5-ceb85786e504 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:33.009570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-86afa0ff-4f77-4a12-83d5-ceb85786e504 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Aug 04 04:47:33.010117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 470/950] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:32 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:33.878629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2e8dc5f2-ffaa-4768-a7f1-b0706f17606f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:33.880737 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2e8dc5f2-ffaa-4768-a7f1-b0706f17606f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:33.887126 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e8dc5f2-ffaa-4768-a7f1-b0706f17606f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:33.887568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e8dc5f2-ffaa-4768-a7f1-b0706f17606f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:33.888320 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e8dc5f2-ffaa-4768-a7f1-b0706f17606f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:33.888750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e8dc5f2-ffaa-4768-a7f1-b0706f17606f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:33.917310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2e8dc5f2-ffaa-4768-a7f1-b0706f17606f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043370 Aug 04 04:47:33.917876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 481/951] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:33 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:34.021375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b753be1f-daf3-4c9e-a1b1-3948b9b55cc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:34.023526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b753be1f-daf3-4c9e-a1b1-3948b9b55cc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:34.030045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b753be1f-daf3-4c9e-a1b1-3948b9b55cc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:34.030493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b753be1f-daf3-4c9e-a1b1-3948b9b55cc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:34.031255 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b753be1f-daf3-4c9e-a1b1-3948b9b55cc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:34.031692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b753be1f-daf3-4c9e-a1b1-3948b9b55cc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:34.060396 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b753be1f-daf3-4c9e-a1b1-3948b9b55cc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043056 Aug 04 04:47:34.060931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 471/952] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:34 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:34.929715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2800f7d9-47d2-4a21-b0c6-935231f773ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:34.931854 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2800f7d9-47d2-4a21-b0c6-935231f773ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:34.938238 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2800f7d9-47d2-4a21-b0c6-935231f773ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:34.938680 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2800f7d9-47d2-4a21-b0c6-935231f773ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:34.940043 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2800f7d9-47d2-4a21-b0c6-935231f773ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:34.940475 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2800f7d9-47d2-4a21-b0c6-935231f773ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:34.969026 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2800f7d9-47d2-4a21-b0c6-935231f773ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Aug 04 04:47:34.969589 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 482/953] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:34 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:35.073147 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-29522086-7afe-417c-94c5-66b633a312ba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:35.075273 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-29522086-7afe-417c-94c5-66b633a312ba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:35.081942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-29522086-7afe-417c-94c5-66b633a312ba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:35.082391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-29522086-7afe-417c-94c5-66b633a312ba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:35.083148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-29522086-7afe-417c-94c5-66b633a312ba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:35.083579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-29522086-7afe-417c-94c5-66b633a312ba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:35.112322 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-29522086-7afe-417c-94c5-66b633a312ba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043192 Aug 04 04:47:35.112901 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 472/954] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:35 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:35.981718 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1a3b98bf-ed3c-48b6-af00-c395a59f490b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:35.983891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1a3b98bf-ed3c-48b6-af00-c395a59f490b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:35.991351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a3b98bf-ed3c-48b6-af00-c395a59f490b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:35.991828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a3b98bf-ed3c-48b6-af00-c395a59f490b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:35.992591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a3b98bf-ed3c-48b6-af00-c395a59f490b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:35.993051 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a3b98bf-ed3c-48b6-af00-c395a59f490b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:36.021450 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1a3b98bf-ed3c-48b6-af00-c395a59f490b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 Aug 04 04:47:36.022044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 483/955] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:35 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:36.123863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c4826302-4da5-4837-97f7-9112f36b07cd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:36.126035 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c4826302-4da5-4837-97f7-9112f36b07cd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:36.132470 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c4826302-4da5-4837-97f7-9112f36b07cd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:36.132920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c4826302-4da5-4837-97f7-9112f36b07cd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:36.133711 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c4826302-4da5-4837-97f7-9112f36b07cd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:36.134142 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c4826302-4da5-4837-97f7-9112f36b07cd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:36.163704 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c4826302-4da5-4837-97f7-9112f36b07cd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043806 Aug 04 04:47:36.164254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 473/956] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:36 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:37.033834 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a40a33d5-83cb-434f-8bf1-2d8d57ea6001 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:37.036220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a40a33d5-83cb-434f-8bf1-2d8d57ea6001 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:37.042622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a40a33d5-83cb-434f-8bf1-2d8d57ea6001 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:37.043067 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a40a33d5-83cb-434f-8bf1-2d8d57ea6001 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:37.043819 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a40a33d5-83cb-434f-8bf1-2d8d57ea6001 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:37.044249 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a40a33d5-83cb-434f-8bf1-2d8d57ea6001 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:37.072845 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a40a33d5-83cb-434f-8bf1-2d8d57ea6001 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043052 Aug 04 04:47:37.073380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 484/957] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:37 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:37.176631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8d3a88bf-1ee6-4087-93e4-c1382a1a2be9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:37.178844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8d3a88bf-1ee6-4087-93e4-c1382a1a2be9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:37.185311 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d3a88bf-1ee6-4087-93e4-c1382a1a2be9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:37.185800 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d3a88bf-1ee6-4087-93e4-c1382a1a2be9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:37.186558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d3a88bf-1ee6-4087-93e4-c1382a1a2be9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:37.186994 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d3a88bf-1ee6-4087-93e4-c1382a1a2be9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:37.191499 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:37.218353 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8d3a88bf-1ee6-4087-93e4-c1382a1a2be9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046514 Aug 04 04:47:37.218901 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 474/958] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:37 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:38.085122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-170a55f2-5f7d-48de-878e-685a4b0957f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:38.087298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-170a55f2-5f7d-48de-878e-685a4b0957f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:38.093774 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-170a55f2-5f7d-48de-878e-685a4b0957f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:38.094227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-170a55f2-5f7d-48de-878e-685a4b0957f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:38.094999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-170a55f2-5f7d-48de-878e-685a4b0957f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:38.095954 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-170a55f2-5f7d-48de-878e-685a4b0957f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:38.124678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-170a55f2-5f7d-48de-878e-685a4b0957f8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043494 Aug 04 04:47:38.125220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 485/959] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:38 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:47:38.230619 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b3f9bc0a-a4eb-474f-85a3-fbaa623daadd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:38.232764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b3f9bc0a-a4eb-474f-85a3-fbaa623daadd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:38.239789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b3f9bc0a-a4eb-474f-85a3-fbaa623daadd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:38.240231 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b3f9bc0a-a4eb-474f-85a3-fbaa623daadd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:38.240991 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b3f9bc0a-a4eb-474f-85a3-fbaa623daadd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:38.241434 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b3f9bc0a-a4eb-474f-85a3-fbaa623daadd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:38.271106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b3f9bc0a-a4eb-474f-85a3-fbaa623daadd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Aug 04 04:47:38.271658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 475/960] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:38 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:38.534312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:47:38.534477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 04:47:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:47:39.136967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f43b7cac-07d7-49d6-9555-d0ac85ea1342 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:39.139106 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f43b7cac-07d7-49d6-9555-d0ac85ea1342 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:39.146142 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f43b7cac-07d7-49d6-9555-d0ac85ea1342 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:39.146594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f43b7cac-07d7-49d6-9555-d0ac85ea1342 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:39.147356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f43b7cac-07d7-49d6-9555-d0ac85ea1342 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:39.147795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f43b7cac-07d7-49d6-9555-d0ac85ea1342 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:39.177820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f43b7cac-07d7-49d6-9555-d0ac85ea1342 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044776 Aug 04 04:47:39.178359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 486/961] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:39.284224 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-31b7eccd-fb97-4c8f-bfd3-8c183f6b6a05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:39.286683 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-31b7eccd-fb97-4c8f-bfd3-8c183f6b6a05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:39.293202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31b7eccd-fb97-4c8f-bfd3-8c183f6b6a05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:39.293688 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31b7eccd-fb97-4c8f-bfd3-8c183f6b6a05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:39.294449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31b7eccd-fb97-4c8f-bfd3-8c183f6b6a05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:39.294886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31b7eccd-fb97-4c8f-bfd3-8c183f6b6a05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:39.323058 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-31b7eccd-fb97-4c8f-bfd3-8c183f6b6a05 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043500 Aug 04 04:47:39.323608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 476/962] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:39 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:40.190614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7ae0fc2e-dff4-4082-b2e5-3a491385bca4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:40.192726 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7ae0fc2e-dff4-4082-b2e5-3a491385bca4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:40.199149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7ae0fc2e-dff4-4082-b2e5-3a491385bca4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:40.199597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7ae0fc2e-dff4-4082-b2e5-3a491385bca4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:40.200356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7ae0fc2e-dff4-4082-b2e5-3a491385bca4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:40.200789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7ae0fc2e-dff4-4082-b2e5-3a491385bca4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:40.229434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7ae0fc2e-dff4-4082-b2e5-3a491385bca4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043298 Aug 04 04:47:40.230003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 487/963] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:40 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:40.251002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:47:40.251168 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 04:47:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:47:40.335621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b25dad0a-d5bc-4de0-b407-df5ee75126db tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:40.337763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b25dad0a-d5bc-4de0-b407-df5ee75126db tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:40.344281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b25dad0a-d5bc-4de0-b407-df5ee75126db tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:40.344733 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b25dad0a-d5bc-4de0-b407-df5ee75126db tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:40.346064 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b25dad0a-d5bc-4de0-b407-df5ee75126db tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:40.346517 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b25dad0a-d5bc-4de0-b407-df5ee75126db tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:40.376888 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b25dad0a-d5bc-4de0-b407-df5ee75126db tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044550 Aug 04 04:47:40.377496 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 477/964] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:40 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:41.241907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-96f3b210-120c-4bbc-94e7-8fb4b8c4237a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:41.244090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-96f3b210-120c-4bbc-94e7-8fb4b8c4237a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:41.250549 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96f3b210-120c-4bbc-94e7-8fb4b8c4237a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:41.250994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96f3b210-120c-4bbc-94e7-8fb4b8c4237a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:41.251851 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96f3b210-120c-4bbc-94e7-8fb4b8c4237a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:41.252291 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96f3b210-120c-4bbc-94e7-8fb4b8c4237a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:41.255920 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:41.280197 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-96f3b210-120c-4bbc-94e7-8fb4b8c4237a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 Aug 04 04:47:41.280742 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 488/965] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:41 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:41.388335 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3ff85ae5-b530-4ec1-9c40-74f6f8f93782 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:41.390511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3ff85ae5-b530-4ec1-9c40-74f6f8f93782 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:41.393343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=58 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:41.398623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3ff85ae5-b530-4ec1-9c40-74f6f8f93782 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:41.399068 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3ff85ae5-b530-4ec1-9c40-74f6f8f93782 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:41.399822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3ff85ae5-b530-4ec1-9c40-74f6f8f93782 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:41.400250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3ff85ae5-b530-4ec1-9c40-74f6f8f93782 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:41.429594 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3ff85ae5-b530-4ec1-9c40-74f6f8f93782 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Aug 04 04:47:41.430148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 478/966] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:41 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:42.293528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b7d52a13-5805-4e0f-899a-8d5546fa12f0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:42.295676 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b7d52a13-5805-4e0f-899a-8d5546fa12f0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:42.303370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7d52a13-5805-4e0f-899a-8d5546fa12f0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:42.303813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7d52a13-5805-4e0f-899a-8d5546fa12f0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:42.304583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7d52a13-5805-4e0f-899a-8d5546fa12f0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:42.305012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7d52a13-5805-4e0f-899a-8d5546fa12f0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:42.340711 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b7d52a13-5805-4e0f-899a-8d5546fa12f0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051053 Aug 04 04:47:42.341253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 489/967] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:42 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:42.442192 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-15b2fd9c-8336-41f9-95c4-7cc6968ad6c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:42.444333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-15b2fd9c-8336-41f9-95c4-7cc6968ad6c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:42.450709 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-15b2fd9c-8336-41f9-95c4-7cc6968ad6c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:42.451162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-15b2fd9c-8336-41f9-95c4-7cc6968ad6c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:42.451915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-15b2fd9c-8336-41f9-95c4-7cc6968ad6c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:42.452372 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-15b2fd9c-8336-41f9-95c4-7cc6968ad6c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:42.480697 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-15b2fd9c-8336-41f9-95c4-7cc6968ad6c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043055 Aug 04 04:47:42.481260 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 479/968] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:42 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:43.352341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-758b6ef1-bba6-4d4d-acaa-bbe625277567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:43.354561 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-758b6ef1-bba6-4d4d-acaa-bbe625277567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:43.361401 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-758b6ef1-bba6-4d4d-acaa-bbe625277567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:43.362024 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-758b6ef1-bba6-4d4d-acaa-bbe625277567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:43.362787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-758b6ef1-bba6-4d4d-acaa-bbe625277567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:43.363229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-758b6ef1-bba6-4d4d-acaa-bbe625277567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:43.391394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-758b6ef1-bba6-4d4d-acaa-bbe625277567 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042997 Aug 04 04:47:43.391935 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 490/969] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:43 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:43.493180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dff28067-8b30-40e1-a03e-4ad374c63400 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:43.495456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dff28067-8b30-40e1-a03e-4ad374c63400 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:43.502543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dff28067-8b30-40e1-a03e-4ad374c63400 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:43.502993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dff28067-8b30-40e1-a03e-4ad374c63400 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:43.503763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dff28067-8b30-40e1-a03e-4ad374c63400 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:43.504204 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dff28067-8b30-40e1-a03e-4ad374c63400 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:43.533488 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dff28067-8b30-40e1-a03e-4ad374c63400 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Aug 04 04:47:43.534066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 480/970] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:43 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:44.404547 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c656423a-6af8-4d52-b5ae-3e7a557e6381 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:44.406694 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c656423a-6af8-4d52-b5ae-3e7a557e6381 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:44.409837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=58 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:44.416708 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c656423a-6af8-4d52-b5ae-3e7a557e6381 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:44.417488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c656423a-6af8-4d52-b5ae-3e7a557e6381 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:44.418318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c656423a-6af8-4d52-b5ae-3e7a557e6381 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:44.418759 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c656423a-6af8-4d52-b5ae-3e7a557e6381 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:44.450134 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c656423a-6af8-4d52-b5ae-3e7a557e6381 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049452 Aug 04 04:47:44.450721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 491/971] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:44 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:44.546420 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a025cf6d-fa23-476f-9cb3-01779ae900b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:44.548925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a025cf6d-fa23-476f-9cb3-01779ae900b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:44.555624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a025cf6d-fa23-476f-9cb3-01779ae900b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:44.556076 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a025cf6d-fa23-476f-9cb3-01779ae900b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:44.556840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a025cf6d-fa23-476f-9cb3-01779ae900b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:44.557280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a025cf6d-fa23-476f-9cb3-01779ae900b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:44.587549 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a025cf6d-fa23-476f-9cb3-01779ae900b0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Aug 04 04:47:44.588101 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 481/972] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:44 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:47:45.466078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-14fbdcd0-24d2-4c34-b066-a23771586647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:45.468208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-14fbdcd0-24d2-4c34-b066-a23771586647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:45.475213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-14fbdcd0-24d2-4c34-b066-a23771586647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:45.475655 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-14fbdcd0-24d2-4c34-b066-a23771586647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:45.476409 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-14fbdcd0-24d2-4c34-b066-a23771586647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:45.476839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-14fbdcd0-24d2-4c34-b066-a23771586647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:45.505762 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-14fbdcd0-24d2-4c34-b066-a23771586647 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043104 Aug 04 04:47:45.505762 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 492/973] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:45 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:45.600663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d8ec7745-d6e1-419a-931c-c7239fc4b2b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:45.602827 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d8ec7745-d6e1-419a-931c-c7239fc4b2b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:45.609230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d8ec7745-d6e1-419a-931c-c7239fc4b2b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:45.609719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d8ec7745-d6e1-419a-931c-c7239fc4b2b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:45.610480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d8ec7745-d6e1-419a-931c-c7239fc4b2b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:45.611874 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d8ec7745-d6e1-419a-931c-c7239fc4b2b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:45.643149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d8ec7745-d6e1-419a-931c-c7239fc4b2b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046454 Aug 04 04:47:45.643707 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 482/974] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:45 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:46.517964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-af693929-9b5e-44d1-95c1-0bb43dc9099d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:46.520070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-af693929-9b5e-44d1-95c1-0bb43dc9099d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:46.527480 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af693929-9b5e-44d1-95c1-0bb43dc9099d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:46.527933 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af693929-9b5e-44d1-95c1-0bb43dc9099d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:46.528684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af693929-9b5e-44d1-95c1-0bb43dc9099d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:46.529111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af693929-9b5e-44d1-95c1-0bb43dc9099d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:46.556635 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-af693929-9b5e-44d1-95c1-0bb43dc9099d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043251 Aug 04 04:47:46.557176 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 493/975] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:46 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:46.655386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4541482a-1401-4250-8268-73526870a922 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:46.657591 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4541482a-1401-4250-8268-73526870a922 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:46.664338 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4541482a-1401-4250-8268-73526870a922 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:46.664794 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4541482a-1401-4250-8268-73526870a922 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:46.665666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4541482a-1401-4250-8268-73526870a922 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:46.666112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4541482a-1401-4250-8268-73526870a922 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:46.695795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4541482a-1401-4250-8268-73526870a922 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044406 Aug 04 04:47:46.696361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 483/976] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:46 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:47.568968 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-db0b97ab-12ef-45d4-b523-7adbd9f3f5e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:47.571104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-db0b97ab-12ef-45d4-b523-7adbd9f3f5e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:47.577457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db0b97ab-12ef-45d4-b523-7adbd9f3f5e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:47.577932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db0b97ab-12ef-45d4-b523-7adbd9f3f5e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:47.578684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db0b97ab-12ef-45d4-b523-7adbd9f3f5e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:47.579110 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db0b97ab-12ef-45d4-b523-7adbd9f3f5e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:47.608046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-db0b97ab-12ef-45d4-b523-7adbd9f3f5e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043022 Aug 04 04:47:47.608586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 494/977] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:47 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:47.708969 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-99022272-5433-4b66-8f13-05990118b809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:47.711032 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-99022272-5433-4b66-8f13-05990118b809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:47.717602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99022272-5433-4b66-8f13-05990118b809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:47.718063 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99022272-5433-4b66-8f13-05990118b809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:47.718817 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99022272-5433-4b66-8f13-05990118b809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:47.719257 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99022272-5433-4b66-8f13-05990118b809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:47.747602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-99022272-5433-4b66-8f13-05990118b809 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043459 Aug 04 04:47:47.748141 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 484/978] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:47 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:48.620341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9d26513b-f71a-42cf-ad01-44fa5c712f75 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:48.622503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9d26513b-f71a-42cf-ad01-44fa5c712f75 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:48.629783 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9d26513b-f71a-42cf-ad01-44fa5c712f75 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:48.630233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9d26513b-f71a-42cf-ad01-44fa5c712f75 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:48.631020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9d26513b-f71a-42cf-ad01-44fa5c712f75 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:48.631449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9d26513b-f71a-42cf-ad01-44fa5c712f75 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:48.662341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9d26513b-f71a-42cf-ad01-44fa5c712f75 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Aug 04 04:47:48.662906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 495/979] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:48 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:48.759635 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a3a23763-259f-4f33-8988-e42e26a42df2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:48.761728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a3a23763-259f-4f33-8988-e42e26a42df2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:48.768215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3a23763-259f-4f33-8988-e42e26a42df2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:48.768658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3a23763-259f-4f33-8988-e42e26a42df2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:48.769437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3a23763-259f-4f33-8988-e42e26a42df2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:48.769893 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3a23763-259f-4f33-8988-e42e26a42df2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:48.799853 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a3a23763-259f-4f33-8988-e42e26a42df2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044203 Aug 04 04:47:48.800435 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 485/980] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:48 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:49.675820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-715dbd93-0c06-487c-8a90-c4909365de8c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:49.677891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-715dbd93-0c06-487c-8a90-c4909365de8c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:49.685438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-715dbd93-0c06-487c-8a90-c4909365de8c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:49.685918 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-715dbd93-0c06-487c-8a90-c4909365de8c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:49.686691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-715dbd93-0c06-487c-8a90-c4909365de8c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:49.687128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-715dbd93-0c06-487c-8a90-c4909365de8c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:49.717571 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-715dbd93-0c06-487c-8a90-c4909365de8c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046509 Aug 04 04:47:49.718118 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 496/981] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:49 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:49.811260 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0a17a1d2-2c92-4344-b897-fd4ad3951f27 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:49.813372 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0a17a1d2-2c92-4344-b897-fd4ad3951f27 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:49.820475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a17a1d2-2c92-4344-b897-fd4ad3951f27 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:49.820923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a17a1d2-2c92-4344-b897-fd4ad3951f27 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:49.821832 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a17a1d2-2c92-4344-b897-fd4ad3951f27 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:49.822267 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a17a1d2-2c92-4344-b897-fd4ad3951f27 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:49.850264 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0a17a1d2-2c92-4344-b897-fd4ad3951f27 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042916 Aug 04 04:47:49.850807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 486/982] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:49 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:50.730348 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-68649fa0-eb3d-4336-a89f-7c8f20099bdf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:50.732389 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-68649fa0-eb3d-4336-a89f-7c8f20099bdf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:50.739062 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68649fa0-eb3d-4336-a89f-7c8f20099bdf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:50.739517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68649fa0-eb3d-4336-a89f-7c8f20099bdf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:50.740277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68649fa0-eb3d-4336-a89f-7c8f20099bdf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:50.740716 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68649fa0-eb3d-4336-a89f-7c8f20099bdf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:50.769590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-68649fa0-eb3d-4336-a89f-7c8f20099bdf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043268 Aug 04 04:47:50.770139 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 497/983] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:50 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:50.862583 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3562b28c-7963-46d9-91c5-65602aedbab4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:50.864723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3562b28c-7963-46d9-91c5-65602aedbab4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:50.871187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3562b28c-7963-46d9-91c5-65602aedbab4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:50.871637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3562b28c-7963-46d9-91c5-65602aedbab4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:50.872391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3562b28c-7963-46d9-91c5-65602aedbab4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:50.872821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3562b28c-7963-46d9-91c5-65602aedbab4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:50.902150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3562b28c-7963-46d9-91c5-65602aedbab4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043782 Aug 04 04:47:50.902713 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 487/984] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:50 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:51.781773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-da1dc8b2-b389-4d8e-85f3-b40845e408f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:51.784983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-da1dc8b2-b389-4d8e-85f3-b40845e408f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:51.791747 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da1dc8b2-b389-4d8e-85f3-b40845e408f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:51.792199 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da1dc8b2-b389-4d8e-85f3-b40845e408f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:51.792961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da1dc8b2-b389-4d8e-85f3-b40845e408f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:51.793397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da1dc8b2-b389-4d8e-85f3-b40845e408f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:51.823191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-da1dc8b2-b389-4d8e-85f3-b40845e408f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045551 Aug 04 04:47:51.823744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 498/985] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:51 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:51.916092 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a91d8660-4ff2-4cd8-a881-c89ad291823a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:51.918238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a91d8660-4ff2-4cd8-a881-c89ad291823a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:51.924693 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a91d8660-4ff2-4cd8-a881-c89ad291823a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:51.925137 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a91d8660-4ff2-4cd8-a881-c89ad291823a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:51.925920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a91d8660-4ff2-4cd8-a881-c89ad291823a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:51.926353 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a91d8660-4ff2-4cd8-a881-c89ad291823a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:51.956198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a91d8660-4ff2-4cd8-a881-c89ad291823a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Aug 04 04:47:51.956749 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 488/986] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:51 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:52.835744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4697cdb7-d6db-42d8-985d-3d6f5f140599 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:52.837887 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4697cdb7-d6db-42d8-985d-3d6f5f140599 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:52.844232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4697cdb7-d6db-42d8-985d-3d6f5f140599 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:52.844676 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4697cdb7-d6db-42d8-985d-3d6f5f140599 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:52.845517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4697cdb7-d6db-42d8-985d-3d6f5f140599 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:52.845975 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4697cdb7-d6db-42d8-985d-3d6f5f140599 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:52.874222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4697cdb7-d6db-42d8-985d-3d6f5f140599 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042710 Aug 04 04:47:52.874759 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 499/987] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:52 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:52.967391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-574d5ce1-eba3-4675-959f-a9e886b6b810 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:52.969532 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-574d5ce1-eba3-4675-959f-a9e886b6b810 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:52.976589 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-574d5ce1-eba3-4675-959f-a9e886b6b810 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:52.977037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-574d5ce1-eba3-4675-959f-a9e886b6b810 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:52.977822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-574d5ce1-eba3-4675-959f-a9e886b6b810 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:52.978254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-574d5ce1-eba3-4675-959f-a9e886b6b810 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:53.006484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-574d5ce1-eba3-4675-959f-a9e886b6b810 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043023 Aug 04 04:47:53.007028 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 489/988] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:52 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:53.034083 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:47:53.034244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 04:47:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:47:53.887459 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-db61c97e-c62e-41ac-95ab-f02ea3a938cc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:53.889634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-db61c97e-c62e-41ac-95ab-f02ea3a938cc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:53.896949 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db61c97e-c62e-41ac-95ab-f02ea3a938cc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:53.897400 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db61c97e-c62e-41ac-95ab-f02ea3a938cc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:53.898188 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db61c97e-c62e-41ac-95ab-f02ea3a938cc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:53.898630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db61c97e-c62e-41ac-95ab-f02ea3a938cc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:53.926964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-db61c97e-c62e-41ac-95ab-f02ea3a938cc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043537 Aug 04 04:47:53.927508 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 500/989] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:53 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:54.019325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-70bf120d-36e8-4dc9-8ea7-115740b6f4c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:54.021473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-70bf120d-36e8-4dc9-8ea7-115740b6f4c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:54.027857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-70bf120d-36e8-4dc9-8ea7-115740b6f4c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:54.028306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-70bf120d-36e8-4dc9-8ea7-115740b6f4c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:54.029054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-70bf120d-36e8-4dc9-8ea7-115740b6f4c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:54.029485 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-70bf120d-36e8-4dc9-8ea7-115740b6f4c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:54.053880 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:54.058453 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-70bf120d-36e8-4dc9-8ea7-115740b6f4c2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Aug 04 04:47:54.058996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 490/990] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:54 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:54.938529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-807dfd58-4b01-4425-9582-0a6ebcf86992 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:54.940644 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-807dfd58-4b01-4425-9582-0a6ebcf86992 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:54.947012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-807dfd58-4b01-4425-9582-0a6ebcf86992 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:54.947460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-807dfd58-4b01-4425-9582-0a6ebcf86992 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:54.948212 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-807dfd58-4b01-4425-9582-0a6ebcf86992 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:54.948641 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-807dfd58-4b01-4425-9582-0a6ebcf86992 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:54.977010 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-807dfd58-4b01-4425-9582-0a6ebcf86992 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042490 Aug 04 04:47:54.977571 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 501/991] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:54 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:55.070968 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d053871d-f361-4086-8aeb-100125758242 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:55.073096 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d053871d-f361-4086-8aeb-100125758242 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:55.080460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d053871d-f361-4086-8aeb-100125758242 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:55.080914 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d053871d-f361-4086-8aeb-100125758242 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:55.081707 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d053871d-f361-4086-8aeb-100125758242 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:55.082148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d053871d-f361-4086-8aeb-100125758242 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:55.110787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d053871d-f361-4086-8aeb-100125758242 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043760 Aug 04 04:47:55.111343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 491/992] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:55 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:47:55.989402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ca08094e-1e7b-472f-8073-4d8bc53ed2c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:55.991550 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ca08094e-1e7b-472f-8073-4d8bc53ed2c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:55.998046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ca08094e-1e7b-472f-8073-4d8bc53ed2c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:55.998507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ca08094e-1e7b-472f-8073-4d8bc53ed2c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:55.999263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ca08094e-1e7b-472f-8073-4d8bc53ed2c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:55.999692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ca08094e-1e7b-472f-8073-4d8bc53ed2c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:56.027919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ca08094e-1e7b-472f-8073-4d8bc53ed2c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043418 Aug 04 04:47:56.028465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 502/993] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:55 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:56.122829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9b7cc9ba-3de0-4ecf-8a64-41ca1181f300 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:56.124948 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9b7cc9ba-3de0-4ecf-8a64-41ca1181f300 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:56.131415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9b7cc9ba-3de0-4ecf-8a64-41ca1181f300 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:56.131867 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9b7cc9ba-3de0-4ecf-8a64-41ca1181f300 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:56.132628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9b7cc9ba-3de0-4ecf-8a64-41ca1181f300 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:56.133064 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9b7cc9ba-3de0-4ecf-8a64-41ca1181f300 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:56.162047 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9b7cc9ba-3de0-4ecf-8a64-41ca1181f300 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043119 Aug 04 04:47:56.162594 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 492/994] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:56 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:57.040400 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8556c64c-86df-4593-86fe-05c3d2edc2ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:57.042529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8556c64c-86df-4593-86fe-05c3d2edc2ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:57.048958 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8556c64c-86df-4593-86fe-05c3d2edc2ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:57.049329 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8556c64c-86df-4593-86fe-05c3d2edc2ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:57.050119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8556c64c-86df-4593-86fe-05c3d2edc2ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:57.050550 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8556c64c-86df-4593-86fe-05c3d2edc2ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:57.078447 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8556c64c-86df-4593-86fe-05c3d2edc2ab tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042349 Aug 04 04:47:57.078975 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 503/995] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:57 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:57.175044 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f3488eec-3503-4819-91b2-05e1373b830e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:57.177166 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f3488eec-3503-4819-91b2-05e1373b830e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:57.183608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f3488eec-3503-4819-91b2-05e1373b830e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:57.184087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f3488eec-3503-4819-91b2-05e1373b830e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:57.184852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f3488eec-3503-4819-91b2-05e1373b830e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:57.185288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f3488eec-3503-4819-91b2-05e1373b830e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:57.213973 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f3488eec-3503-4819-91b2-05e1373b830e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043687 Aug 04 04:47:57.214519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 493/996] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:57 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:58.091380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c447ad40-c966-4269-98eb-a4dd2cde25be tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:58.093504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c447ad40-c966-4269-98eb-a4dd2cde25be tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:58.100124 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c447ad40-c966-4269-98eb-a4dd2cde25be tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:58.100576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c447ad40-c966-4269-98eb-a4dd2cde25be tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:58.101343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c447ad40-c966-4269-98eb-a4dd2cde25be tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:58.101817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c447ad40-c966-4269-98eb-a4dd2cde25be tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:58.126077 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:58.132086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c447ad40-c966-4269-98eb-a4dd2cde25be tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Aug 04 04:47:58.132638 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 504/997] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:58 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:58.226770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f9632e21-b7a1-44f7-bc0f-48c13bc7f06a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:58.228892 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f9632e21-b7a1-44f7-bc0f-48c13bc7f06a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:58.235382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9632e21-b7a1-44f7-bc0f-48c13bc7f06a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:58.235830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9632e21-b7a1-44f7-bc0f-48c13bc7f06a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:58.237165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9632e21-b7a1-44f7-bc0f-48c13bc7f06a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:58.237624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9632e21-b7a1-44f7-bc0f-48c13bc7f06a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:58.266142 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f9632e21-b7a1-44f7-bc0f-48c13bc7f06a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043538 Aug 04 04:47:58.266686 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 494/998] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:58 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:59.144562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a55b9d71-eee7-4b85-ae99-630aec751bbc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:59.146729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a55b9d71-eee7-4b85-ae99-630aec751bbc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:59.153313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a55b9d71-eee7-4b85-ae99-630aec751bbc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:59.153799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a55b9d71-eee7-4b85-ae99-630aec751bbc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:59.154566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a55b9d71-eee7-4b85-ae99-630aec751bbc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:59.155006 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a55b9d71-eee7-4b85-ae99-630aec751bbc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:59.183881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a55b9d71-eee7-4b85-ae99-630aec751bbc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 Aug 04 04:47:59.184421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 505/999] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:59 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:47:59.278438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4f54d06e-cceb-4adf-a7c6-790c4446b131 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:47:59.280533 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4f54d06e-cceb-4adf-a7c6-790c4446b131 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:47:59.287796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f54d06e-cceb-4adf-a7c6-790c4446b131 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:59.288240 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f54d06e-cceb-4adf-a7c6-790c4446b131 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:59.288992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f54d06e-cceb-4adf-a7c6-790c4446b131 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:47:59.289425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f54d06e-cceb-4adf-a7c6-790c4446b131 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:47:59.318079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4f54d06e-cceb-4adf-a7c6-790c4446b131 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043578 Aug 04 04:47:59.318625 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 495/1000] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:47:59 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:00.196086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6d03caa8-5ae3-4a55-ae51-5adc45af8d27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:00.198222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6d03caa8-5ae3-4a55-ae51-5adc45af8d27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:00.205246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d03caa8-5ae3-4a55-ae51-5adc45af8d27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:00.205969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d03caa8-5ae3-4a55-ae51-5adc45af8d27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:00.206521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d03caa8-5ae3-4a55-ae51-5adc45af8d27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:00.206948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d03caa8-5ae3-4a55-ae51-5adc45af8d27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:00.235271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6d03caa8-5ae3-4a55-ae51-5adc45af8d27 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043157 Aug 04 04:48:00.235806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 506/1001] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:00 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:00.330859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d8ca283e-e6fe-4818-bcfc-92c70c28d01b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:00.332925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d8ca283e-e6fe-4818-bcfc-92c70c28d01b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:00.339657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d8ca283e-e6fe-4818-bcfc-92c70c28d01b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:00.340107 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d8ca283e-e6fe-4818-bcfc-92c70c28d01b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:00.340887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d8ca283e-e6fe-4818-bcfc-92c70c28d01b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:00.341326 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d8ca283e-e6fe-4818-bcfc-92c70c28d01b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:00.371710 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d8ca283e-e6fe-4818-bcfc-92c70c28d01b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045482 Aug 04 04:48:00.372384 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 496/1002] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:00 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:01.247464 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8c416236-90f2-482f-a7c5-95900142c365 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:01.249601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8c416236-90f2-482f-a7c5-95900142c365 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:01.256401 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8c416236-90f2-482f-a7c5-95900142c365 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:01.256797 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8c416236-90f2-482f-a7c5-95900142c365 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:01.257577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8c416236-90f2-482f-a7c5-95900142c365 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:01.258012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8c416236-90f2-482f-a7c5-95900142c365 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:01.287556 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8c416236-90f2-482f-a7c5-95900142c365 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044034 Aug 04 04:48:01.288103 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 507/1003] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:01 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:01.384251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eb07d4c7-5ad8-4af5-9dbc-66914bbad2bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:01.386394 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eb07d4c7-5ad8-4af5-9dbc-66914bbad2bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:01.392938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb07d4c7-5ad8-4af5-9dbc-66914bbad2bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:01.393379 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb07d4c7-5ad8-4af5-9dbc-66914bbad2bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:01.394166 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb07d4c7-5ad8-4af5-9dbc-66914bbad2bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:01.394598 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb07d4c7-5ad8-4af5-9dbc-66914bbad2bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:01.424497 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eb07d4c7-5ad8-4af5-9dbc-66914bbad2bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043687 Aug 04 04:48:01.425036 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 497/1004] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:01 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:02.299924 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f36fafde-849f-425d-a42a-4ee4892fadec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:02.302087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f36fafde-849f-425d-a42a-4ee4892fadec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:02.308522 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f36fafde-849f-425d-a42a-4ee4892fadec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:02.308973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f36fafde-849f-425d-a42a-4ee4892fadec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:02.309770 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f36fafde-849f-425d-a42a-4ee4892fadec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:02.310208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f36fafde-849f-425d-a42a-4ee4892fadec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:02.348707 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f36fafde-849f-425d-a42a-4ee4892fadec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050316 Aug 04 04:48:02.349284 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 508/1005] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:02 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:02.436568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-db43d368-ac3a-4fbd-bec1-23aa8208f488 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:02.438735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-db43d368-ac3a-4fbd-bec1-23aa8208f488 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:02.445950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db43d368-ac3a-4fbd-bec1-23aa8208f488 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:02.446402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db43d368-ac3a-4fbd-bec1-23aa8208f488 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:02.447292 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db43d368-ac3a-4fbd-bec1-23aa8208f488 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:02.447735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db43d368-ac3a-4fbd-bec1-23aa8208f488 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:02.476316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-db43d368-ac3a-4fbd-bec1-23aa8208f488 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043675 Aug 04 04:48:02.476865 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 498/1006] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:02 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:03.360185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c2bc240b-66bc-45fa-969f-6d1b52123000 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:03.362508 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c2bc240b-66bc-45fa-969f-6d1b52123000 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:03.369002 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2bc240b-66bc-45fa-969f-6d1b52123000 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:03.369455 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2bc240b-66bc-45fa-969f-6d1b52123000 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:03.370253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2bc240b-66bc-45fa-969f-6d1b52123000 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:03.370719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2bc240b-66bc-45fa-969f-6d1b52123000 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:03.402585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c2bc240b-66bc-45fa-969f-6d1b52123000 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046272 Aug 04 04:48:03.403177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 509/1007] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:03 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:03.487924 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b4f6182d-34e7-430d-be2f-7ef8e83f4113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:03.490098 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b4f6182d-34e7-430d-be2f-7ef8e83f4113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:03.496651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b4f6182d-34e7-430d-be2f-7ef8e83f4113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:03.497103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b4f6182d-34e7-430d-be2f-7ef8e83f4113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:03.497894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b4f6182d-34e7-430d-be2f-7ef8e83f4113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:03.498332 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b4f6182d-34e7-430d-be2f-7ef8e83f4113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:03.529256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b4f6182d-34e7-430d-be2f-7ef8e83f4113 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045333 Aug 04 04:48:03.529840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 499/1008] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:03 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:04.415731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ff1cca0e-d150-4fd9-ac0c-0dca46639f3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:04.417898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ff1cca0e-d150-4fd9-ac0c-0dca46639f3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:04.425177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ff1cca0e-d150-4fd9-ac0c-0dca46639f3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:04.425652 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ff1cca0e-d150-4fd9-ac0c-0dca46639f3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:04.426430 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ff1cca0e-d150-4fd9-ac0c-0dca46639f3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:04.426868 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ff1cca0e-d150-4fd9-ac0c-0dca46639f3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:04.456457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ff1cca0e-d150-4fd9-ac0c-0dca46639f3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045121 Aug 04 04:48:04.457019 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 510/1009] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:04 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:04.541554 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ae6a9536-d4f8-4043-99cd-f95fbaabaaad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:04.543717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ae6a9536-d4f8-4043-99cd-f95fbaabaaad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:04.550857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ae6a9536-d4f8-4043-99cd-f95fbaabaaad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:04.551320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ae6a9536-d4f8-4043-99cd-f95fbaabaaad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:04.552085 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ae6a9536-d4f8-4043-99cd-f95fbaabaaad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:04.552533 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ae6a9536-d4f8-4043-99cd-f95fbaabaaad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:04.581766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ae6a9536-d4f8-4043-99cd-f95fbaabaaad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044053 Aug 04 04:48:04.582319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 500/1010] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:04 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:05.468713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-82dde292-f60c-4008-aae4-9829be68ff01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:05.471155 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-82dde292-f60c-4008-aae4-9829be68ff01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:05.477628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-82dde292-f60c-4008-aae4-9829be68ff01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:05.478078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-82dde292-f60c-4008-aae4-9829be68ff01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:05.478839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-82dde292-f60c-4008-aae4-9829be68ff01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:05.479276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-82dde292-f60c-4008-aae4-9829be68ff01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:05.593685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-92891f06-a2ae-4f86-94a7-4c7286e114cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:05.596075 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-92891f06-a2ae-4f86-94a7-4c7286e114cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:05.602946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-92891f06-a2ae-4f86-94a7-4c7286e114cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:05.603398 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-92891f06-a2ae-4f86-94a7-4c7286e114cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:05.604180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-92891f06-a2ae-4f86-94a7-4c7286e114cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:05.604622 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-92891f06-a2ae-4f86-94a7-4c7286e114cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:05.636863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-92891f06-a2ae-4f86-94a7-4c7286e114cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047229 Aug 04 04:48:05.637434 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 501/1011] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:05 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:05.660051 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-82dde292-f60c-4008-aae4-9829be68ff01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195210 Aug 04 04:48:05.660605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 511/1012] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:05 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:06.650021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-873e312b-524a-4bae-8e0a-805ba96de68c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:06.652458 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-873e312b-524a-4bae-8e0a-805ba96de68c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:06.659206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-873e312b-524a-4bae-8e0a-805ba96de68c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:06.659651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-873e312b-524a-4bae-8e0a-805ba96de68c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:06.660407 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-873e312b-524a-4bae-8e0a-805ba96de68c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:06.660840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-873e312b-524a-4bae-8e0a-805ba96de68c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:06.672269 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9bc1a869-f168-491b-9d19-bfa65adfaac0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:06.674597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9bc1a869-f168-491b-9d19-bfa65adfaac0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:06.683187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9bc1a869-f168-491b-9d19-bfa65adfaac0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:06.683187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9bc1a869-f168-491b-9d19-bfa65adfaac0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:06.684172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9bc1a869-f168-491b-9d19-bfa65adfaac0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:06.684605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9bc1a869-f168-491b-9d19-bfa65adfaac0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:06.692553 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-873e312b-524a-4bae-8e0a-805ba96de68c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Aug 04 04:48:06.693179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 502/1013] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:06 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:06.718429 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9bc1a869-f168-491b-9d19-bfa65adfaac0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048260 Aug 04 04:48:06.718998 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 512/1014] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:06 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:07.705489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eb4c75bb-3231-4db8-a6e4-41622e34376b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:07.707596 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eb4c75bb-3231-4db8-a6e4-41622e34376b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:07.714138 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb4c75bb-3231-4db8-a6e4-41622e34376b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:07.714619 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb4c75bb-3231-4db8-a6e4-41622e34376b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:07.715388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb4c75bb-3231-4db8-a6e4-41622e34376b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:07.715819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb4c75bb-3231-4db8-a6e4-41622e34376b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:07.730895 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a0b5f01c-a281-42e1-a25f-fadbedaf1a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:07.733049 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a0b5f01c-a281-42e1-a25f-fadbedaf1a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:07.740070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a0b5f01c-a281-42e1-a25f-fadbedaf1a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:07.740513 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a0b5f01c-a281-42e1-a25f-fadbedaf1a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:07.741269 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a0b5f01c-a281-42e1-a25f-fadbedaf1a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:07.741753 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a0b5f01c-a281-42e1-a25f-fadbedaf1a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:07.745585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eb4c75bb-3231-4db8-a6e4-41622e34376b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044588 Aug 04 04:48:07.746334 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 503/1015] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:07 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:07.770028 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a0b5f01c-a281-42e1-a25f-fadbedaf1a4a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042993 Aug 04 04:48:07.770564 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 513/1016] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:07 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:08.758528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ff535c9c-54aa-49c7-85b0-bc68f4717c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:08.760563 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ff535c9c-54aa-49c7-85b0-bc68f4717c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:08.766940 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff535c9c-54aa-49c7-85b0-bc68f4717c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:08.767761 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff535c9c-54aa-49c7-85b0-bc68f4717c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:08.768505 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff535c9c-54aa-49c7-85b0-bc68f4717c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:08.768941 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff535c9c-54aa-49c7-85b0-bc68f4717c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:08.782181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2ca73316-1987-43a9-a91a-6ce71a943a0f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:08.785310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2ca73316-1987-43a9-a91a-6ce71a943a0f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:08.791943 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2ca73316-1987-43a9-a91a-6ce71a943a0f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:08.792391 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2ca73316-1987-43a9-a91a-6ce71a943a0f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:08.793155 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2ca73316-1987-43a9-a91a-6ce71a943a0f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:08.793608 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2ca73316-1987-43a9-a91a-6ce71a943a0f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:08.799232 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ff535c9c-54aa-49c7-85b0-bc68f4717c0a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Aug 04 04:48:08.799784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 504/1017] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:08 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:08.822954 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2ca73316-1987-43a9-a91a-6ce71a943a0f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044765 Aug 04 04:48:08.823482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 514/1018] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:09.811605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-946290ca-f55a-4c89-bfa8-758b8664bea4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:09.813768 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-946290ca-f55a-4c89-bfa8-758b8664bea4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:09.820846 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-946290ca-f55a-4c89-bfa8-758b8664bea4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:09.821294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-946290ca-f55a-4c89-bfa8-758b8664bea4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:09.822078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-946290ca-f55a-4c89-bfa8-758b8664bea4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:09.822509 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-946290ca-f55a-4c89-bfa8-758b8664bea4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:09.836157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-34332a4d-2fcc-4321-9c9c-23536b6d7cee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:09.838305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-34332a4d-2fcc-4321-9c9c-23536b6d7cee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:09.844657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-34332a4d-2fcc-4321-9c9c-23536b6d7cee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:09.845107 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-34332a4d-2fcc-4321-9c9c-23536b6d7cee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:09.845912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-34332a4d-2fcc-4321-9c9c-23536b6d7cee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:09.846348 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-34332a4d-2fcc-4321-9c9c-23536b6d7cee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:09.851807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-946290ca-f55a-4c89-bfa8-758b8664bea4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044087 Aug 04 04:48:09.852369 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 505/1019] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:09 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:09.874804 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-34332a4d-2fcc-4321-9c9c-23536b6d7cee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042575 Aug 04 04:48:09.875334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 515/1020] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:09 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:10.864080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-97e4303e-fb92-46ed-9027-4f3547068c39 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:10.866210 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-97e4303e-fb92-46ed-9027-4f3547068c39 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:10.872722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97e4303e-fb92-46ed-9027-4f3547068c39 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:10.873167 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97e4303e-fb92-46ed-9027-4f3547068c39 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:10.873950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97e4303e-fb92-46ed-9027-4f3547068c39 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:10.874383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97e4303e-fb92-46ed-9027-4f3547068c39 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:10.887672 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e2f62ced-db55-4331-84ef-ec1edfedf714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:10.889806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e2f62ced-db55-4331-84ef-ec1edfedf714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:10.896421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e2f62ced-db55-4331-84ef-ec1edfedf714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:10.896870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e2f62ced-db55-4331-84ef-ec1edfedf714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:10.897669 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e2f62ced-db55-4331-84ef-ec1edfedf714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:10.898104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e2f62ced-db55-4331-84ef-ec1edfedf714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:10.903786 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-97e4303e-fb92-46ed-9027-4f3547068c39 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043616 Aug 04 04:48:10.904343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 506/1021] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:10 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:10.927416 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e2f62ced-db55-4331-84ef-ec1edfedf714 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043845 Aug 04 04:48:10.927951 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 516/1022] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:11.916291 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0706bbbd-f89e-4e33-8ef0-aa1188bf10a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:11.918432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0706bbbd-f89e-4e33-8ef0-aa1188bf10a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:11.920717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=58 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:11.926605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0706bbbd-f89e-4e33-8ef0-aa1188bf10a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:11.927051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0706bbbd-f89e-4e33-8ef0-aa1188bf10a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:11.927806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0706bbbd-f89e-4e33-8ef0-aa1188bf10a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:11.928236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0706bbbd-f89e-4e33-8ef0-aa1188bf10a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:11.940092 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ef483a26-01c2-495e-b46e-14523f718d29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:11.942281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ef483a26-01c2-495e-b46e-14523f718d29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:11.944758 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:11.949333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef483a26-01c2-495e-b46e-14523f718d29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:11.949815 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef483a26-01c2-495e-b46e-14523f718d29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:11.950585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef483a26-01c2-495e-b46e-14523f718d29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:11.951025 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef483a26-01c2-495e-b46e-14523f718d29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:11.957843 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0706bbbd-f89e-4e33-8ef0-aa1188bf10a7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045416 Aug 04 04:48:11.958401 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 507/1023] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:11 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:11.983087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ef483a26-01c2-495e-b46e-14523f718d29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047403 Aug 04 04:48:11.983637 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 517/1024] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:11 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:12.969632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-53c24f57-efcc-4537-994a-e5380b4236c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:12.971759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-53c24f57-efcc-4537-994a-e5380b4236c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:12.978231 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-53c24f57-efcc-4537-994a-e5380b4236c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:12.978708 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-53c24f57-efcc-4537-994a-e5380b4236c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:12.979463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-53c24f57-efcc-4537-994a-e5380b4236c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:12.979898 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-53c24f57-efcc-4537-994a-e5380b4236c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:12.996329 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-303ff85f-e730-491f-8cf9-abad86ce1de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:12.998468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-303ff85f-e730-491f-8cf9-abad86ce1de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:13.006182 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-303ff85f-e730-491f-8cf9-abad86ce1de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:13.006668 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-303ff85f-e730-491f-8cf9-abad86ce1de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:13.007445 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-303ff85f-e730-491f-8cf9-abad86ce1de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:13.007885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-303ff85f-e730-491f-8cf9-abad86ce1de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:13.012139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-53c24f57-efcc-4537-994a-e5380b4236c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046511 Aug 04 04:48:13.012710 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 508/1025] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:13.037444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-303ff85f-e730-491f-8cf9-abad86ce1de7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Aug 04 04:48:13.038014 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 518/1026] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:12 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:14.025102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e4801048-f3bc-4be8-b516-dcf711230033 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:14.027258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e4801048-f3bc-4be8-b516-dcf711230033 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:14.034273 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e4801048-f3bc-4be8-b516-dcf711230033 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:14.034725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e4801048-f3bc-4be8-b516-dcf711230033 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:14.035485 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e4801048-f3bc-4be8-b516-dcf711230033 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:14.035920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e4801048-f3bc-4be8-b516-dcf711230033 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:14.049850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7c84ce0f-a527-45b0-bafe-3f830f030853 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:14.051947 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7c84ce0f-a527-45b0-bafe-3f830f030853 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:14.058359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c84ce0f-a527-45b0-bafe-3f830f030853 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:14.058812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c84ce0f-a527-45b0-bafe-3f830f030853 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:14.059578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c84ce0f-a527-45b0-bafe-3f830f030853 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:14.060012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c84ce0f-a527-45b0-bafe-3f830f030853 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:14.067234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e4801048-f3bc-4be8-b516-dcf711230033 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046378 Aug 04 04:48:14.067808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 509/1027] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:14 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:14.089378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7c84ce0f-a527-45b0-bafe-3f830f030853 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043593 Aug 04 04:48:14.089947 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 519/1028] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:14 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:15.079544 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5f1446ee-1c19-4d33-9442-ac077651b13f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:15.082358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5f1446ee-1c19-4d33-9442-ac077651b13f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:15.088983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5f1446ee-1c19-4d33-9442-ac077651b13f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:15.089440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5f1446ee-1c19-4d33-9442-ac077651b13f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:15.090212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5f1446ee-1c19-4d33-9442-ac077651b13f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:15.090643 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5f1446ee-1c19-4d33-9442-ac077651b13f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:15.102029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f895e5fb-ab2c-4394-ad79-45cc7da9e185 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:15.104167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f895e5fb-ab2c-4394-ad79-45cc7da9e185 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:15.106477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=58 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:15.112455 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f895e5fb-ab2c-4394-ad79-45cc7da9e185 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:15.112908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f895e5fb-ab2c-4394-ad79-45cc7da9e185 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:15.113721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f895e5fb-ab2c-4394-ad79-45cc7da9e185 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:15.114161 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f895e5fb-ab2c-4394-ad79-45cc7da9e185 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:15.120042 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5f1446ee-1c19-4d33-9442-ac077651b13f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Aug 04 04:48:15.120591 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 510/1029] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:15 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:15.144145 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f895e5fb-ab2c-4394-ad79-45cc7da9e185 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045972 Aug 04 04:48:15.144691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 520/1030] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:15 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:16.132164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-442eb425-fa6a-4312-8a8e-b651e6dcbbdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:16.134359 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-442eb425-fa6a-4312-8a8e-b651e6dcbbdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:16.140773 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-442eb425-fa6a-4312-8a8e-b651e6dcbbdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:16.141221 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-442eb425-fa6a-4312-8a8e-b651e6dcbbdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:16.142006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-442eb425-fa6a-4312-8a8e-b651e6dcbbdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:16.142544 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-442eb425-fa6a-4312-8a8e-b651e6dcbbdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:16.156397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-17aabe39-e1fb-49cf-9f5f-619449886297 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:16.158672 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-17aabe39-e1fb-49cf-9f5f-619449886297 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:16.165223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-17aabe39-e1fb-49cf-9f5f-619449886297 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:16.165709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-17aabe39-e1fb-49cf-9f5f-619449886297 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:16.166474 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-17aabe39-e1fb-49cf-9f5f-619449886297 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:16.166904 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-17aabe39-e1fb-49cf-9f5f-619449886297 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:16.171322 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-442eb425-fa6a-4312-8a8e-b651e6dcbbdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043237 Aug 04 04:48:16.171881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 511/1031] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:16.183817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:16.197065 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-17aabe39-e1fb-49cf-9f5f-619449886297 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044679 Aug 04 04:48:16.197622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 521/1032] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:16 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:17.184240 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6bab93dc-1b04-42ad-92e3-343a9bcc2bf9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:17.186379 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6bab93dc-1b04-42ad-92e3-343a9bcc2bf9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:17.193491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6bab93dc-1b04-42ad-92e3-343a9bcc2bf9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:17.193966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6bab93dc-1b04-42ad-92e3-343a9bcc2bf9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:17.194725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6bab93dc-1b04-42ad-92e3-343a9bcc2bf9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:17.195156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6bab93dc-1b04-42ad-92e3-343a9bcc2bf9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:17.209091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dd8d1745-9f5b-42d2-b578-155579b306c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:17.211363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dd8d1745-9f5b-42d2-b578-155579b306c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:17.217851 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd8d1745-9f5b-42d2-b578-155579b306c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:17.218302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd8d1745-9f5b-42d2-b578-155579b306c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:17.219106 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd8d1745-9f5b-42d2-b578-155579b306c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:17.219579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd8d1745-9f5b-42d2-b578-155579b306c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:17.224759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6bab93dc-1b04-42ad-92e3-343a9bcc2bf9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044404 Aug 04 04:48:17.225321 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 512/1033] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:17 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:17.247879 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dd8d1745-9f5b-42d2-b578-155579b306c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043430 Aug 04 04:48:17.248416 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 522/1034] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:17 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:18.237178 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-86ab5c67-5ee9-4e2f-ba72-4ced0a200c10 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:18.239355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-86ab5c67-5ee9-4e2f-ba72-4ced0a200c10 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:18.245843 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86ab5c67-5ee9-4e2f-ba72-4ced0a200c10 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:18.246296 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86ab5c67-5ee9-4e2f-ba72-4ced0a200c10 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:18.247136 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86ab5c67-5ee9-4e2f-ba72-4ced0a200c10 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:18.247571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86ab5c67-5ee9-4e2f-ba72-4ced0a200c10 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:18.260555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9a2a3c27-8e99-451e-801c-f35282e7db58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:18.263228 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9a2a3c27-8e99-451e-801c-f35282e7db58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:18.270726 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a2a3c27-8e99-451e-801c-f35282e7db58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:18.271172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a2a3c27-8e99-451e-801c-f35282e7db58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:18.272010 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a2a3c27-8e99-451e-801c-f35282e7db58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:18.272438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a2a3c27-8e99-451e-801c-f35282e7db58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:18.277179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-86ab5c67-5ee9-4e2f-ba72-4ced0a200c10 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 Aug 04 04:48:18.277777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 513/1035] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:18 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:18.301971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9a2a3c27-8e99-451e-801c-f35282e7db58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045270 Aug 04 04:48:18.302510 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 523/1036] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:18 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:19.290423 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-13cd34b0-a9e0-483d-b99d-da1056eb0762 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:19.292545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-13cd34b0-a9e0-483d-b99d-da1056eb0762 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:19.299750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13cd34b0-a9e0-483d-b99d-da1056eb0762 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:19.300206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13cd34b0-a9e0-483d-b99d-da1056eb0762 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:19.300972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13cd34b0-a9e0-483d-b99d-da1056eb0762 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:19.301411 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13cd34b0-a9e0-483d-b99d-da1056eb0762 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:19.314254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-da5d41f8-ab53-4649-8d78-d6644084c1ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:19.316459 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-da5d41f8-ab53-4649-8d78-d6644084c1ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:19.322885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da5d41f8-ab53-4649-8d78-d6644084c1ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:19.323334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da5d41f8-ab53-4649-8d78-d6644084c1ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:19.324106 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da5d41f8-ab53-4649-8d78-d6644084c1ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:19.324543 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da5d41f8-ab53-4649-8d78-d6644084c1ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:19.331095 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-13cd34b0-a9e0-483d-b99d-da1056eb0762 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Aug 04 04:48:19.331659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 514/1037] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:19.353520 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-da5d41f8-ab53-4649-8d78-d6644084c1ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043360 Aug 04 04:48:19.354083 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 524/1038] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:19 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:20.342400 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-be7ea7e2-f511-40cf-b5f1-1ecaee04feaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:20.344503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-be7ea7e2-f511-40cf-b5f1-1ecaee04feaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:20.351319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be7ea7e2-f511-40cf-b5f1-1ecaee04feaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:20.351770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be7ea7e2-f511-40cf-b5f1-1ecaee04feaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:20.352665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be7ea7e2-f511-40cf-b5f1-1ecaee04feaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:20.353105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be7ea7e2-f511-40cf-b5f1-1ecaee04feaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:20.366762 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4bf735d3-c1dd-4296-89c6-cc0f05684e46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:20.369506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4bf735d3-c1dd-4296-89c6-cc0f05684e46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:20.375910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bf735d3-c1dd-4296-89c6-cc0f05684e46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:20.376369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bf735d3-c1dd-4296-89c6-cc0f05684e46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:20.377920 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bf735d3-c1dd-4296-89c6-cc0f05684e46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:20.378405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bf735d3-c1dd-4296-89c6-cc0f05684e46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:20.385625 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-be7ea7e2-f511-40cf-b5f1-1ecaee04feaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047075 Aug 04 04:48:20.386194 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 515/1039] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:20.407383 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4bf735d3-c1dd-4296-89c6-cc0f05684e46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Aug 04 04:48:20.407986 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 525/1040] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:20 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:21.397535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b7874b61-1122-46d8-88c1-77fe07535bb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:21.399696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b7874b61-1122-46d8-88c1-77fe07535bb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:21.406213 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7874b61-1122-46d8-88c1-77fe07535bb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:21.406663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7874b61-1122-46d8-88c1-77fe07535bb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:21.407409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7874b61-1122-46d8-88c1-77fe07535bb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:21.408087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7874b61-1122-46d8-88c1-77fe07535bb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:21.419629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-62e1a7c2-8f71-4ce7-b8f5-0f166e848777 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:21.421779 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-62e1a7c2-8f71-4ce7-b8f5-0f166e848777 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:21.428868 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-62e1a7c2-8f71-4ce7-b8f5-0f166e848777 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:21.429319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-62e1a7c2-8f71-4ce7-b8f5-0f166e848777 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:21.430113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-62e1a7c2-8f71-4ce7-b8f5-0f166e848777 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:21.430549 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-62e1a7c2-8f71-4ce7-b8f5-0f166e848777 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:21.439798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b7874b61-1122-46d8-88c1-77fe07535bb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045504 Aug 04 04:48:21.440472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 516/1041] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:21 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:21.459799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-62e1a7c2-8f71-4ce7-b8f5-0f166e848777 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044060 Aug 04 04:48:21.460343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 526/1042] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:21 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:22.452293 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9a346f92-5c44-40f1-aad7-a4ec7ecf930c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:22.454461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9a346f92-5c44-40f1-aad7-a4ec7ecf930c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:22.461613 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9a346f92-5c44-40f1-aad7-a4ec7ecf930c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:22.462062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9a346f92-5c44-40f1-aad7-a4ec7ecf930c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:22.462818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9a346f92-5c44-40f1-aad7-a4ec7ecf930c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:22.463252 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9a346f92-5c44-40f1-aad7-a4ec7ecf930c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:22.472097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2e2929d0-98cc-4716-bf1d-b2c0c7932904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:22.474259 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2e2929d0-98cc-4716-bf1d-b2c0c7932904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:22.480744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e2929d0-98cc-4716-bf1d-b2c0c7932904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:22.481130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e2929d0-98cc-4716-bf1d-b2c0c7932904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:22.481913 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e2929d0-98cc-4716-bf1d-b2c0c7932904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:22.482347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e2929d0-98cc-4716-bf1d-b2c0c7932904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:22.493505 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9a346f92-5c44-40f1-aad7-a4ec7ecf930c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Aug 04 04:48:22.495678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 517/1043] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:22 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:22.512230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2e2929d0-98cc-4716-bf1d-b2c0c7932904 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044075 Aug 04 04:48:22.512784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 527/1044] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:22 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:23.506317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eca9402f-9f95-44fc-9598-750185d53599 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:23.508455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eca9402f-9f95-44fc-9598-750185d53599 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:23.515103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eca9402f-9f95-44fc-9598-750185d53599 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:23.515543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eca9402f-9f95-44fc-9598-750185d53599 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:23.516316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eca9402f-9f95-44fc-9598-750185d53599 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:23.516755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eca9402f-9f95-44fc-9598-750185d53599 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:23.524359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-03dd0c18-b2e7-49b0-b717-3038ae005b43 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:23.526505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-03dd0c18-b2e7-49b0-b717-3038ae005b43 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:23.532831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03dd0c18-b2e7-49b0-b717-3038ae005b43 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:23.533279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03dd0c18-b2e7-49b0-b717-3038ae005b43 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:23.534090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03dd0c18-b2e7-49b0-b717-3038ae005b43 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:23.534507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03dd0c18-b2e7-49b0-b717-3038ae005b43 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:23.549190 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eca9402f-9f95-44fc-9598-750185d53599 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047320 Aug 04 04:48:23.549821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 518/1045] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:23 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:23.563524 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-03dd0c18-b2e7-49b0-b717-3038ae005b43 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043007 Aug 04 04:48:23.564062 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 528/1046] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:23 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:24.560737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2d37c05f-f081-4bc6-b68a-5cee50ea0464 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:24.562912 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2d37c05f-f081-4bc6-b68a-5cee50ea0464 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:24.570325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2d37c05f-f081-4bc6-b68a-5cee50ea0464 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:24.570778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2d37c05f-f081-4bc6-b68a-5cee50ea0464 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:24.571602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2d37c05f-f081-4bc6-b68a-5cee50ea0464 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:24.572044 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2d37c05f-f081-4bc6-b68a-5cee50ea0464 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:24.576641 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b8952a92-f0c8-4b16-bbd0-80387e567657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:24.578826 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b8952a92-f0c8-4b16-bbd0-80387e567657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:24.586239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b8952a92-f0c8-4b16-bbd0-80387e567657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:24.586686 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b8952a92-f0c8-4b16-bbd0-80387e567657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:24.587452 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b8952a92-f0c8-4b16-bbd0-80387e567657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:24.587889 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b8952a92-f0c8-4b16-bbd0-80387e567657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:24.601656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2d37c05f-f081-4bc6-b68a-5cee50ea0464 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Aug 04 04:48:24.602470 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 519/1047] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:24 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:24.617305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b8952a92-f0c8-4b16-bbd0-80387e567657 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Aug 04 04:48:24.617897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 529/1048] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:24 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:25.614064 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c1187396-0580-418a-8952-9fce8b9b4688 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:25.616220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c1187396-0580-418a-8952-9fce8b9b4688 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:25.622645 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c1187396-0580-418a-8952-9fce8b9b4688 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:25.623073 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c1187396-0580-418a-8952-9fce8b9b4688 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:25.623829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c1187396-0580-418a-8952-9fce8b9b4688 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:25.624268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c1187396-0580-418a-8952-9fce8b9b4688 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:25.629760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-62c981cd-a78d-4745-951a-0b75bef75df6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:25.631907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-62c981cd-a78d-4745-951a-0b75bef75df6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:25.638276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-62c981cd-a78d-4745-951a-0b75bef75df6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:25.638723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-62c981cd-a78d-4745-951a-0b75bef75df6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:25.639475 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-62c981cd-a78d-4745-951a-0b75bef75df6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:25.639905 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-62c981cd-a78d-4745-951a-0b75bef75df6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:25.653511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c1187396-0580-418a-8952-9fce8b9b4688 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Aug 04 04:48:25.654285 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 520/1049] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:25 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:25.669953 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-62c981cd-a78d-4745-951a-0b75bef75df6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044496 Aug 04 04:48:25.670487 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 530/1050] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:25 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:26.665817 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a274415d-f999-472a-b4ed-7667cd387e1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:26.667974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a274415d-f999-472a-b4ed-7667cd387e1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:26.674749 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a274415d-f999-472a-b4ed-7667cd387e1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:26.675201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a274415d-f999-472a-b4ed-7667cd387e1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:26.676001 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a274415d-f999-472a-b4ed-7667cd387e1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:26.676439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a274415d-f999-472a-b4ed-7667cd387e1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:26.682601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-43c8f786-fed4-4e43-8b56-675354ff981d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:26.684664 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-43c8f786-fed4-4e43-8b56-675354ff981d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:26.691933 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-43c8f786-fed4-4e43-8b56-675354ff981d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:26.692381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-43c8f786-fed4-4e43-8b56-675354ff981d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:26.693140 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-43c8f786-fed4-4e43-8b56-675354ff981d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:26.693594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-43c8f786-fed4-4e43-8b56-675354ff981d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:26.707019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a274415d-f999-472a-b4ed-7667cd387e1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045477 Aug 04 04:48:26.707597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 521/1051] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:26 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:26.722726 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-43c8f786-fed4-4e43-8b56-675354ff981d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044144 Aug 04 04:48:26.723272 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 531/1052] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:26 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:27.719039 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f21bd599-3b42-49b0-a587-00ec32fb756e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:27.721285 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f21bd599-3b42-49b0-a587-00ec32fb756e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:27.727679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f21bd599-3b42-49b0-a587-00ec32fb756e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.728154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f21bd599-3b42-49b0-a587-00ec32fb756e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:27.728905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f21bd599-3b42-49b0-a587-00ec32fb756e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.729381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f21bd599-3b42-49b0-a587-00ec32fb756e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:27.734901 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-21656c20-e4f7-40dc-97ee-aa9867d5db13 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:27.737087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-21656c20-e4f7-40dc-97ee-aa9867d5db13 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:27.743728 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21656c20-e4f7-40dc-97ee-aa9867d5db13 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.744181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21656c20-e4f7-40dc-97ee-aa9867d5db13 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:27.744954 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21656c20-e4f7-40dc-97ee-aa9867d5db13 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:27.745392 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21656c20-e4f7-40dc-97ee-aa9867d5db13 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:27.758724 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f21bd599-3b42-49b0-a587-00ec32fb756e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Aug 04 04:48:27.759277 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 522/1053] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:27 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:27.775301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-21656c20-e4f7-40dc-97ee-aa9867d5db13 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Aug 04 04:48:27.775843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 532/1054] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:27 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:28.771398 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8ee1e526-9b4c-4d75-b966-6c95e033b789 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:28.773426 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8ee1e526-9b4c-4d75-b966-6c95e033b789 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:28.779963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8ee1e526-9b4c-4d75-b966-6c95e033b789 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:28.780417 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8ee1e526-9b4c-4d75-b966-6c95e033b789 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:28.781179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8ee1e526-9b4c-4d75-b966-6c95e033b789 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:28.781704 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8ee1e526-9b4c-4d75-b966-6c95e033b789 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:28.787112 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-421fce83-8506-424d-986f-3efa1689db5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:28.789600 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-421fce83-8506-424d-986f-3efa1689db5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:28.795975 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-421fce83-8506-424d-986f-3efa1689db5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:28.796436 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-421fce83-8506-424d-986f-3efa1689db5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:28.797204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-421fce83-8506-424d-986f-3efa1689db5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:28.797683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-421fce83-8506-424d-986f-3efa1689db5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:28.812291 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8ee1e526-9b4c-4d75-b966-6c95e033b789 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045443 Aug 04 04:48:28.812860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 523/1055] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:28 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:28.827450 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-421fce83-8506-424d-986f-3efa1689db5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044402 Aug 04 04:48:28.827996 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 533/1056] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:28 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:29.824293 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-559818ec-cad5-44a7-988d-cd7d26195a50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:29.826442 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-559818ec-cad5-44a7-988d-cd7d26195a50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:29.833515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-559818ec-cad5-44a7-988d-cd7d26195a50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:29.833998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-559818ec-cad5-44a7-988d-cd7d26195a50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:29.834765 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-559818ec-cad5-44a7-988d-cd7d26195a50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:29.835199 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-559818ec-cad5-44a7-988d-cd7d26195a50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:29.838915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:29.839774 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c9c75c07-1c10-4ad7-a29a-e7792eb9f65f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:29.842471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c9c75c07-1c10-4ad7-a29a-e7792eb9f65f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:29.849168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c9c75c07-1c10-4ad7-a29a-e7792eb9f65f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:29.849660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c9c75c07-1c10-4ad7-a29a-e7792eb9f65f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:29.850424 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c9c75c07-1c10-4ad7-a29a-e7792eb9f65f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:29.850852 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c9c75c07-1c10-4ad7-a29a-e7792eb9f65f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:29.865320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-559818ec-cad5-44a7-988d-cd7d26195a50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044881 Aug 04 04:48:29.865899 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 524/1057] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:29 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:29.880108 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c9c75c07-1c10-4ad7-a29a-e7792eb9f65f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 Aug 04 04:48:29.880662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 534/1058] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:29 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:30.878885 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-04dd38aa-5ae0-461b-8fb9-9d2c25db000d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:30.881022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-04dd38aa-5ae0-461b-8fb9-9d2c25db000d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:30.887605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-04dd38aa-5ae0-461b-8fb9-9d2c25db000d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:30.888060 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-04dd38aa-5ae0-461b-8fb9-9d2c25db000d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:30.888820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-04dd38aa-5ae0-461b-8fb9-9d2c25db000d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:30.889258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-04dd38aa-5ae0-461b-8fb9-9d2c25db000d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:30.892285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5f9e9ea7-ca82-400a-99c8-1b6b0b2d4ee5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:30.895042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5f9e9ea7-ca82-400a-99c8-1b6b0b2d4ee5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:30.901353 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f9e9ea7-ca82-400a-99c8-1b6b0b2d4ee5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:30.901843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f9e9ea7-ca82-400a-99c8-1b6b0b2d4ee5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:30.902586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f9e9ea7-ca82-400a-99c8-1b6b0b2d4ee5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:30.903016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f9e9ea7-ca82-400a-99c8-1b6b0b2d4ee5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:30.919945 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-04dd38aa-5ae0-461b-8fb9-9d2c25db000d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046127 Aug 04 04:48:30.920503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 525/1059] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:30 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:30.932031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5f9e9ea7-ca82-400a-99c8-1b6b0b2d4ee5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Aug 04 04:48:30.932569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 535/1060] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:30 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:31.932196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c35538dc-7c4d-498d-bfa4-a522e4f3f459 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:31.934346 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c35538dc-7c4d-498d-bfa4-a522e4f3f459 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:31.941587 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c35538dc-7c4d-498d-bfa4-a522e4f3f459 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:31.942049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c35538dc-7c4d-498d-bfa4-a522e4f3f459 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:31.942820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c35538dc-7c4d-498d-bfa4-a522e4f3f459 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:31.943333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c35538dc-7c4d-498d-bfa4-a522e4f3f459 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:31.944482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4b461995-115c-4c49-9cb1-71a3e9a11d58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:31.946678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4b461995-115c-4c49-9cb1-71a3e9a11d58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:31.953329 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b461995-115c-4c49-9cb1-71a3e9a11d58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:31.953817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b461995-115c-4c49-9cb1-71a3e9a11d58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:31.954604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b461995-115c-4c49-9cb1-71a3e9a11d58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:31.955045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b461995-115c-4c49-9cb1-71a3e9a11d58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:31.972906 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c35538dc-7c4d-498d-bfa4-a522e4f3f459 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044681 Aug 04 04:48:31.973465 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 526/1061] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:31 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:31.984252 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4b461995-115c-4c49-9cb1-71a3e9a11d58 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 Aug 04 04:48:31.984798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 536/1062] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:31 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:32.985158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cd9c1f09-5040-4a82-9279-3656d40bb3bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:32.987376 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cd9c1f09-5040-4a82-9279-3656d40bb3bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:32.994072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd9c1f09-5040-4a82-9279-3656d40bb3bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:32.994529 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd9c1f09-5040-4a82-9279-3656d40bb3bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:32.995304 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd9c1f09-5040-4a82-9279-3656d40bb3bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:32.995745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd9c1f09-5040-4a82-9279-3656d40bb3bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:32.996119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9b65c4a7-6ca7-43a2-9c06-4f008790b493 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:32.998338 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9b65c4a7-6ca7-43a2-9c06-4f008790b493 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:33.005307 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9b65c4a7-6ca7-43a2-9c06-4f008790b493 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:33.005781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9b65c4a7-6ca7-43a2-9c06-4f008790b493 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:33.006684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9b65c4a7-6ca7-43a2-9c06-4f008790b493 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:33.007120 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9b65c4a7-6ca7-43a2-9c06-4f008790b493 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:33.025822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cd9c1f09-5040-4a82-9279-3656d40bb3bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044551 Aug 04 04:48:33.026391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 527/1063] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:32 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:33.036962 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9b65c4a7-6ca7-43a2-9c06-4f008790b493 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044675 Aug 04 04:48:33.037799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 537/1064] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:32 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:34.039091 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-423c66c8-d6e8-4790-8bb5-6b24da8cb482 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:34.041266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-423c66c8-d6e8-4790-8bb5-6b24da8cb482 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:34.047817 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-423c66c8-d6e8-4790-8bb5-6b24da8cb482 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.048119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-315c8248-2fc3-4394-a263-eb5bda83581c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:34.048522 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-423c66c8-d6e8-4790-8bb5-6b24da8cb482 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.049009 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-423c66c8-d6e8-4790-8bb5-6b24da8cb482 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.049608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-423c66c8-d6e8-4790-8bb5-6b24da8cb482 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.050580 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-315c8248-2fc3-4394-a263-eb5bda83581c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:34.056917 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-315c8248-2fc3-4394-a263-eb5bda83581c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.057361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-315c8248-2fc3-4394-a263-eb5bda83581c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.058153 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-315c8248-2fc3-4394-a263-eb5bda83581c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:34.058585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-315c8248-2fc3-4394-a263-eb5bda83581c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:34.062211 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:34.078226 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-423c66c8-d6e8-4790-8bb5-6b24da8cb482 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043904 Aug 04 04:48:34.078781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 528/1065] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:34 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:34.088275 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-315c8248-2fc3-4394-a263-eb5bda83581c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Aug 04 04:48:34.088822 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 538/1066] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:34 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:35.091531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-96555027-122d-40fe-9982-4b432081e006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:35.093694 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-96555027-122d-40fe-9982-4b432081e006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:35.100435 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-96555027-122d-40fe-9982-4b432081e006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:35.100882 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-96555027-122d-40fe-9982-4b432081e006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:35.101273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6e57224d-d03b-410d-92cd-b037e490e361 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:35.101743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-96555027-122d-40fe-9982-4b432081e006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:35.102088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-96555027-122d-40fe-9982-4b432081e006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:35.103413 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6e57224d-d03b-410d-92cd-b037e490e361 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:35.109963 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e57224d-d03b-410d-92cd-b037e490e361 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:35.110416 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e57224d-d03b-410d-92cd-b037e490e361 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:35.111194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e57224d-d03b-410d-92cd-b037e490e361 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:35.111737 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e57224d-d03b-410d-92cd-b037e490e361 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:35.131845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-96555027-122d-40fe-9982-4b432081e006 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044335 Aug 04 04:48:35.132409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 529/1067] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:35 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:35.141661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6e57224d-d03b-410d-92cd-b037e490e361 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045284 Aug 04 04:48:35.142197 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 539/1068] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:35 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:36.144997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9894b86a-9eaf-4fe1-878b-0189381ac95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:36.147215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9894b86a-9eaf-4fe1-878b-0189381ac95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:36.153735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9894b86a-9eaf-4fe1-878b-0189381ac95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:36.154188 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9894b86a-9eaf-4fe1-878b-0189381ac95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:36.154960 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9894b86a-9eaf-4fe1-878b-0189381ac95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:36.155402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9894b86a-9eaf-4fe1-878b-0189381ac95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:36.155624 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-48f633b4-de49-4450-88b3-00ab4f5194d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:36.157816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-48f633b4-de49-4450-88b3-00ab4f5194d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:36.164887 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-48f633b4-de49-4450-88b3-00ab4f5194d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:36.165330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-48f633b4-de49-4450-88b3-00ab4f5194d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:36.166120 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-48f633b4-de49-4450-88b3-00ab4f5194d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:36.166556 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-48f633b4-de49-4450-88b3-00ab4f5194d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:36.186071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9894b86a-9eaf-4fe1-878b-0189381ac95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 Aug 04 04:48:36.187192 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 530/1069] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:36 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:36.197062 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-48f633b4-de49-4450-88b3-00ab4f5194d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046449 Aug 04 04:48:36.197648 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 540/1070] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:36 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:37.197939 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-93ffc256-bd62-47fe-961b-c43d7b8ebcd8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:37.200051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-93ffc256-bd62-47fe-961b-c43d7b8ebcd8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:37.207535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93ffc256-bd62-47fe-961b-c43d7b8ebcd8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:37.207983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93ffc256-bd62-47fe-961b-c43d7b8ebcd8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:37.208744 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93ffc256-bd62-47fe-961b-c43d7b8ebcd8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:37.209173 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-93ffc256-bd62-47fe-961b-c43d7b8ebcd8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:37.209476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5da97323-e501-445a-8633-7df80eef1e71 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:37.211656 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5da97323-e501-445a-8633-7df80eef1e71 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:37.218034 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5da97323-e501-445a-8633-7df80eef1e71 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:37.218485 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5da97323-e501-445a-8633-7df80eef1e71 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:37.219251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5da97323-e501-445a-8633-7df80eef1e71 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:37.219687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5da97323-e501-445a-8633-7df80eef1e71 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:37.238750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-93ffc256-bd62-47fe-961b-c43d7b8ebcd8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044695 Aug 04 04:48:37.239535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 531/1071] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:37 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:37.249524 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5da97323-e501-445a-8633-7df80eef1e71 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045150 Aug 04 04:48:37.250102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 541/1072] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:37 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:38.250821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2b4180cf-da26-440a-a342-0e7d6fdf6fa2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:38.253265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2b4180cf-da26-440a-a342-0e7d6fdf6fa2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:38.259884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2b4180cf-da26-440a-a342-0e7d6fdf6fa2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.260339 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2b4180cf-da26-440a-a342-0e7d6fdf6fa2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.261110 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2b4180cf-da26-440a-a342-0e7d6fdf6fa2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.261567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2b4180cf-da26-440a-a342-0e7d6fdf6fa2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.262119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e89574ec-23c1-4b93-9178-3e202acdb424 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:38.264253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e89574ec-23c1-4b93-9178-3e202acdb424 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:38.271168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e89574ec-23c1-4b93-9178-3e202acdb424 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.271612 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e89574ec-23c1-4b93-9178-3e202acdb424 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.272405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e89574ec-23c1-4b93-9178-3e202acdb424 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:38.272907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e89574ec-23c1-4b93-9178-3e202acdb424 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:38.297878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2b4180cf-da26-440a-a342-0e7d6fdf6fa2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050805 Aug 04 04:48:38.298445 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 532/1073] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:38 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:38.305010 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e89574ec-23c1-4b93-9178-3e202acdb424 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046736 Aug 04 04:48:38.305580 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 542/1074] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:38 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:39.310106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-87415530-b313-4a77-a9b7-cd7b7b859303 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:39.312238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-87415530-b313-4a77-a9b7-cd7b7b859303 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:39.317465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c4fe13f6-0c58-43e0-b64d-5ff8ccf273e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:39.319561 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-87415530-b313-4a77-a9b7-cd7b7b859303 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:39.319713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c4fe13f6-0c58-43e0-b64d-5ff8ccf273e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:39.320014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-87415530-b313-4a77-a9b7-cd7b7b859303 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:39.320781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-87415530-b313-4a77-a9b7-cd7b7b859303 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:39.321225 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-87415530-b313-4a77-a9b7-cd7b7b859303 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:39.326105 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c4fe13f6-0c58-43e0-b64d-5ff8ccf273e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:39.326552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c4fe13f6-0c58-43e0-b64d-5ff8ccf273e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:39.327309 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c4fe13f6-0c58-43e0-b64d-5ff8ccf273e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:39.327739 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c4fe13f6-0c58-43e0-b64d-5ff8ccf273e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:39.350740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-87415530-b313-4a77-a9b7-cd7b7b859303 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044494 Aug 04 04:48:39.351299 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 533/1075] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:39 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:39.356684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c4fe13f6-0c58-43e0-b64d-5ff8ccf273e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043719 Aug 04 04:48:39.357235 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 543/1076] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:40.363309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5f438d8b-19c3-4041-9ce5-f25f75cbcb5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:40.365647 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5f438d8b-19c3-4041-9ce5-f25f75cbcb5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:40.369237 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-47b61e89-c32f-4d07-91c3-78a9afa1a82c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:40.371603 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-47b61e89-c32f-4d07-91c3-78a9afa1a82c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:40.372162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5f438d8b-19c3-4041-9ce5-f25f75cbcb5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:40.372611 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5f438d8b-19c3-4041-9ce5-f25f75cbcb5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:40.373374 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5f438d8b-19c3-4041-9ce5-f25f75cbcb5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:40.373833 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5f438d8b-19c3-4041-9ce5-f25f75cbcb5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:40.378466 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47b61e89-c32f-4d07-91c3-78a9afa1a82c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:40.378953 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47b61e89-c32f-4d07-91c3-78a9afa1a82c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:40.379740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47b61e89-c32f-4d07-91c3-78a9afa1a82c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:40.380179 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47b61e89-c32f-4d07-91c3-78a9afa1a82c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:40.412041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-47b61e89-c32f-4d07-91c3-78a9afa1a82c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046947 Aug 04 04:48:40.412638 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 544/1077] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:40 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:40.555830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5f438d8b-19c3-4041-9ce5-f25f75cbcb5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196587 Aug 04 04:48:40.556394 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 534/1078] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:40 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:41.424540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d77503a4-c919-4e2e-8dc9-cebe66bfb587 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:41.426678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d77503a4-c919-4e2e-8dc9-cebe66bfb587 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:41.433108 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d77503a4-c919-4e2e-8dc9-cebe66bfb587 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:41.433577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d77503a4-c919-4e2e-8dc9-cebe66bfb587 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:41.434332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d77503a4-c919-4e2e-8dc9-cebe66bfb587 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:41.434763 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d77503a4-c919-4e2e-8dc9-cebe66bfb587 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:41.463461 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d77503a4-c919-4e2e-8dc9-cebe66bfb587 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043074 Aug 04 04:48:41.464013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 545/1079] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:41 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:41.568072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a3843a12-ef19-4568-b5db-38ce4dc28fdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:41.570174 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a3843a12-ef19-4568-b5db-38ce4dc28fdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:41.576491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3843a12-ef19-4568-b5db-38ce4dc28fdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:41.576937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3843a12-ef19-4568-b5db-38ce4dc28fdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:41.577710 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3843a12-ef19-4568-b5db-38ce4dc28fdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:41.578139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a3843a12-ef19-4568-b5db-38ce4dc28fdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:41.608504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a3843a12-ef19-4568-b5db-38ce4dc28fdf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 Aug 04 04:48:41.609046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 535/1080] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:41 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:42.475830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5da047d2-c2b6-4e5a-9230-3012b0fab2e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:42.478213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5da047d2-c2b6-4e5a-9230-3012b0fab2e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:42.484857 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5da047d2-c2b6-4e5a-9230-3012b0fab2e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:42.485314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5da047d2-c2b6-4e5a-9230-3012b0fab2e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:42.486113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5da047d2-c2b6-4e5a-9230-3012b0fab2e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:42.486549 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5da047d2-c2b6-4e5a-9230-3012b0fab2e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:42.515949 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5da047d2-c2b6-4e5a-9230-3012b0fab2e4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Aug 04 04:48:42.516499 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 546/1081] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:42 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:48:42.620556 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-689a262c-f975-4c98-98d9-713285b9c2ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:42.622670 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-689a262c-f975-4c98-98d9-713285b9c2ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:42.625040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=58 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:42.631446 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-689a262c-f975-4c98-98d9-713285b9c2ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:42.631896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-689a262c-f975-4c98-98d9-713285b9c2ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:42.632654 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-689a262c-f975-4c98-98d9-713285b9c2ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:42.633089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-689a262c-f975-4c98-98d9-713285b9c2ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:42.663786 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-689a262c-f975-4c98-98d9-713285b9c2ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047029 Aug 04 04:48:42.664335 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 536/1082] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:42 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:43.529029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-18f4e61b-609f-494d-83b1-2cd8ff321e80 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:43.531239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-18f4e61b-609f-494d-83b1-2cd8ff321e80 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:43.539051 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18f4e61b-609f-494d-83b1-2cd8ff321e80 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:43.539501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18f4e61b-609f-494d-83b1-2cd8ff321e80 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:43.540256 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18f4e61b-609f-494d-83b1-2cd8ff321e80 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:43.540690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18f4e61b-609f-494d-83b1-2cd8ff321e80 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:43.569325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-18f4e61b-609f-494d-83b1-2cd8ff321e80 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Aug 04 04:48:43.569888 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 547/1083] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:43 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:43.676726 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-65b5856d-fe2a-406f-9d0c-24f7a159962e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:43.678858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-65b5856d-fe2a-406f-9d0c-24f7a159962e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:43.685313 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-65b5856d-fe2a-406f-9d0c-24f7a159962e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:43.685802 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-65b5856d-fe2a-406f-9d0c-24f7a159962e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:43.686557 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-65b5856d-fe2a-406f-9d0c-24f7a159962e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:43.686989 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-65b5856d-fe2a-406f-9d0c-24f7a159962e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:43.716542 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-65b5856d-fe2a-406f-9d0c-24f7a159962e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 Aug 04 04:48:43.717090 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 537/1084] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:43 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:44.581561 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ba578eb1-9362-4b29-98a1-8c2c7837b81e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:44.583751 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ba578eb1-9362-4b29-98a1-8c2c7837b81e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:44.590692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba578eb1-9362-4b29-98a1-8c2c7837b81e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:44.591087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba578eb1-9362-4b29-98a1-8c2c7837b81e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:44.591854 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba578eb1-9362-4b29-98a1-8c2c7837b81e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:44.592294 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba578eb1-9362-4b29-98a1-8c2c7837b81e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:44.626612 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ba578eb1-9362-4b29-98a1-8c2c7837b81e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049137 Aug 04 04:48:44.627169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 548/1085] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:44 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:44.729097 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-60f58e35-a6b4-4bd6-853e-075dbd6ef7a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:44.731269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-60f58e35-a6b4-4bd6-853e-075dbd6ef7a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:44.737747 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-60f58e35-a6b4-4bd6-853e-075dbd6ef7a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:44.738207 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-60f58e35-a6b4-4bd6-853e-075dbd6ef7a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:44.738958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-60f58e35-a6b4-4bd6-853e-075dbd6ef7a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:44.739396 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-60f58e35-a6b4-4bd6-853e-075dbd6ef7a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:44.769428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-60f58e35-a6b4-4bd6-853e-075dbd6ef7a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Aug 04 04:48:44.770010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 538/1086] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:44 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:45.639565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-19296b03-4039-4e93-ae02-590e8d99ad93 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:45.641744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-19296b03-4039-4e93-ae02-590e8d99ad93 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:45.644813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=58 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:45.650122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-19296b03-4039-4e93-ae02-590e8d99ad93 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:45.650570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-19296b03-4039-4e93-ae02-590e8d99ad93 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:45.651327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-19296b03-4039-4e93-ae02-590e8d99ad93 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:45.651758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-19296b03-4039-4e93-ae02-590e8d99ad93 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:45.679821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-19296b03-4039-4e93-ae02-590e8d99ad93 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044221 Aug 04 04:48:45.680362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 549/1087] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:45 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:45.781271 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e4290290-ee73-4b36-ae0a-d0f9fa2b3a73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:45.783405 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e4290290-ee73-4b36-ae0a-d0f9fa2b3a73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:45.790251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e4290290-ee73-4b36-ae0a-d0f9fa2b3a73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:45.790696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e4290290-ee73-4b36-ae0a-d0f9fa2b3a73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:45.791455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e4290290-ee73-4b36-ae0a-d0f9fa2b3a73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:45.791880 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e4290290-ee73-4b36-ae0a-d0f9fa2b3a73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:45.821600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e4290290-ee73-4b36-ae0a-d0f9fa2b3a73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044233 Aug 04 04:48:45.822148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 539/1088] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:45 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:46.692438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-79b7af94-387e-44de-9c58-1d195f59ada6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:46.694632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-79b7af94-387e-44de-9c58-1d195f59ada6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:46.700980 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-79b7af94-387e-44de-9c58-1d195f59ada6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:46.701422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-79b7af94-387e-44de-9c58-1d195f59ada6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:46.702209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-79b7af94-387e-44de-9c58-1d195f59ada6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:46.702637 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-79b7af94-387e-44de-9c58-1d195f59ada6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:46.731520 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-79b7af94-387e-44de-9c58-1d195f59ada6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043342 Aug 04 04:48:46.732047 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 550/1089] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:46 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:46.833887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0faad1a2-502e-468e-81be-cdd9a4777be4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:46.835993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0faad1a2-502e-468e-81be-cdd9a4777be4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:46.842402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0faad1a2-502e-468e-81be-cdd9a4777be4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:46.842850 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0faad1a2-502e-468e-81be-cdd9a4777be4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:46.843606 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0faad1a2-502e-468e-81be-cdd9a4777be4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:46.844041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0faad1a2-502e-468e-81be-cdd9a4777be4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:46.871046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:46.876065 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0faad1a2-502e-468e-81be-cdd9a4777be4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047106 Aug 04 04:48:46.876622 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 540/1090] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:46 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:47.743974 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4fe1247e-fc3d-4b49-85e5-1563d0d1b518 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:47.746045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4fe1247e-fc3d-4b49-85e5-1563d0d1b518 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:47.752443 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4fe1247e-fc3d-4b49-85e5-1563d0d1b518 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:47.752965 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4fe1247e-fc3d-4b49-85e5-1563d0d1b518 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:47.753770 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4fe1247e-fc3d-4b49-85e5-1563d0d1b518 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:47.754203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4fe1247e-fc3d-4b49-85e5-1563d0d1b518 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:47.781755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4fe1247e-fc3d-4b49-85e5-1563d0d1b518 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041818 Aug 04 04:48:47.782289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 551/1091] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:47 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:47.888289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-62f69638-30b1-4ca3-8dd8-8661cecf6ce2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:47.890461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-62f69638-30b1-4ca3-8dd8-8661cecf6ce2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:47.897013 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-62f69638-30b1-4ca3-8dd8-8661cecf6ce2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:47.897472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-62f69638-30b1-4ca3-8dd8-8661cecf6ce2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:47.898379 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-62f69638-30b1-4ca3-8dd8-8661cecf6ce2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:47.898821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-62f69638-30b1-4ca3-8dd8-8661cecf6ce2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:47.929824 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-62f69638-30b1-4ca3-8dd8-8661cecf6ce2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045638 Aug 04 04:48:47.930388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 541/1092] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:47 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:48.794124 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-74f8d74c-beac-4512-b08b-be5ae0758216 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:48.796402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-74f8d74c-beac-4512-b08b-be5ae0758216 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:48.803603 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-74f8d74c-beac-4512-b08b-be5ae0758216 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:48.804056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-74f8d74c-beac-4512-b08b-be5ae0758216 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:48.804828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-74f8d74c-beac-4512-b08b-be5ae0758216 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:48.805270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-74f8d74c-beac-4512-b08b-be5ae0758216 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:48.833858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-74f8d74c-beac-4512-b08b-be5ae0758216 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043752 Aug 04 04:48:48.834395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 552/1093] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:48 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:48.942245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fdf417a9-9f49-46c8-a5e0-078242220393 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:48.944385 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fdf417a9-9f49-46c8-a5e0-078242220393 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:48.950831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdf417a9-9f49-46c8-a5e0-078242220393 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:48.951276 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdf417a9-9f49-46c8-a5e0-078242220393 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:48.952043 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdf417a9-9f49-46c8-a5e0-078242220393 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:48.952564 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdf417a9-9f49-46c8-a5e0-078242220393 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:48.981880 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fdf417a9-9f49-46c8-a5e0-078242220393 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044167 Aug 04 04:48:48.982436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 542/1094] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:48 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:49.847096 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4be0f9e6-2109-4797-be3b-911f315b0e7c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:49.849240 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4be0f9e6-2109-4797-be3b-911f315b0e7c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:49.855731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4be0f9e6-2109-4797-be3b-911f315b0e7c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:49.856183 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4be0f9e6-2109-4797-be3b-911f315b0e7c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:49.856948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4be0f9e6-2109-4797-be3b-911f315b0e7c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:49.857387 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4be0f9e6-2109-4797-be3b-911f315b0e7c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:49.886387 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4be0f9e6-2109-4797-be3b-911f315b0e7c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043914 Aug 04 04:48:49.886936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 553/1095] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:49 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:49.993834 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9a612e98-51c0-4852-a02f-cf8120155ee5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:49.995957 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9a612e98-51c0-4852-a02f-cf8120155ee5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:50.002847 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9a612e98-51c0-4852-a02f-cf8120155ee5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:50.003295 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9a612e98-51c0-4852-a02f-cf8120155ee5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:50.004053 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9a612e98-51c0-4852-a02f-cf8120155ee5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:50.004576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9a612e98-51c0-4852-a02f-cf8120155ee5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:50.033349 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9a612e98-51c0-4852-a02f-cf8120155ee5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043414 Aug 04 04:48:50.033929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 543/1096] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:49 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:50.900305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5519fa67-f73d-4f17-b262-f6dc8607d16f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:50.902495 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5519fa67-f73d-4f17-b262-f6dc8607d16f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:50.909409 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5519fa67-f73d-4f17-b262-f6dc8607d16f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:50.909886 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5519fa67-f73d-4f17-b262-f6dc8607d16f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:50.910650 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5519fa67-f73d-4f17-b262-f6dc8607d16f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:50.911090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5519fa67-f73d-4f17-b262-f6dc8607d16f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:50.935713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:50.940924 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5519fa67-f73d-4f17-b262-f6dc8607d16f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045836 Aug 04 04:48:50.941470 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 554/1097] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:50 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:51.045430 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-832af149-d544-43fe-9c2d-c7daafe189f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:51.047557 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-832af149-d544-43fe-9c2d-c7daafe189f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:51.054889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-832af149-d544-43fe-9c2d-c7daafe189f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:51.055344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-832af149-d544-43fe-9c2d-c7daafe189f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:51.056122 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-832af149-d544-43fe-9c2d-c7daafe189f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:51.056564 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-832af149-d544-43fe-9c2d-c7daafe189f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:51.087567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-832af149-d544-43fe-9c2d-c7daafe189f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045968 Aug 04 04:48:51.088139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 544/1098] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:51 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:51.953083 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c6b9231f-8a48-49b5-96ec-6ae56d61b50e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:51.955664 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c6b9231f-8a48-49b5-96ec-6ae56d61b50e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:51.962177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6b9231f-8a48-49b5-96ec-6ae56d61b50e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:51.962623 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6b9231f-8a48-49b5-96ec-6ae56d61b50e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:51.963376 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6b9231f-8a48-49b5-96ec-6ae56d61b50e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:51.963808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6b9231f-8a48-49b5-96ec-6ae56d61b50e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:51.991836 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c6b9231f-8a48-49b5-96ec-6ae56d61b50e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042877 Aug 04 04:48:51.992380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 555/1099] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:51 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:52.100087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-150dacef-32ae-4fd5-b6ac-85f898a2db0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:52.102203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-150dacef-32ae-4fd5-b6ac-85f898a2db0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:52.108901 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-150dacef-32ae-4fd5-b6ac-85f898a2db0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:52.109363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-150dacef-32ae-4fd5-b6ac-85f898a2db0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:52.110144 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-150dacef-32ae-4fd5-b6ac-85f898a2db0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:52.110580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-150dacef-32ae-4fd5-b6ac-85f898a2db0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:52.140858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-150dacef-32ae-4fd5-b6ac-85f898a2db0b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 Aug 04 04:48:52.141828 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 545/1100] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:52 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:53.005113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-68eaaa45-fa37-424f-9dd9-ee3512d8ce7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:53.007299 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-68eaaa45-fa37-424f-9dd9-ee3512d8ce7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:53.015201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68eaaa45-fa37-424f-9dd9-ee3512d8ce7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:53.015647 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68eaaa45-fa37-424f-9dd9-ee3512d8ce7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:53.016404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68eaaa45-fa37-424f-9dd9-ee3512d8ce7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:53.016836 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68eaaa45-fa37-424f-9dd9-ee3512d8ce7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:53.047363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-68eaaa45-fa37-424f-9dd9-ee3512d8ce7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046971 Aug 04 04:48:53.047910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 556/1101] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:52 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:53.153651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d8507ff1-e8c8-4270-b9f4-f6d966439fbf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:53.155777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d8507ff1-e8c8-4270-b9f4-f6d966439fbf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:53.163110 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d8507ff1-e8c8-4270-b9f4-f6d966439fbf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:53.163820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d8507ff1-e8c8-4270-b9f4-f6d966439fbf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:53.164585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d8507ff1-e8c8-4270-b9f4-f6d966439fbf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:53.165021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d8507ff1-e8c8-4270-b9f4-f6d966439fbf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:53.195201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d8507ff1-e8c8-4270-b9f4-f6d966439fbf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045504 Aug 04 04:48:53.195763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 546/1102] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:53 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:54.058544 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-38a428f8-02e8-4f7f-a60c-04ff58a0504c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:54.060744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-38a428f8-02e8-4f7f-a60c-04ff58a0504c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:54.067660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-38a428f8-02e8-4f7f-a60c-04ff58a0504c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:54.068115 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-38a428f8-02e8-4f7f-a60c-04ff58a0504c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:54.068883 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-38a428f8-02e8-4f7f-a60c-04ff58a0504c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:54.069325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-38a428f8-02e8-4f7f-a60c-04ff58a0504c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:54.099381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-38a428f8-02e8-4f7f-a60c-04ff58a0504c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044758 Aug 04 04:48:54.099932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 557/1103] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:54 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:54.208071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e8bb15dd-c20c-48df-b196-dca131048b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:54.210196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e8bb15dd-c20c-48df-b196-dca131048b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:54.216799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8bb15dd-c20c-48df-b196-dca131048b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:54.217253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8bb15dd-c20c-48df-b196-dca131048b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:54.218038 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8bb15dd-c20c-48df-b196-dca131048b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:54.218624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8bb15dd-c20c-48df-b196-dca131048b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:54.248754 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e8bb15dd-c20c-48df-b196-dca131048b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045097 Aug 04 04:48:54.249308 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 547/1104] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:54 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:55.111678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-45639089-2727-4c0f-a920-e5d8639a7b98 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:55.114027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-45639089-2727-4c0f-a920-e5d8639a7b98 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:55.120629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-45639089-2727-4c0f-a920-e5d8639a7b98 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:55.121083 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-45639089-2727-4c0f-a920-e5d8639a7b98 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:55.121876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-45639089-2727-4c0f-a920-e5d8639a7b98 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:55.122323 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-45639089-2727-4c0f-a920-e5d8639a7b98 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:55.150624 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-45639089-2727-4c0f-a920-e5d8639a7b98 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042928 Aug 04 04:48:55.151178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 558/1105] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:55 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:55.261966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-036abcfc-9f20-48ee-8e59-f2a9d479b590 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:55.264069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-036abcfc-9f20-48ee-8e59-f2a9d479b590 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:55.271904 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-036abcfc-9f20-48ee-8e59-f2a9d479b590 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:55.272479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-036abcfc-9f20-48ee-8e59-f2a9d479b590 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:55.273114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-036abcfc-9f20-48ee-8e59-f2a9d479b590 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:55.273626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-036abcfc-9f20-48ee-8e59-f2a9d479b590 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:55.307403 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-036abcfc-9f20-48ee-8e59-f2a9d479b590 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049266 Aug 04 04:48:55.307952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 548/1106] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:55 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:56.163664 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8a720ec5-13c3-4dcb-971e-24b59b4fca1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:56.165838 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8a720ec5-13c3-4dcb-971e-24b59b4fca1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:56.172164 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a720ec5-13c3-4dcb-971e-24b59b4fca1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:56.172606 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a720ec5-13c3-4dcb-971e-24b59b4fca1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:56.173363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a720ec5-13c3-4dcb-971e-24b59b4fca1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:56.173835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a720ec5-13c3-4dcb-971e-24b59b4fca1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:56.201663 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8a720ec5-13c3-4dcb-971e-24b59b4fca1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042784 Aug 04 04:48:56.202198 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 559/1107] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:56 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:56.319967 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9efe4e8a-8ddc-45f5-b3e2-015b89b2304a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:56.322130 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9efe4e8a-8ddc-45f5-b3e2-015b89b2304a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:56.328616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9efe4e8a-8ddc-45f5-b3e2-015b89b2304a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:56.329070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9efe4e8a-8ddc-45f5-b3e2-015b89b2304a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:56.329864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9efe4e8a-8ddc-45f5-b3e2-015b89b2304a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:56.332413 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9efe4e8a-8ddc-45f5-b3e2-015b89b2304a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:56.361744 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9efe4e8a-8ddc-45f5-b3e2-015b89b2304a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045958 Aug 04 04:48:56.362662 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 549/1108] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:56 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:57.213820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fe936952-22da-4eee-b9f3-36cc426f0bb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:57.215975 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fe936952-22da-4eee-b9f3-36cc426f0bb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:57.222552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fe936952-22da-4eee-b9f3-36cc426f0bb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:57.222993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fe936952-22da-4eee-b9f3-36cc426f0bb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:57.223744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fe936952-22da-4eee-b9f3-36cc426f0bb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:57.224173 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fe936952-22da-4eee-b9f3-36cc426f0bb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:57.253021 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fe936952-22da-4eee-b9f3-36cc426f0bb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042792 Aug 04 04:48:57.253566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 560/1109] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:57 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:57.374120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fe1e8f8c-7233-4c56-9061-9369fa7a041e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:57.376354 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fe1e8f8c-7233-4c56-9061-9369fa7a041e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:57.383223 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fe1e8f8c-7233-4c56-9061-9369fa7a041e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:57.383676 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fe1e8f8c-7233-4c56-9061-9369fa7a041e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:57.384441 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fe1e8f8c-7233-4c56-9061-9369fa7a041e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:57.384896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fe1e8f8c-7233-4c56-9061-9369fa7a041e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:57.415303 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fe1e8f8c-7233-4c56-9061-9369fa7a041e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Aug 04 04:48:57.415864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 550/1110] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:57 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:58.265172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-db05cba5-16b9-4b3d-bf68-e4d3d8a7a36c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:58.267325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-db05cba5-16b9-4b3d-bf68-e4d3d8a7a36c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:58.273988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db05cba5-16b9-4b3d-bf68-e4d3d8a7a36c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:58.274435 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db05cba5-16b9-4b3d-bf68-e4d3d8a7a36c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:58.275187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db05cba5-16b9-4b3d-bf68-e4d3d8a7a36c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:58.275612 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-db05cba5-16b9-4b3d-bf68-e4d3d8a7a36c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:58.304758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-db05cba5-16b9-4b3d-bf68-e4d3d8a7a36c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043557 Aug 04 04:48:58.305296 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 561/1111] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:58 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:58.427317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c4d3a0fd-6e7d-4861-98ff-647c0af11225 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:58.429494 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c4d3a0fd-6e7d-4861-98ff-647c0af11225 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:58.436026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c4d3a0fd-6e7d-4861-98ff-647c0af11225 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:58.436473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c4d3a0fd-6e7d-4861-98ff-647c0af11225 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:58.437233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c4d3a0fd-6e7d-4861-98ff-647c0af11225 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:58.437696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c4d3a0fd-6e7d-4861-98ff-647c0af11225 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:58.468641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c4d3a0fd-6e7d-4861-98ff-647c0af11225 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044406 Aug 04 04:48:58.468641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 551/1112] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:58 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:59.316775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8feac46c-a850-4aab-afed-a20ae370b171 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:59.318972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8feac46c-a850-4aab-afed-a20ae370b171 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:59.325391 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8feac46c-a850-4aab-afed-a20ae370b171 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:59.325867 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8feac46c-a850-4aab-afed-a20ae370b171 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:59.326624 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8feac46c-a850-4aab-afed-a20ae370b171 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:59.327054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8feac46c-a850-4aab-afed-a20ae370b171 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:59.356511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8feac46c-a850-4aab-afed-a20ae370b171 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043853 Aug 04 04:48:59.357064 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 562/1113] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:59 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:48:59.480421 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ec7abbfd-8a94-4ace-b4a4-71558b05c309 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:48:59.482707 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ec7abbfd-8a94-4ace-b4a4-71558b05c309 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:48:59.489362 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ec7abbfd-8a94-4ace-b4a4-71558b05c309 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:59.489844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ec7abbfd-8a94-4ace-b4a4-71558b05c309 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:59.490814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ec7abbfd-8a94-4ace-b4a4-71558b05c309 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:48:59.491261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ec7abbfd-8a94-4ace-b4a4-71558b05c309 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:48:59.524894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ec7abbfd-8a94-4ace-b4a4-71558b05c309 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048384 Aug 04 04:48:59.525834 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 552/1114] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:48:59 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:00.369120 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a76a335f-f91e-41af-8caa-4cab0ac96146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:00.371278 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a76a335f-f91e-41af-8caa-4cab0ac96146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:00.378037 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a76a335f-f91e-41af-8caa-4cab0ac96146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:00.379785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a76a335f-f91e-41af-8caa-4cab0ac96146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:00.380578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a76a335f-f91e-41af-8caa-4cab0ac96146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:00.381025 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a76a335f-f91e-41af-8caa-4cab0ac96146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:00.409567 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a76a335f-f91e-41af-8caa-4cab0ac96146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043873 Aug 04 04:49:00.410120 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 563/1115] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:00 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:00.538141 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8d55fa89-847a-4a65-ae2c-28626ba2c3cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:00.540509 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8d55fa89-847a-4a65-ae2c-28626ba2c3cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:00.546998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d55fa89-847a-4a65-ae2c-28626ba2c3cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:00.547446 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d55fa89-847a-4a65-ae2c-28626ba2c3cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:00.548204 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d55fa89-847a-4a65-ae2c-28626ba2c3cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:00.548640 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d55fa89-847a-4a65-ae2c-28626ba2c3cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:00.580162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8d55fa89-847a-4a65-ae2c-28626ba2c3cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046648 Aug 04 04:49:00.580999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 553/1116] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:00 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:01.422196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7393bd22-bd38-4bcd-8467-e22ff3db0cea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:01.424502 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7393bd22-bd38-4bcd-8467-e22ff3db0cea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:01.431226 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7393bd22-bd38-4bcd-8467-e22ff3db0cea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:01.431680 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7393bd22-bd38-4bcd-8467-e22ff3db0cea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:01.432445 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7393bd22-bd38-4bcd-8467-e22ff3db0cea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:01.432883 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7393bd22-bd38-4bcd-8467-e22ff3db0cea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:01.462070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7393bd22-bd38-4bcd-8467-e22ff3db0cea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 Aug 04 04:49:01.462621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 564/1117] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:01 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:01.592399 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-da8f2de7-7133-42a0-ac27-bf2aef612041 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:01.594538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-da8f2de7-7133-42a0-ac27-bf2aef612041 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:01.601270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-da8f2de7-7133-42a0-ac27-bf2aef612041 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:01.601759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-da8f2de7-7133-42a0-ac27-bf2aef612041 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:01.602537 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-da8f2de7-7133-42a0-ac27-bf2aef612041 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:01.602977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-da8f2de7-7133-42a0-ac27-bf2aef612041 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:01.633267 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-da8f2de7-7133-42a0-ac27-bf2aef612041 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044809 Aug 04 04:49:01.633849 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 554/1118] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:01 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:02.474785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fc29bc47-5ee0-46dd-9873-9fc7c18376bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:02.476912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fc29bc47-5ee0-46dd-9873-9fc7c18376bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:02.483585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc29bc47-5ee0-46dd-9873-9fc7c18376bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:02.484032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc29bc47-5ee0-46dd-9873-9fc7c18376bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:02.484792 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc29bc47-5ee0-46dd-9873-9fc7c18376bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:02.485227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc29bc47-5ee0-46dd-9873-9fc7c18376bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:02.514567 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fc29bc47-5ee0-46dd-9873-9fc7c18376bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Aug 04 04:49:02.515132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 565/1119] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:02 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:02.645894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a68e5e33-84aa-463c-a536-d9d03bf5001a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:02.647942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a68e5e33-84aa-463c-a536-d9d03bf5001a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:02.654546 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a68e5e33-84aa-463c-a536-d9d03bf5001a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:02.655033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a68e5e33-84aa-463c-a536-d9d03bf5001a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:02.655763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a68e5e33-84aa-463c-a536-d9d03bf5001a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:02.656197 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a68e5e33-84aa-463c-a536-d9d03bf5001a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:02.685807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a68e5e33-84aa-463c-a536-d9d03bf5001a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044598 Aug 04 04:49:02.686359 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 555/1120] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:02 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:03.528232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-098147a9-0c56-4a93-ab95-2ed34f3b4cd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:03.530435 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-098147a9-0c56-4a93-ab95-2ed34f3b4cd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:03.537951 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-098147a9-0c56-4a93-ab95-2ed34f3b4cd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:03.538401 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-098147a9-0c56-4a93-ab95-2ed34f3b4cd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:03.539418 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-098147a9-0c56-4a93-ab95-2ed34f3b4cd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:03.539857 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-098147a9-0c56-4a93-ab95-2ed34f3b4cd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:03.568285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-098147a9-0c56-4a93-ab95-2ed34f3b4cd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 Aug 04 04:49:03.568833 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 566/1121] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:03 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:03.698697 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5b02f2c6-b22b-40a4-9bc4-5aff8300ecf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:03.700791 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5b02f2c6-b22b-40a4-9bc4-5aff8300ecf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:03.707891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b02f2c6-b22b-40a4-9bc4-5aff8300ecf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:03.708532 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b02f2c6-b22b-40a4-9bc4-5aff8300ecf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:03.709275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b02f2c6-b22b-40a4-9bc4-5aff8300ecf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:03.709753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b02f2c6-b22b-40a4-9bc4-5aff8300ecf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:03.739341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5b02f2c6-b22b-40a4-9bc4-5aff8300ecf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044492 Aug 04 04:49:03.739879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 556/1122] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:03 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:04.579891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-315c161c-f80a-4a37-816c-5fe4a506a346 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:04.582192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-315c161c-f80a-4a37-816c-5fe4a506a346 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:04.588598 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-315c161c-f80a-4a37-816c-5fe4a506a346 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:04.589040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-315c161c-f80a-4a37-816c-5fe4a506a346 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:04.589821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-315c161c-f80a-4a37-816c-5fe4a506a346 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:04.590253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-315c161c-f80a-4a37-816c-5fe4a506a346 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:04.618685 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-315c161c-f80a-4a37-816c-5fe4a506a346 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042685 Aug 04 04:49:04.619227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 567/1123] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:04 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:04.750854 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-718b5d2f-1cfd-4452-bd64-864509f06d80 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:04.753511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-718b5d2f-1cfd-4452-bd64-864509f06d80 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:04.759809 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-718b5d2f-1cfd-4452-bd64-864509f06d80 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:04.760197 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-718b5d2f-1cfd-4452-bd64-864509f06d80 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:04.760955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-718b5d2f-1cfd-4452-bd64-864509f06d80 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:04.761383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-718b5d2f-1cfd-4452-bd64-864509f06d80 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:04.778472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:04.792486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-718b5d2f-1cfd-4452-bd64-864509f06d80 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045628 Aug 04 04:49:04.793021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 557/1124] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:04 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:05.633422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a6d9923d-da2f-4a1a-9094-e3b3a28ce5ee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:05.635648 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a6d9923d-da2f-4a1a-9094-e3b3a28ce5ee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:05.642268 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a6d9923d-da2f-4a1a-9094-e3b3a28ce5ee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:05.642721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a6d9923d-da2f-4a1a-9094-e3b3a28ce5ee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:05.644177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a6d9923d-da2f-4a1a-9094-e3b3a28ce5ee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:05.644612 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a6d9923d-da2f-4a1a-9094-e3b3a28ce5ee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:05.674654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a6d9923d-da2f-4a1a-9094-e3b3a28ce5ee tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047260 Aug 04 04:49:05.675210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 568/1125] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:05 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:05.804415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ecf73d16-6b8c-4cf9-9db0-6f7fd8bc5707 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:05.806571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ecf73d16-6b8c-4cf9-9db0-6f7fd8bc5707 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:05.812991 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ecf73d16-6b8c-4cf9-9db0-6f7fd8bc5707 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:05.813450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ecf73d16-6b8c-4cf9-9db0-6f7fd8bc5707 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:05.814246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ecf73d16-6b8c-4cf9-9db0-6f7fd8bc5707 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:05.815285 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ecf73d16-6b8c-4cf9-9db0-6f7fd8bc5707 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:05.845539 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ecf73d16-6b8c-4cf9-9db0-6f7fd8bc5707 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044833 Aug 04 04:49:05.845991 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 558/1126] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:05 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:06.687205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2cadb4f7-393c-4d0c-8adf-9f54c5a1837f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:06.689600 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2cadb4f7-393c-4d0c-8adf-9f54c5a1837f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:06.696986 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2cadb4f7-393c-4d0c-8adf-9f54c5a1837f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:06.697428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2cadb4f7-393c-4d0c-8adf-9f54c5a1837f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:06.698230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2cadb4f7-393c-4d0c-8adf-9f54c5a1837f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:06.698661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2cadb4f7-393c-4d0c-8adf-9f54c5a1837f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:06.726912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2cadb4f7-393c-4d0c-8adf-9f54c5a1837f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Aug 04 04:49:06.727465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 569/1127] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:06 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:06.858370 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-703ceeee-97ac-424e-bfa2-386dabd3c34d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:06.861632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-703ceeee-97ac-424e-bfa2-386dabd3c34d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:06.869213 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-703ceeee-97ac-424e-bfa2-386dabd3c34d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:06.869903 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-703ceeee-97ac-424e-bfa2-386dabd3c34d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:06.870700 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-703ceeee-97ac-424e-bfa2-386dabd3c34d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:06.871148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-703ceeee-97ac-424e-bfa2-386dabd3c34d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:06.903617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-703ceeee-97ac-424e-bfa2-386dabd3c34d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049309 Aug 04 04:49:06.904188 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 559/1128] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:06 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:07.739378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-247b64aa-e030-4d3c-82a6-86dc23d4e205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:07.741532 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-247b64aa-e030-4d3c-82a6-86dc23d4e205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:07.748084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-247b64aa-e030-4d3c-82a6-86dc23d4e205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:07.748535 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-247b64aa-e030-4d3c-82a6-86dc23d4e205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:07.749301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-247b64aa-e030-4d3c-82a6-86dc23d4e205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:07.749772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-247b64aa-e030-4d3c-82a6-86dc23d4e205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:07.778848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-247b64aa-e030-4d3c-82a6-86dc23d4e205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043567 Aug 04 04:49:07.779402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 570/1129] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:07 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:07.916035 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a0e9bec5-3d60-488d-8938-a9f8d7510cb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:07.919660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a0e9bec5-3d60-488d-8938-a9f8d7510cb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:07.926221 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0e9bec5-3d60-488d-8938-a9f8d7510cb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:07.926668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0e9bec5-3d60-488d-8938-a9f8d7510cb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:07.927440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0e9bec5-3d60-488d-8938-a9f8d7510cb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:07.927875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0e9bec5-3d60-488d-8938-a9f8d7510cb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:07.958042 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a0e9bec5-3d60-488d-8938-a9f8d7510cb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046143 Aug 04 04:49:07.958706 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 560/1130] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:07 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:08.791599 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-49f7616a-354a-4d81-b5ef-e278b4ee67bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:08.793780 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-49f7616a-354a-4d81-b5ef-e278b4ee67bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:08.800880 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-49f7616a-354a-4d81-b5ef-e278b4ee67bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:08.801333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-49f7616a-354a-4d81-b5ef-e278b4ee67bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:08.802117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-49f7616a-354a-4d81-b5ef-e278b4ee67bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:08.802541 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-49f7616a-354a-4d81-b5ef-e278b4ee67bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:08.818671 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:08.831453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-49f7616a-354a-4d81-b5ef-e278b4ee67bb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044125 Aug 04 04:49:08.832004 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 571/1131] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:08.970094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ad3f0454-d335-4c5f-8f2a-4499e0ab8107 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:08.973609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ad3f0454-d335-4c5f-8f2a-4499e0ab8107 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:08.980109 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad3f0454-d335-4c5f-8f2a-4499e0ab8107 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:08.980566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad3f0454-d335-4c5f-8f2a-4499e0ab8107 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:08.981337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad3f0454-d335-4c5f-8f2a-4499e0ab8107 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:08.981806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad3f0454-d335-4c5f-8f2a-4499e0ab8107 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:09.013787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ad3f0454-d335-4c5f-8f2a-4499e0ab8107 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047452 Aug 04 04:49:09.014286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 561/1132] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:08 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:09.843037 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4e7dfdbb-0045-48ff-ad5d-3f4cd2583037 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:09.845173 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4e7dfdbb-0045-48ff-ad5d-3f4cd2583037 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:09.851652 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e7dfdbb-0045-48ff-ad5d-3f4cd2583037 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:09.852227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e7dfdbb-0045-48ff-ad5d-3f4cd2583037 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:09.852875 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e7dfdbb-0045-48ff-ad5d-3f4cd2583037 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:09.853305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e7dfdbb-0045-48ff-ad5d-3f4cd2583037 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:09.881732 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4e7dfdbb-0045-48ff-ad5d-3f4cd2583037 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042552 Aug 04 04:49:09.882267 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 572/1133] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:09 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:10.025864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1513d54d-e88a-434b-b95d-ba1de3bf4b50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:10.028117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1513d54d-e88a-434b-b95d-ba1de3bf4b50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:10.034776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1513d54d-e88a-434b-b95d-ba1de3bf4b50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:10.035234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1513d54d-e88a-434b-b95d-ba1de3bf4b50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:10.036008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1513d54d-e88a-434b-b95d-ba1de3bf4b50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:10.036480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1513d54d-e88a-434b-b95d-ba1de3bf4b50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:10.070374 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1513d54d-e88a-434b-b95d-ba1de3bf4b50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048460 Aug 04 04:49:10.070921 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 562/1134] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:10 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:10.895054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7b807dc3-df4b-4427-ad0b-99017d46443d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:10.897241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7b807dc3-df4b-4427-ad0b-99017d46443d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:10.903461 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7b807dc3-df4b-4427-ad0b-99017d46443d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:10.903911 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7b807dc3-df4b-4427-ad0b-99017d46443d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:10.904667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7b807dc3-df4b-4427-ad0b-99017d46443d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:10.905143 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7b807dc3-df4b-4427-ad0b-99017d46443d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:10.934143 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7b807dc3-df4b-4427-ad0b-99017d46443d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Aug 04 04:49:10.934680 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 573/1135] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:11.082711 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-97b81e44-0a9f-4494-8c42-c2352ca0c2df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:11.085056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-97b81e44-0a9f-4494-8c42-c2352ca0c2df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:11.091439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97b81e44-0a9f-4494-8c42-c2352ca0c2df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:11.091890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97b81e44-0a9f-4494-8c42-c2352ca0c2df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:11.092646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97b81e44-0a9f-4494-8c42-c2352ca0c2df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:11.093082 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97b81e44-0a9f-4494-8c42-c2352ca0c2df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:11.122871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-97b81e44-0a9f-4494-8c42-c2352ca0c2df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044545 Aug 04 04:49:11.123403 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 563/1136] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:11 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:49:11.946942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4c7c54dd-047f-459d-a157-b41df79127fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:11.949094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4c7c54dd-047f-459d-a157-b41df79127fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:11.956093 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c7c54dd-047f-459d-a157-b41df79127fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:11.956540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c7c54dd-047f-459d-a157-b41df79127fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:11.957289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c7c54dd-047f-459d-a157-b41df79127fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:11.957752 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c7c54dd-047f-459d-a157-b41df79127fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:11.984995 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4c7c54dd-047f-459d-a157-b41df79127fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041992 Aug 04 04:49:11.985531 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 574/1137] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:11 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:12.134587 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-03251793-f4c0-4fbb-90b5-2da2d78c04af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:12.136771 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-03251793-f4c0-4fbb-90b5-2da2d78c04af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:12.143391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03251793-f4c0-4fbb-90b5-2da2d78c04af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:12.143987 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03251793-f4c0-4fbb-90b5-2da2d78c04af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:12.144777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03251793-f4c0-4fbb-90b5-2da2d78c04af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:12.145211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03251793-f4c0-4fbb-90b5-2da2d78c04af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:12.176852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-03251793-f4c0-4fbb-90b5-2da2d78c04af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046091 Aug 04 04:49:12.177400 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 564/1138] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:12.996373 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a6932af6-a3cf-427a-8d92-2efd868691bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:12.998540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a6932af6-a3cf-427a-8d92-2efd868691bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:13.004881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a6932af6-a3cf-427a-8d92-2efd868691bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:13.005324 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a6932af6-a3cf-427a-8d92-2efd868691bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:13.006106 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a6932af6-a3cf-427a-8d92-2efd868691bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:13.006539 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a6932af6-a3cf-427a-8d92-2efd868691bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:13.035302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a6932af6-a3cf-427a-8d92-2efd868691bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042879 Aug 04 04:49:13.035842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 575/1139] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:12 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:13.188301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-21a540fd-3de9-49c4-b2bb-922597f2a9c9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:13.191471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-21a540fd-3de9-49c4-b2bb-922597f2a9c9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:13.193739 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=58 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:13.198929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-21a540fd-3de9-49c4-b2bb-922597f2a9c9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:13.199377 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-21a540fd-3de9-49c4-b2bb-922597f2a9c9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:13.200135 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-21a540fd-3de9-49c4-b2bb-922597f2a9c9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:13.200572 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-21a540fd-3de9-49c4-b2bb-922597f2a9c9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:13.231093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-21a540fd-3de9-49c4-b2bb-922597f2a9c9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046796 Aug 04 04:49:13.231644 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 565/1140] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:13 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:14.047800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e1db7efb-bb3a-4cb7-8627-8551a868d484 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:14.050639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e1db7efb-bb3a-4cb7-8627-8551a868d484 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:14.057125 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e1db7efb-bb3a-4cb7-8627-8551a868d484 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:14.057609 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e1db7efb-bb3a-4cb7-8627-8551a868d484 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:14.058381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e1db7efb-bb3a-4cb7-8627-8551a868d484 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:14.058823 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e1db7efb-bb3a-4cb7-8627-8551a868d484 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:14.087091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e1db7efb-bb3a-4cb7-8627-8551a868d484 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043176 Aug 04 04:49:14.087629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 576/1141] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:14 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:14.245010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fcb78701-86e9-448d-98c2-9d2b3dff39bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:14.247209 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fcb78701-86e9-448d-98c2-9d2b3dff39bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:14.253897 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fcb78701-86e9-448d-98c2-9d2b3dff39bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:14.254343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fcb78701-86e9-448d-98c2-9d2b3dff39bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:14.255098 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fcb78701-86e9-448d-98c2-9d2b3dff39bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:14.255565 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fcb78701-86e9-448d-98c2-9d2b3dff39bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:14.285877 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fcb78701-86e9-448d-98c2-9d2b3dff39bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044900 Aug 04 04:49:14.286422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 566/1142] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:14 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:15.098587 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-96441e56-1c30-4b62-9952-ecef9594d8ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:15.100743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-96441e56-1c30-4b62-9952-ecef9594d8ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:15.107230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96441e56-1c30-4b62-9952-ecef9594d8ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:15.107672 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96441e56-1c30-4b62-9952-ecef9594d8ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:15.108424 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96441e56-1c30-4b62-9952-ecef9594d8ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:15.108854 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96441e56-1c30-4b62-9952-ecef9594d8ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:15.138654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-96441e56-1c30-4b62-9952-ecef9594d8ef tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044078 Aug 04 04:49:15.139198 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 577/1143] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:15 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:15.298038 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a1939b5c-9149-4e9e-9863-cecedca5274a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:15.300720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a1939b5c-9149-4e9e-9863-cecedca5274a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:15.307162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1939b5c-9149-4e9e-9863-cecedca5274a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:15.307609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1939b5c-9149-4e9e-9863-cecedca5274a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:15.308365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1939b5c-9149-4e9e-9863-cecedca5274a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:15.308814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1939b5c-9149-4e9e-9863-cecedca5274a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:15.344386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a1939b5c-9149-4e9e-9863-cecedca5274a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050347 Aug 04 04:49:15.344930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 567/1144] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:15 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:16.150935 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6b66f6ff-45bb-4979-9f87-310aee65ef24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:16.153151 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6b66f6ff-45bb-4979-9f87-310aee65ef24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:16.155517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=58 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:16.161783 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b66f6ff-45bb-4979-9f87-310aee65ef24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:16.162235 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b66f6ff-45bb-4979-9f87-310aee65ef24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:16.163006 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b66f6ff-45bb-4979-9f87-310aee65ef24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:16.163448 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b66f6ff-45bb-4979-9f87-310aee65ef24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:16.191772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6b66f6ff-45bb-4979-9f87-310aee65ef24 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Aug 04 04:49:16.192320 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 578/1145] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:16 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:16.356319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c9d18452-55eb-41ce-8e6f-75d797426c5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:16.358464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c9d18452-55eb-41ce-8e6f-75d797426c5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:16.365577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9d18452-55eb-41ce-8e6f-75d797426c5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:16.366031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9d18452-55eb-41ce-8e6f-75d797426c5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:16.366791 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9d18452-55eb-41ce-8e6f-75d797426c5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:16.367222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9d18452-55eb-41ce-8e6f-75d797426c5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:16.397976 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c9d18452-55eb-41ce-8e6f-75d797426c5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045702 Aug 04 04:49:16.398517 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 568/1146] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:17.204032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5e5bee95-50a4-4450-a7ad-b406e9161991 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:17.206229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5e5bee95-50a4-4450-a7ad-b406e9161991 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:17.212677 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5e5bee95-50a4-4450-a7ad-b406e9161991 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:17.213127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5e5bee95-50a4-4450-a7ad-b406e9161991 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:17.213930 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5e5bee95-50a4-4450-a7ad-b406e9161991 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:17.214373 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5e5bee95-50a4-4450-a7ad-b406e9161991 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:17.243381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5e5bee95-50a4-4450-a7ad-b406e9161991 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042918 Aug 04 04:49:17.243584 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 579/1147] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:17 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:17.410307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9fbfc65a-c0e1-4b44-91cf-ed1c79475819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:17.412443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9fbfc65a-c0e1-4b44-91cf-ed1c79475819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:17.419056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9fbfc65a-c0e1-4b44-91cf-ed1c79475819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:17.419765 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9fbfc65a-c0e1-4b44-91cf-ed1c79475819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:17.420275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9fbfc65a-c0e1-4b44-91cf-ed1c79475819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:17.420700 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9fbfc65a-c0e1-4b44-91cf-ed1c79475819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:17.449457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9fbfc65a-c0e1-4b44-91cf-ed1c79475819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043598 Aug 04 04:49:17.450027 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 569/1148] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:17 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:18.255330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d7fa2a64-6e9e-4a44-b0bd-9d8edf7e27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:18.257428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d7fa2a64-6e9e-4a44-b0bd-9d8edf7e27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:18.264041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7fa2a64-6e9e-4a44-b0bd-9d8edf7e27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:18.264494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7fa2a64-6e9e-4a44-b0bd-9d8edf7e27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:18.265245 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7fa2a64-6e9e-4a44-b0bd-9d8edf7e27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:18.265708 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7fa2a64-6e9e-4a44-b0bd-9d8edf7e27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:18.294847 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d7fa2a64-6e9e-4a44-b0bd-9d8edf7e27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043626 Aug 04 04:49:18.295380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 580/1149] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:18 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:18.462326 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-195aabd4-841b-4de6-a758-46c1ab462f26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:18.464648 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-195aabd4-841b-4de6-a758-46c1ab462f26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:18.471224 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-195aabd4-841b-4de6-a758-46c1ab462f26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:18.472393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-195aabd4-841b-4de6-a758-46c1ab462f26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:18.473309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-195aabd4-841b-4de6-a758-46c1ab462f26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:18.473878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-195aabd4-841b-4de6-a758-46c1ab462f26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:18.506146 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-195aabd4-841b-4de6-a758-46c1ab462f26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047810 Aug 04 04:49:18.506610 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 570/1150] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:18 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:19.306985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fa69b213-86ed-411a-91fb-7f23a5f86798 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:19.309140 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fa69b213-86ed-411a-91fb-7f23a5f86798 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:19.315958 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa69b213-86ed-411a-91fb-7f23a5f86798 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:19.316430 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa69b213-86ed-411a-91fb-7f23a5f86798 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:19.317179 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa69b213-86ed-411a-91fb-7f23a5f86798 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:19.317640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa69b213-86ed-411a-91fb-7f23a5f86798 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:19.345359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fa69b213-86ed-411a-91fb-7f23a5f86798 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042269 Aug 04 04:49:19.346557 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 581/1151] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:19 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:19.518532 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-280a46fd-3b41-4234-992c-c20dd072e672 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:19.520661 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-280a46fd-3b41-4234-992c-c20dd072e672 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:19.527456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-280a46fd-3b41-4234-992c-c20dd072e672 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:19.527889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-280a46fd-3b41-4234-992c-c20dd072e672 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:19.528662 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-280a46fd-3b41-4234-992c-c20dd072e672 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:19.529097 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-280a46fd-3b41-4234-992c-c20dd072e672 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:19.560161 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-280a46fd-3b41-4234-992c-c20dd072e672 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045455 Aug 04 04:49:19.560708 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 571/1152] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:20.358517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0ab5ef45-edc6-4e26-b8b0-6af237258732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:20.360897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0ab5ef45-edc6-4e26-b8b0-6af237258732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:20.369014 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ab5ef45-edc6-4e26-b8b0-6af237258732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:20.369482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ab5ef45-edc6-4e26-b8b0-6af237258732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:20.370255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ab5ef45-edc6-4e26-b8b0-6af237258732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:20.370688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ab5ef45-edc6-4e26-b8b0-6af237258732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:20.399327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0ab5ef45-edc6-4e26-b8b0-6af237258732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044780 Aug 04 04:49:20.399866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 582/1153] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:20 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:20.572207 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-662153b0-ca08-49a4-9e2e-5c66047cc7ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:20.574407 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-662153b0-ca08-49a4-9e2e-5c66047cc7ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:20.580970 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-662153b0-ca08-49a4-9e2e-5c66047cc7ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:20.589907 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-662153b0-ca08-49a4-9e2e-5c66047cc7ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:20.591777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-662153b0-ca08-49a4-9e2e-5c66047cc7ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:20.592229 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-662153b0-ca08-49a4-9e2e-5c66047cc7ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:20.622016 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-662153b0-ca08-49a4-9e2e-5c66047cc7ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053542 Aug 04 04:49:20.622483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 572/1154] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:21.412262 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-93af4306-15ac-46d6-a3bc-c8793088c3fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:21.414858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-93af4306-15ac-46d6-a3bc-c8793088c3fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:21.421328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-93af4306-15ac-46d6-a3bc-c8793088c3fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:21.421813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-93af4306-15ac-46d6-a3bc-c8793088c3fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:21.422575 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-93af4306-15ac-46d6-a3bc-c8793088c3fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:21.423013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-93af4306-15ac-46d6-a3bc-c8793088c3fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:21.451325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-93af4306-15ac-46d6-a3bc-c8793088c3fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043752 Aug 04 04:49:21.451863 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 583/1155] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:21 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:21.635233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-961e71db-6f38-4360-8119-a193a65a1550 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:21.637375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-961e71db-6f38-4360-8119-a193a65a1550 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:21.646069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-961e71db-6f38-4360-8119-a193a65a1550 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:21.646530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-961e71db-6f38-4360-8119-a193a65a1550 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:21.647318 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-961e71db-6f38-4360-8119-a193a65a1550 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:21.647759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-961e71db-6f38-4360-8119-a193a65a1550 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:21.665449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-01369277-d41d-48f5-9bef-b59065544bfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:21.665912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-01369277-d41d-48f5-9bef-b59065544bfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:21.671806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-01369277-d41d-48f5-9bef-b59065544bfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:21.672260 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-01369277-d41d-48f5-9bef-b59065544bfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:21.673033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-01369277-d41d-48f5-9bef-b59065544bfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:21.673471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-01369277-d41d-48f5-9bef-b59065544bfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:21.677526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-961e71db-6f38-4360-8119-a193a65a1550 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046933 Aug 04 04:49:21.678107 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 573/1156] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:21 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:21.839888 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.objects.instance [None req-01369277-d41d-48f5-9bef-b59065544bfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lazy-loading 'services' on Instance uuid dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 {{(pid=134884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:49:21.911088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-01369277-d41d-48f5-9bef-b59065544bfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6/os-volume_attachments/83f1e6f6-5caa-4592-bbab-04344788c4b6" status: 202 len: 0 microversion: 2.1 time: 0.249832 Aug 04 04:49:21.911870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 584/1157] 10.222.0.47 () {58 vars in 1416 bytes} [Thu Aug 4 04:49:21 2022] DELETE /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6/os-volume_attachments/83f1e6f6-5caa-4592-bbab-04344788c4b6 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 04:49:22.464286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3b257a92-4c9b-4aaa-b787-129b630aa66e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:22.466415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3b257a92-4c9b-4aaa-b787-129b630aa66e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:22.472986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3b257a92-4c9b-4aaa-b787-129b630aa66e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:22.473432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3b257a92-4c9b-4aaa-b787-129b630aa66e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:22.474216 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3b257a92-4c9b-4aaa-b787-129b630aa66e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:22.474643 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3b257a92-4c9b-4aaa-b787-129b630aa66e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:22.478246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:22.503432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3b257a92-4c9b-4aaa-b787-129b630aa66e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043161 Aug 04 04:49:22.503996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 574/1158] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:22 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:22.691204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4bb8297c-e861-456a-b865-875176948f87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:22.693505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4bb8297c-e861-456a-b865-875176948f87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:22.699758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bb8297c-e861-456a-b865-875176948f87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:22.700202 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bb8297c-e861-456a-b865-875176948f87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:22.700961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bb8297c-e861-456a-b865-875176948f87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:22.701426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bb8297c-e861-456a-b865-875176948f87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:22.731573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4bb8297c-e861-456a-b865-875176948f87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045650 Aug 04 04:49:22.732040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 585/1159] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:22 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:23.515987 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a65c5a2c-6390-4583-9993-eb15508d002c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:23.518180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a65c5a2c-6390-4583-9993-eb15508d002c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:23.524651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a65c5a2c-6390-4583-9993-eb15508d002c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:23.525106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a65c5a2c-6390-4583-9993-eb15508d002c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:23.525900 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a65c5a2c-6390-4583-9993-eb15508d002c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:23.526338 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a65c5a2c-6390-4583-9993-eb15508d002c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:23.555593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a65c5a2c-6390-4583-9993-eb15508d002c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043626 Aug 04 04:49:23.556143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 575/1160] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:23 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:23.743988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5a43937d-508e-441c-b804-8244fb29063e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:23.746100 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5a43937d-508e-441c-b804-8244fb29063e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:23.752470 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a43937d-508e-441c-b804-8244fb29063e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:23.752917 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a43937d-508e-441c-b804-8244fb29063e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:23.753711 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a43937d-508e-441c-b804-8244fb29063e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:23.754142 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a43937d-508e-441c-b804-8244fb29063e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:23.781463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5a43937d-508e-441c-b804-8244fb29063e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041448 Aug 04 04:49:23.782020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 586/1161] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:23 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:24.568337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b32a900f-18a4-4001-bab2-df4899b2da03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:24.570486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b32a900f-18a4-4001-bab2-df4899b2da03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:24.576923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b32a900f-18a4-4001-bab2-df4899b2da03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:24.577372 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b32a900f-18a4-4001-bab2-df4899b2da03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:24.578158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b32a900f-18a4-4001-bab2-df4899b2da03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:24.578590 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b32a900f-18a4-4001-bab2-df4899b2da03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:24.607486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b32a900f-18a4-4001-bab2-df4899b2da03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043645 Aug 04 04:49:24.607961 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 576/1162] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:24 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:24.794249 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-177e6639-7c3b-4273-9541-0732b88c45ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:24.796408 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-177e6639-7c3b-4273-9541-0732b88c45ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:24.803631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-177e6639-7c3b-4273-9541-0732b88c45ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:24.804082 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-177e6639-7c3b-4273-9541-0732b88c45ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:24.804876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-177e6639-7c3b-4273-9541-0732b88c45ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:24.805316 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-177e6639-7c3b-4273-9541-0732b88c45ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:24.823290 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:24.851498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-177e6639-7c3b-4273-9541-0732b88c45ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061141 Aug 04 04:49:24.852062 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 587/1163] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:24 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:25.620135 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c3ebe7d9-00cf-4377-8c18-d5128132a67d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:25.622267 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c3ebe7d9-00cf-4377-8c18-d5128132a67d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:25.629459 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3ebe7d9-00cf-4377-8c18-d5128132a67d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:25.629935 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3ebe7d9-00cf-4377-8c18-d5128132a67d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:25.630823 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3ebe7d9-00cf-4377-8c18-d5128132a67d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:25.631252 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3ebe7d9-00cf-4377-8c18-d5128132a67d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:25.659010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c3ebe7d9-00cf-4377-8c18-d5128132a67d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042752 Aug 04 04:49:25.659585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 577/1164] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:25 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:25.864523 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c176d46d-ce08-4707-a4b6-bc6ecc1f0f9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:25.866704 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c176d46d-ce08-4707-a4b6-bc6ecc1f0f9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:25.873136 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c176d46d-ce08-4707-a4b6-bc6ecc1f0f9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:25.873614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c176d46d-ce08-4707-a4b6-bc6ecc1f0f9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:25.874382 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c176d46d-ce08-4707-a4b6-bc6ecc1f0f9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:25.874846 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c176d46d-ce08-4707-a4b6-bc6ecc1f0f9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:25.906620 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c176d46d-ce08-4707-a4b6-bc6ecc1f0f9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047288 Aug 04 04:49:25.907341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 588/1165] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:25 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:26.671348 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a6cc3920-9d2f-41ad-b2fc-268d3dddd028 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:26.673493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a6cc3920-9d2f-41ad-b2fc-268d3dddd028 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:26.680671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a6cc3920-9d2f-41ad-b2fc-268d3dddd028 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:26.681126 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a6cc3920-9d2f-41ad-b2fc-268d3dddd028 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:26.681915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a6cc3920-9d2f-41ad-b2fc-268d3dddd028 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:26.682355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a6cc3920-9d2f-41ad-b2fc-268d3dddd028 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:26.710977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a6cc3920-9d2f-41ad-b2fc-268d3dddd028 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043467 Aug 04 04:49:26.711448 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 578/1166] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:26 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:26.919138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5795e133-534d-435a-8e20-605459879b61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:26.921275 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5795e133-534d-435a-8e20-605459879b61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:26.928331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5795e133-534d-435a-8e20-605459879b61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:26.928775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5795e133-534d-435a-8e20-605459879b61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:26.929533 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5795e133-534d-435a-8e20-605459879b61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:26.929991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5795e133-534d-435a-8e20-605459879b61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:26.960641 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5795e133-534d-435a-8e20-605459879b61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045132 Aug 04 04:49:26.965061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 589/1167] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:26 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:27.723202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-628e55f1-968f-464e-bd94-17c1fc5f882a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:27.725309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-628e55f1-968f-464e-bd94-17c1fc5f882a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:27.731885 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-628e55f1-968f-464e-bd94-17c1fc5f882a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:27.732333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-628e55f1-968f-464e-bd94-17c1fc5f882a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:27.733112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-628e55f1-968f-464e-bd94-17c1fc5f882a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:27.733556 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-628e55f1-968f-464e-bd94-17c1fc5f882a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:27.761593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-628e55f1-968f-464e-bd94-17c1fc5f882a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042359 Aug 04 04:49:27.762060 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 579/1168] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:27 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:27.972416 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cfd9bfee-7883-4533-882e-d71221b096e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:27.974559 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cfd9bfee-7883-4533-882e-d71221b096e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:27.980905 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cfd9bfee-7883-4533-882e-d71221b096e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:27.981349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cfd9bfee-7883-4533-882e-d71221b096e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:27.982133 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cfd9bfee-7883-4533-882e-d71221b096e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:27.982567 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cfd9bfee-7883-4533-882e-d71221b096e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:28.011841 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cfd9bfee-7883-4533-882e-d71221b096e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043496 Aug 04 04:49:28.012326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 590/1169] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:27 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:28.774226 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eaa14480-3aa5-4f8b-96f0-23dcddb5a33a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:28.776384 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eaa14480-3aa5-4f8b-96f0-23dcddb5a33a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:28.782803 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eaa14480-3aa5-4f8b-96f0-23dcddb5a33a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:28.783251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eaa14480-3aa5-4f8b-96f0-23dcddb5a33a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:28.784962 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eaa14480-3aa5-4f8b-96f0-23dcddb5a33a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:28.785411 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eaa14480-3aa5-4f8b-96f0-23dcddb5a33a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:28.813404 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eaa14480-3aa5-4f8b-96f0-23dcddb5a33a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043128 Aug 04 04:49:28.813970 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 580/1170] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:28 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:29.023841 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fbf0ed01-a60f-44c1-9122-0698e6187930 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:29.026078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fbf0ed01-a60f-44c1-9122-0698e6187930 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:29.032449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fbf0ed01-a60f-44c1-9122-0698e6187930 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:29.032901 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fbf0ed01-a60f-44c1-9122-0698e6187930 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:29.033769 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fbf0ed01-a60f-44c1-9122-0698e6187930 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:29.034401 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fbf0ed01-a60f-44c1-9122-0698e6187930 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:29.063258 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fbf0ed01-a60f-44c1-9122-0698e6187930 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043342 Aug 04 04:49:29.063816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 591/1171] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:29 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:29.825663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5ab48ecd-0b46-4ab3-b2db-a4bae61815a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:29.827819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5ab48ecd-0b46-4ab3-b2db-a4bae61815a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:29.834319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ab48ecd-0b46-4ab3-b2db-a4bae61815a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:29.834754 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ab48ecd-0b46-4ab3-b2db-a4bae61815a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:29.835508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ab48ecd-0b46-4ab3-b2db-a4bae61815a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:29.835936 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ab48ecd-0b46-4ab3-b2db-a4bae61815a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:29.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5ab48ecd-0b46-4ab3-b2db-a4bae61815a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043355 Aug 04 04:49:29.865625 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 581/1172] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:29 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:30.076086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1cf05483-0e6e-4337-abd7-79195644a1e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:30.078229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1cf05483-0e6e-4337-abd7-79195644a1e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:30.085168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1cf05483-0e6e-4337-abd7-79195644a1e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:30.085659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1cf05483-0e6e-4337-abd7-79195644a1e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:30.086423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1cf05483-0e6e-4337-abd7-79195644a1e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:30.086859 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1cf05483-0e6e-4337-abd7-79195644a1e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:30.116014 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1cf05483-0e6e-4337-abd7-79195644a1e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Aug 04 04:49:30.116573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 592/1173] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:30 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:30.877351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e6d8208c-01c2-498c-8d7b-7222dddd1d0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:30.879481 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e6d8208c-01c2-498c-8d7b-7222dddd1d0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:30.885963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6d8208c-01c2-498c-8d7b-7222dddd1d0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:30.886410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6d8208c-01c2-498c-8d7b-7222dddd1d0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:30.887162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6d8208c-01c2-498c-8d7b-7222dddd1d0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:30.887594 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6d8208c-01c2-498c-8d7b-7222dddd1d0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:30.916711 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e6d8208c-01c2-498c-8d7b-7222dddd1d0d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043469 Aug 04 04:49:30.917251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 582/1174] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:30 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:31.128132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a2304860-5e55-4669-8ad1-6ff73bb498cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:31.130239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a2304860-5e55-4669-8ad1-6ff73bb498cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:31.136587 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2304860-5e55-4669-8ad1-6ff73bb498cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:31.137033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2304860-5e55-4669-8ad1-6ff73bb498cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:31.137814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2304860-5e55-4669-8ad1-6ff73bb498cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:31.138245 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2304860-5e55-4669-8ad1-6ff73bb498cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:31.168111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a2304860-5e55-4669-8ad1-6ff73bb498cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043943 Aug 04 04:49:31.168674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 593/1175] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:31 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:31.929486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-81aa0f06-0594-46cf-a139-61e14b1e7865 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:31.931628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-81aa0f06-0594-46cf-a139-61e14b1e7865 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:31.938077 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81aa0f06-0594-46cf-a139-61e14b1e7865 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:31.938530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81aa0f06-0594-46cf-a139-61e14b1e7865 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:31.939286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81aa0f06-0594-46cf-a139-61e14b1e7865 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:31.939751 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81aa0f06-0594-46cf-a139-61e14b1e7865 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:31.968113 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-81aa0f06-0594-46cf-a139-61e14b1e7865 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 Aug 04 04:49:31.968646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 583/1176] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:31 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:32.180711 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7fb00e56-7ab2-41b8-8b7d-ff0c86502797 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:32.182877 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7fb00e56-7ab2-41b8-8b7d-ff0c86502797 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:32.189279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7fb00e56-7ab2-41b8-8b7d-ff0c86502797 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:32.189772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7fb00e56-7ab2-41b8-8b7d-ff0c86502797 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:32.190527 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7fb00e56-7ab2-41b8-8b7d-ff0c86502797 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:32.191004 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7fb00e56-7ab2-41b8-8b7d-ff0c86502797 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:32.219411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7fb00e56-7ab2-41b8-8b7d-ff0c86502797 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042651 Aug 04 04:49:32.219968 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 594/1177] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:32 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:32.980390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-30870203-0745-4d83-b60e-756b0dc00656 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:32.982536 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-30870203-0745-4d83-b60e-756b0dc00656 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:32.989522 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-30870203-0745-4d83-b60e-756b0dc00656 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:32.990005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-30870203-0745-4d83-b60e-756b0dc00656 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:32.990770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-30870203-0745-4d83-b60e-756b0dc00656 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:32.991207 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-30870203-0745-4d83-b60e-756b0dc00656 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:33.021301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-30870203-0745-4d83-b60e-756b0dc00656 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044836 Aug 04 04:49:33.021876 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 584/1178] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:32 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:33.232222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-60513c88-3422-4687-91fe-a607fef0a3fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:33.234334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-60513c88-3422-4687-91fe-a607fef0a3fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:33.241410 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-60513c88-3422-4687-91fe-a607fef0a3fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:33.242518 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-60513c88-3422-4687-91fe-a607fef0a3fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:33.243339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-60513c88-3422-4687-91fe-a607fef0a3fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:33.243786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-60513c88-3422-4687-91fe-a607fef0a3fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:33.277033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-60513c88-3422-4687-91fe-a607fef0a3fc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048713 Aug 04 04:49:33.277614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 595/1179] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:33 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:34.033709 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-45abe686-15eb-4ca9-85c5-dc6c90150796 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:34.035874 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-45abe686-15eb-4ca9-85c5-dc6c90150796 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:34.042580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-45abe686-15eb-4ca9-85c5-dc6c90150796 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:34.043035 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-45abe686-15eb-4ca9-85c5-dc6c90150796 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:34.043824 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-45abe686-15eb-4ca9-85c5-dc6c90150796 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:34.044263 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-45abe686-15eb-4ca9-85c5-dc6c90150796 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:34.073225 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-45abe686-15eb-4ca9-85c5-dc6c90150796 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043611 Aug 04 04:49:34.073806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 585/1180] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:34 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:34.288707 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-df14cb15-ffb8-40cd-8e9c-8d68f78b4967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:34.291059 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-df14cb15-ffb8-40cd-8e9c-8d68f78b4967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:34.297440 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-df14cb15-ffb8-40cd-8e9c-8d68f78b4967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:34.297989 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-df14cb15-ffb8-40cd-8e9c-8d68f78b4967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:34.298745 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-df14cb15-ffb8-40cd-8e9c-8d68f78b4967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:34.299186 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-df14cb15-ffb8-40cd-8e9c-8d68f78b4967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:34.329290 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-df14cb15-ffb8-40cd-8e9c-8d68f78b4967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Aug 04 04:49:34.329878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 596/1181] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:34 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:35.085620 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-73c3ee4f-afa1-4732-8afc-d9d3fc71277f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:35.087835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-73c3ee4f-afa1-4732-8afc-d9d3fc71277f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:35.094094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73c3ee4f-afa1-4732-8afc-d9d3fc71277f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:35.094549 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73c3ee4f-afa1-4732-8afc-d9d3fc71277f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:35.095306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73c3ee4f-afa1-4732-8afc-d9d3fc71277f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:35.095740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73c3ee4f-afa1-4732-8afc-d9d3fc71277f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:35.125167 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-73c3ee4f-afa1-4732-8afc-d9d3fc71277f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Aug 04 04:49:35.125743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 586/1182] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:35 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:35.342572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2ec47e48-4e44-4eb6-a574-03e04cedf325 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:35.344644 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2ec47e48-4e44-4eb6-a574-03e04cedf325 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:35.351967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2ec47e48-4e44-4eb6-a574-03e04cedf325 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:35.352423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2ec47e48-4e44-4eb6-a574-03e04cedf325 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:35.353225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2ec47e48-4e44-4eb6-a574-03e04cedf325 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:35.353697 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2ec47e48-4e44-4eb6-a574-03e04cedf325 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:35.382801 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2ec47e48-4e44-4eb6-a574-03e04cedf325 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Aug 04 04:49:35.383366 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 597/1183] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:35 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:36.137125 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9fe1aea5-3cc3-48ac-ae95-cc68d5010f35 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:36.139317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9fe1aea5-3cc3-48ac-ae95-cc68d5010f35 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:36.146300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9fe1aea5-3cc3-48ac-ae95-cc68d5010f35 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:36.146747 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9fe1aea5-3cc3-48ac-ae95-cc68d5010f35 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:36.147525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9fe1aea5-3cc3-48ac-ae95-cc68d5010f35 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:36.147954 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9fe1aea5-3cc3-48ac-ae95-cc68d5010f35 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:36.176993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9fe1aea5-3cc3-48ac-ae95-cc68d5010f35 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043772 Aug 04 04:49:36.177535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 587/1184] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:36 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:36.394627 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d156a10b-3034-4cd0-a5aa-241c94c09bde tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:36.396678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d156a10b-3034-4cd0-a5aa-241c94c09bde tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:36.403476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d156a10b-3034-4cd0-a5aa-241c94c09bde tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:36.403929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d156a10b-3034-4cd0-a5aa-241c94c09bde tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:36.404700 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d156a10b-3034-4cd0-a5aa-241c94c09bde tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:36.405138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d156a10b-3034-4cd0-a5aa-241c94c09bde tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:36.438569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d156a10b-3034-4cd0-a5aa-241c94c09bde tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047975 Aug 04 04:49:36.439141 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 598/1185] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:36 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:37.189022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e463702b-de17-4922-8d2c-37c168cd03ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:37.191732 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e463702b-de17-4922-8d2c-37c168cd03ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:37.198163 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e463702b-de17-4922-8d2c-37c168cd03ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:37.198606 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e463702b-de17-4922-8d2c-37c168cd03ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:37.199358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e463702b-de17-4922-8d2c-37c168cd03ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:37.199785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e463702b-de17-4922-8d2c-37c168cd03ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:37.228840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e463702b-de17-4922-8d2c-37c168cd03ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043699 Aug 04 04:49:37.229377 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 588/1186] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:37 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:37.452485 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e5909d12-6911-4daf-89cb-13b77dd5f4c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:37.454588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e5909d12-6911-4daf-89cb-13b77dd5f4c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:37.461800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5909d12-6911-4daf-89cb-13b77dd5f4c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:37.462273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5909d12-6911-4daf-89cb-13b77dd5f4c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:37.463030 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5909d12-6911-4daf-89cb-13b77dd5f4c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:37.463457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5909d12-6911-4daf-89cb-13b77dd5f4c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:37.493939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e5909d12-6911-4daf-89cb-13b77dd5f4c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046898 Aug 04 04:49:37.499264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 599/1187] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:37 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:38.241925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-81fc8b72-bd29-4121-9ea7-172566b29bf9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:38.244048 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-81fc8b72-bd29-4121-9ea7-172566b29bf9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:38.250493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81fc8b72-bd29-4121-9ea7-172566b29bf9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:38.250939 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81fc8b72-bd29-4121-9ea7-172566b29bf9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:38.251689 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81fc8b72-bd29-4121-9ea7-172566b29bf9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:38.252117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81fc8b72-bd29-4121-9ea7-172566b29bf9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:38.280446 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-81fc8b72-bd29-4121-9ea7-172566b29bf9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043386 Aug 04 04:49:38.280982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 589/1188] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:38 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:38.505717 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ad347dcb-7dd4-4c19-87e2-c8216f5895ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:38.507852 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ad347dcb-7dd4-4c19-87e2-c8216f5895ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:38.514359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ad347dcb-7dd4-4c19-87e2-c8216f5895ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:38.514814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ad347dcb-7dd4-4c19-87e2-c8216f5895ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:38.515567 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ad347dcb-7dd4-4c19-87e2-c8216f5895ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:38.516017 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ad347dcb-7dd4-4c19-87e2-c8216f5895ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:38.545904 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ad347dcb-7dd4-4c19-87e2-c8216f5895ff tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044231 Aug 04 04:49:38.546457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 600/1189] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:38 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:39.292623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-aa56d4b9-67ae-4906-8222-b43118f3e068 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:39.294765 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-aa56d4b9-67ae-4906-8222-b43118f3e068 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:39.302189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa56d4b9-67ae-4906-8222-b43118f3e068 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:39.302643 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa56d4b9-67ae-4906-8222-b43118f3e068 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:39.303404 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa56d4b9-67ae-4906-8222-b43118f3e068 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:39.303843 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aa56d4b9-67ae-4906-8222-b43118f3e068 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:39.328528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:39.333790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-aa56d4b9-67ae-4906-8222-b43118f3e068 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045344 Aug 04 04:49:39.334374 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 590/1190] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:39.558468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4007928f-1b97-4b54-a3ea-39fedad22452 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:39.560525 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4007928f-1b97-4b54-a3ea-39fedad22452 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:39.566978 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4007928f-1b97-4b54-a3ea-39fedad22452 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:39.567438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4007928f-1b97-4b54-a3ea-39fedad22452 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:39.568181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4007928f-1b97-4b54-a3ea-39fedad22452 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:39.568611 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4007928f-1b97-4b54-a3ea-39fedad22452 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:39.598149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4007928f-1b97-4b54-a3ea-39fedad22452 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043007 Aug 04 04:49:39.598921 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 601/1191] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:39 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:40.346429 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f4a9ed90-8b9f-455a-a38d-5cb63c0742e0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:40.349018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f4a9ed90-8b9f-455a-a38d-5cb63c0742e0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:40.355657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f4a9ed90-8b9f-455a-a38d-5cb63c0742e0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:40.356106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f4a9ed90-8b9f-455a-a38d-5cb63c0742e0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:40.356908 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f4a9ed90-8b9f-455a-a38d-5cb63c0742e0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:40.357343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f4a9ed90-8b9f-455a-a38d-5cb63c0742e0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:40.387760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f4a9ed90-8b9f-455a-a38d-5cb63c0742e0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 Aug 04 04:49:40.388309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 591/1192] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:40 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:40.611068 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1086bc4d-f27f-46e9-aa12-3f6eb60d0c2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:40.613766 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1086bc4d-f27f-46e9-aa12-3f6eb60d0c2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:40.619713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1086bc4d-f27f-46e9-aa12-3f6eb60d0c2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:40.620155 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1086bc4d-f27f-46e9-aa12-3f6eb60d0c2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:40.620944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1086bc4d-f27f-46e9-aa12-3f6eb60d0c2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:40.621372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1086bc4d-f27f-46e9-aa12-3f6eb60d0c2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:40.650666 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1086bc4d-f27f-46e9-aa12-3f6eb60d0c2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043764 Aug 04 04:49:40.651222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 602/1193] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:40 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:41.400106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f20ed24c-f596-4024-89dc-9f00cae102d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:41.402259 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f20ed24c-f596-4024-89dc-9f00cae102d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:41.408691 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f20ed24c-f596-4024-89dc-9f00cae102d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:41.409143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f20ed24c-f596-4024-89dc-9f00cae102d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:41.410545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f20ed24c-f596-4024-89dc-9f00cae102d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:41.410991 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f20ed24c-f596-4024-89dc-9f00cae102d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:41.442196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f20ed24c-f596-4024-89dc-9f00cae102d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045035 Aug 04 04:49:41.442736 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 592/1194] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:41 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:41.663219 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-43a3976c-e130-4eaa-bba4-01fdb8220fb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:41.665587 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-43a3976c-e130-4eaa-bba4-01fdb8220fb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:41.672056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-43a3976c-e130-4eaa-bba4-01fdb8220fb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:41.672508 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-43a3976c-e130-4eaa-bba4-01fdb8220fb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:41.673271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-43a3976c-e130-4eaa-bba4-01fdb8220fb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:41.673739 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-43a3976c-e130-4eaa-bba4-01fdb8220fb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:41.703301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-43a3976c-e130-4eaa-bba4-01fdb8220fb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044600 Aug 04 04:49:41.703855 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 603/1195] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:41 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:42.454345 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8385166d-7353-4d25-94bb-40355bcfb386 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:42.456623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8385166d-7353-4d25-94bb-40355bcfb386 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:42.464195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8385166d-7353-4d25-94bb-40355bcfb386 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:42.464644 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8385166d-7353-4d25-94bb-40355bcfb386 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:42.465398 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8385166d-7353-4d25-94bb-40355bcfb386 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:42.465857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8385166d-7353-4d25-94bb-40355bcfb386 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:42.494134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8385166d-7353-4d25-94bb-40355bcfb386 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Aug 04 04:49:42.494681 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 593/1196] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:42 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:42.715345 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-279a1a2d-6317-4474-800a-cc82dcdc3d1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:42.717439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-279a1a2d-6317-4474-800a-cc82dcdc3d1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:42.724091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-279a1a2d-6317-4474-800a-cc82dcdc3d1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:42.724534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-279a1a2d-6317-4474-800a-cc82dcdc3d1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:42.725283 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-279a1a2d-6317-4474-800a-cc82dcdc3d1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:42.725748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-279a1a2d-6317-4474-800a-cc82dcdc3d1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:42.729534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:42.756027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-279a1a2d-6317-4474-800a-cc82dcdc3d1c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Aug 04 04:49:42.756580 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 604/1197] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:42 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:43.506709 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d85c1cc0-cea4-40a2-a821-ddbea49f7fc2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:43.508861 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d85c1cc0-cea4-40a2-a821-ddbea49f7fc2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:43.511190 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=58 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:43.516410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d85c1cc0-cea4-40a2-a821-ddbea49f7fc2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:43.516858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d85c1cc0-cea4-40a2-a821-ddbea49f7fc2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:43.517657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d85c1cc0-cea4-40a2-a821-ddbea49f7fc2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:43.518091 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d85c1cc0-cea4-40a2-a821-ddbea49f7fc2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:43.548011 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d85c1cc0-cea4-40a2-a821-ddbea49f7fc2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045418 Aug 04 04:49:43.548558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 594/1198] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:43 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:43.768031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-da3f598a-10ab-45e2-a659-cd5aa57ad6c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:43.770287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-da3f598a-10ab-45e2-a659-cd5aa57ad6c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:43.776749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da3f598a-10ab-45e2-a659-cd5aa57ad6c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:43.777196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da3f598a-10ab-45e2-a659-cd5aa57ad6c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:43.777995 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da3f598a-10ab-45e2-a659-cd5aa57ad6c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:43.778425 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da3f598a-10ab-45e2-a659-cd5aa57ad6c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:43.807752 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-da3f598a-10ab-45e2-a659-cd5aa57ad6c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043673 Aug 04 04:49:43.808302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 605/1199] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:43 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:44.561344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-be72af05-e136-4404-839a-8869d16fd61b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:44.563525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-be72af05-e136-4404-839a-8869d16fd61b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:44.570401 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be72af05-e136-4404-839a-8869d16fd61b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:44.570856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be72af05-e136-4404-839a-8869d16fd61b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:44.571616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be72af05-e136-4404-839a-8869d16fd61b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:44.572053 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be72af05-e136-4404-839a-8869d16fd61b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:44.601152 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-be72af05-e136-4404-839a-8869d16fd61b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043816 Aug 04 04:49:44.601730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 595/1200] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:44 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:44.820298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8afd41af-d3be-4909-8812-0a50e8ec6980 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:44.822469 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8afd41af-d3be-4909-8812-0a50e8ec6980 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:44.828949 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8afd41af-d3be-4909-8812-0a50e8ec6980 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:44.829404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8afd41af-d3be-4909-8812-0a50e8ec6980 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:44.830201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8afd41af-d3be-4909-8812-0a50e8ec6980 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:44.830642 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8afd41af-d3be-4909-8812-0a50e8ec6980 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:44.860510 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8afd41af-d3be-4909-8812-0a50e8ec6980 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044617 Aug 04 04:49:44.861065 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 606/1201] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:44 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:45.614056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8d5e98c1-af53-474a-a612-6508837c77a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:45.616175 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8d5e98c1-af53-474a-a612-6508837c77a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:45.622696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d5e98c1-af53-474a-a612-6508837c77a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:45.623149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d5e98c1-af53-474a-a612-6508837c77a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:45.623907 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d5e98c1-af53-474a-a612-6508837c77a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:45.624343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d5e98c1-af53-474a-a612-6508837c77a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:45.652623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8d5e98c1-af53-474a-a612-6508837c77a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043265 Aug 04 04:49:45.653164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 596/1202] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:45 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:45.871852 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4e973469-c992-4b60-84ef-b13b321c46aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:45.874050 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4e973469-c992-4b60-84ef-b13b321c46aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:45.881088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e973469-c992-4b60-84ef-b13b321c46aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:45.881537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e973469-c992-4b60-84ef-b13b321c46aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:45.882320 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e973469-c992-4b60-84ef-b13b321c46aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:45.882760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e973469-c992-4b60-84ef-b13b321c46aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:45.913062 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4e973469-c992-4b60-84ef-b13b321c46aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045105 Aug 04 04:49:45.913779 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 607/1203] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:45 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:46.664667 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8423fc96-ed46-4006-a7a3-6f083168392a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:46.667089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8423fc96-ed46-4006-a7a3-6f083168392a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:46.673597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8423fc96-ed46-4006-a7a3-6f083168392a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:46.674079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8423fc96-ed46-4006-a7a3-6f083168392a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:46.674834 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8423fc96-ed46-4006-a7a3-6f083168392a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:46.675964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8423fc96-ed46-4006-a7a3-6f083168392a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:46.704122 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8423fc96-ed46-4006-a7a3-6f083168392a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Aug 04 04:49:46.704653 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 597/1204] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:46 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:46.924930 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-56e537f5-4835-4b92-8944-656f3440d621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:46.927333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-56e537f5-4835-4b92-8944-656f3440d621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:46.929694 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=60 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:46.935002 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-56e537f5-4835-4b92-8944-656f3440d621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:46.935448 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-56e537f5-4835-4b92-8944-656f3440d621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:46.936206 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-56e537f5-4835-4b92-8944-656f3440d621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:46.936641 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-56e537f5-4835-4b92-8944-656f3440d621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:46.966673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-56e537f5-4835-4b92-8944-656f3440d621 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045612 Aug 04 04:49:46.967429 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 608/1205] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:46 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:47.716356 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d55a3551-f0f2-4e33-b7b3-3db922b18df1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:47.718525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d55a3551-f0f2-4e33-b7b3-3db922b18df1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:47.725615 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d55a3551-f0f2-4e33-b7b3-3db922b18df1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:47.726063 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d55a3551-f0f2-4e33-b7b3-3db922b18df1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:47.726806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d55a3551-f0f2-4e33-b7b3-3db922b18df1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:47.727236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d55a3551-f0f2-4e33-b7b3-3db922b18df1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:47.755616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d55a3551-f0f2-4e33-b7b3-3db922b18df1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043243 Aug 04 04:49:47.756371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 598/1206] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:47 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:47.978679 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-80124e9e-3626-4e2a-8580-f64d0b95a123 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:47.980812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-80124e9e-3626-4e2a-8580-f64d0b95a123 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:47.987308 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-80124e9e-3626-4e2a-8580-f64d0b95a123 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:47.988578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-80124e9e-3626-4e2a-8580-f64d0b95a123 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:47.989535 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-80124e9e-3626-4e2a-8580-f64d0b95a123 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:47.990059 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-80124e9e-3626-4e2a-8580-f64d0b95a123 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:48.020625 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-80124e9e-3626-4e2a-8580-f64d0b95a123 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Aug 04 04:49:48.021195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 609/1207] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:47 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:48.767825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5b2de057-9f37-4a0f-8fe7-c93bf09b34a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:48.770928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5b2de057-9f37-4a0f-8fe7-c93bf09b34a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:48.777498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b2de057-9f37-4a0f-8fe7-c93bf09b34a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:48.777990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b2de057-9f37-4a0f-8fe7-c93bf09b34a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:48.778749 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b2de057-9f37-4a0f-8fe7-c93bf09b34a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:48.779188 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b2de057-9f37-4a0f-8fe7-c93bf09b34a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:48.808278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5b2de057-9f37-4a0f-8fe7-c93bf09b34a9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044390 Aug 04 04:49:48.808816 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 599/1208] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:48 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:49.032205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2a190f97-31c3-4be2-a06e-a0eb56b99f07 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:49.034396 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2a190f97-31c3-4be2-a06e-a0eb56b99f07 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:49.041253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2a190f97-31c3-4be2-a06e-a0eb56b99f07 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:49.041744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2a190f97-31c3-4be2-a06e-a0eb56b99f07 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:49.042514 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2a190f97-31c3-4be2-a06e-a0eb56b99f07 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:49.042950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2a190f97-31c3-4be2-a06e-a0eb56b99f07 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:49.072893 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2a190f97-31c3-4be2-a06e-a0eb56b99f07 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Aug 04 04:49:49.073454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 610/1209] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:49 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:49.821147 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3712ff18-303d-4d8d-bdcb-25e5ec066a16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:49.823290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3712ff18-303d-4d8d-bdcb-25e5ec066a16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:49.829783 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3712ff18-303d-4d8d-bdcb-25e5ec066a16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:49.830243 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3712ff18-303d-4d8d-bdcb-25e5ec066a16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:49.831006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3712ff18-303d-4d8d-bdcb-25e5ec066a16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:49.831461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3712ff18-303d-4d8d-bdcb-25e5ec066a16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:49.860005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3712ff18-303d-4d8d-bdcb-25e5ec066a16 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042953 Aug 04 04:49:49.860556 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 600/1210] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:49 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:50.084748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4c7aeaa3-1a15-42b9-988d-93500df7b4d5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:50.086821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4c7aeaa3-1a15-42b9-988d-93500df7b4d5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:50.093171 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c7aeaa3-1a15-42b9-988d-93500df7b4d5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:50.093643 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c7aeaa3-1a15-42b9-988d-93500df7b4d5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:50.094399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c7aeaa3-1a15-42b9-988d-93500df7b4d5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:50.094834 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c7aeaa3-1a15-42b9-988d-93500df7b4d5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:50.125946 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4c7aeaa3-1a15-42b9-988d-93500df7b4d5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045254 Aug 04 04:49:50.126507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 611/1211] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:50 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:50.872902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8f467458-7166-4c77-adb2-2ecafbe029d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:50.875036 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8f467458-7166-4c77-adb2-2ecafbe029d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:50.881747 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8f467458-7166-4c77-adb2-2ecafbe029d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:50.882193 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8f467458-7166-4c77-adb2-2ecafbe029d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:50.882952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8f467458-7166-4c77-adb2-2ecafbe029d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:50.883380 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8f467458-7166-4c77-adb2-2ecafbe029d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:50.911409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8f467458-7166-4c77-adb2-2ecafbe029d6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042472 Aug 04 04:49:50.911945 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 601/1212] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:50 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:51.113148 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ddf300df-e680-4076-b8d0-9386c4e8dff6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:51.113971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ddf300df-e680-4076-b8d0-9386c4e8dff6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:51.120436 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ddf300df-e680-4076-b8d0-9386c4e8dff6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:51.120878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ddf300df-e680-4076-b8d0-9386c4e8dff6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:51.121670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ddf300df-e680-4076-b8d0-9386c4e8dff6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:51.122087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ddf300df-e680-4076-b8d0-9386c4e8dff6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:51.138782 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-26b1331d-abeb-4e0b-b396-6b4ccc526034 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:51.140834 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-26b1331d-abeb-4e0b-b396-6b4ccc526034 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:51.146771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ddf300df-e680-4076-b8d0-9386c4e8dff6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Going to try to terminate instance {{(pid=134884) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:49:51.147350 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26b1331d-abeb-4e0b-b396-6b4ccc526034 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:51.147806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26b1331d-abeb-4e0b-b396-6b4ccc526034 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:51.148568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26b1331d-abeb-4e0b-b396-6b4ccc526034 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:51.149000 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26b1331d-abeb-4e0b-b396-6b4ccc526034 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:51.181894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-26b1331d-abeb-4e0b-b396-6b4ccc526034 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046797 Aug 04 04:49:51.182466 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 602/1213] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:51 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:49:51.225410 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ddf300df-e680-4076-b8d0-9386c4e8dff6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 204 len: 0 microversion: 2.1 time: 0.115812 Aug 04 04:49:51.226038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 612/1214] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:49:51 2022] DELETE /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:49:51.234525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dcab956e-9338-4292-91e2-76649d50d02a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:51.235150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dcab956e-9338-4292-91e2-76649d50d02a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:51.241580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dcab956e-9338-4292-91e2-76649d50d02a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:51.242044 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dcab956e-9338-4292-91e2-76649d50d02a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:51.242816 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dcab956e-9338-4292-91e2-76649d50d02a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:51.243256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dcab956e-9338-4292-91e2-76649d50d02a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:51.431655 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dcab956e-9338-4292-91e2-76649d50d02a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:51.438958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dcab956e-9338-4292-91e2-76649d50d02a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1682 microversion: 2.1 time: 0.208448 Aug 04 04:49:51.439528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 603/1215] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:51 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:51.924647 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ef75b440-87cf-4d04-9aa5-5243fcae3d84 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:51.927768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ef75b440-87cf-4d04-9aa5-5243fcae3d84 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:51.933903 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef75b440-87cf-4d04-9aa5-5243fcae3d84 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:51.934292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef75b440-87cf-4d04-9aa5-5243fcae3d84 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:51.935052 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef75b440-87cf-4d04-9aa5-5243fcae3d84 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:51.935489 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef75b440-87cf-4d04-9aa5-5243fcae3d84 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:51.964718 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ef75b440-87cf-4d04-9aa5-5243fcae3d84 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Aug 04 04:49:51.965272 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 613/1216] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:51 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:52.196211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d475fa19-d492-4b5e-bda0-bdd3a69d5328 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:52.200269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d475fa19-d492-4b5e-bda0-bdd3a69d5328 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:52.206210 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d475fa19-d492-4b5e-bda0-bdd3a69d5328 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:52.207219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d475fa19-d492-4b5e-bda0-bdd3a69d5328 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:52.207994 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d475fa19-d492-4b5e-bda0-bdd3a69d5328 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:52.208631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d475fa19-d492-4b5e-bda0-bdd3a69d5328 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:52.241531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d475fa19-d492-4b5e-bda0-bdd3a69d5328 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050733 Aug 04 04:49:52.242115 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 604/1217] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:52 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:52.461677 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-75403180-a32c-4f49-9927-7adfd8332994 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:52.462302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-75403180-a32c-4f49-9927-7adfd8332994 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:52.469380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-75403180-a32c-4f49-9927-7adfd8332994 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:52.470114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-75403180-a32c-4f49-9927-7adfd8332994 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:52.471229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-75403180-a32c-4f49-9927-7adfd8332994 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:52.471701 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-75403180-a32c-4f49-9927-7adfd8332994 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:52.548491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-75403180-a32c-4f49-9927-7adfd8332994 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:52.559013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-75403180-a32c-4f49-9927-7adfd8332994 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 200 len: 1614 microversion: 2.1 time: 0.101140 Aug 04 04:49:52.559013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 614/1218] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:52 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:52.588896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-ea2fe619-9e09-40ef-a145-856f999cf3fe req-60f35c11-a736-466a-9e82-add8d57e2a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbf781e-8aba-4088-8d3e-037ef7c8acbd", "name": "network-vif-deleted", "tag": "61ceb08c-394c-47c9-b6fd-5e32720c71f4"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:52.602246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-ea2fe619-9e09-40ef-a145-856f999cf3fe req-60f35c11-a736-466a-9e82-add8d57e2a52 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:52.602835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-ea2fe619-9e09-40ef-a145-856f999cf3fe req-60f35c11-a736-466a-9e82-add8d57e2a52 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:52.623986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-ea2fe619-9e09-40ef-a145-856f999cf3fe req-60f35c11-a736-466a-9e82-add8d57e2a52 service nova] Creating event network-vif-deleted:61ceb08c-394c-47c9-b6fd-5e32720c71f4 for instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd on hv-cinder-85127 Aug 04 04:49:52.632705 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-ea2fe619-9e09-40ef-a145-856f999cf3fe req-60f35c11-a736-466a-9e82-add8d57e2a52 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162933 Aug 04 04:49:52.638155 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 605/1219] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:49:52.979379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-27ab2510-7f97-4fd4-9b7d-174ff0a64dd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:52.981484 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-27ab2510-7f97-4fd4-9b7d-174ff0a64dd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:52.988877 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27ab2510-7f97-4fd4-9b7d-174ff0a64dd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:52.989454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27ab2510-7f97-4fd4-9b7d-174ff0a64dd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:52.990430 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27ab2510-7f97-4fd4-9b7d-174ff0a64dd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:52.991064 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27ab2510-7f97-4fd4-9b7d-174ff0a64dd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:53.023453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-27ab2510-7f97-4fd4-9b7d-174ff0a64dd5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048465 Aug 04 04:49:53.024040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 615/1220] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:52 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:49:53.254303 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b7349329-9758-477b-b682-ef4be417af09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:53.256498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b7349329-9758-477b-b682-ef4be417af09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:53.263693 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7349329-9758-477b-b682-ef4be417af09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:53.264142 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7349329-9758-477b-b682-ef4be417af09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:53.264915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7349329-9758-477b-b682-ef4be417af09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:53.265350 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b7349329-9758-477b-b682-ef4be417af09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:53.299264 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b7349329-9758-477b-b682-ef4be417af09 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049317 Aug 04 04:49:53.304174 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 606/1221] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:53 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:53.580204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4c71c0db-c643-4d20-b2bc-92f6ad47632e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:53.580824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4c71c0db-c643-4d20-b2bc-92f6ad47632e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:53.588133 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c71c0db-c643-4d20-b2bc-92f6ad47632e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:53.588590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c71c0db-c643-4d20-b2bc-92f6ad47632e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:53.589350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c71c0db-c643-4d20-b2bc-92f6ad47632e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:53.589811 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4c71c0db-c643-4d20-b2bc-92f6ad47632e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:53.605114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-4c71c0db-c643-4d20-b2bc-92f6ad47632e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] HTTP exception thrown: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4c71c0db-c643-4d20-b2bc-92f6ad47632e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Request method failure captured: Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd HTTP/1.1 Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601nPjLcmPV0vVg2FNKyAsUUje18RWIG_TxIfWC210jnaphASZrRhZyq9Y_SDchjVsQCYWSIYUoM5T9CtXKQ_J1Fh7Tjbxe-nlzSYrFMa_gd3dtSn8J6vs-YriYCapLoJ7GeQWUpW8try5lu_qo4lbCzvyB9WeIJv208TzJ5f7iZnds Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:49:53.606786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:49:53.608379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9124d19d48f44fe2a904a715e5db1223", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:49:53.608379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:49:53.608379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 04:49:53.608379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:49:53.608379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 04:49:53.608379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:49:53.608379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:49:53.608379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 49a7ce9a27734dc0a187d1b217206785 Aug 04 04:49:53.608379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 04:49:53.608379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 04:49:53.608379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 04:49:53.608379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '6dbf781e-8aba-4088-8d3e-037ef7c8acbd'} Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:49:53.609210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 04:49:53.610494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:49:53.611577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4c71c0db-c643-4d20-b2bc-92f6ad47632e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Returning 404 to user: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:49:53.611577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4c71c0db-c643-4d20-b2bc-92f6ad47632e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 404 len: 111 microversion: 2.1 time: 0.031826 Aug 04 04:49:53.611577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 616/1222] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:53 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:49:53.617348 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-40d72072-df57-4eb1-8610-4e1e68b59c33 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '.version_select at 0x7fc9421d1d30>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:53.638614 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-40d72072-df57-4eb1-8610-4e1e68b59c33 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1287708061" status: 202 len: 0 microversion: 2.1 time: 0.025264 Aug 04 04:49:53.639162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 607/1223] 10.222.0.47 () {58 vars in 1221 bytes} [Thu Aug 4 04:49:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1287708061 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:49:54.035977 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-38f7a47f-e253-48c8-aad6-70d40ff3d1d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:54.038184 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-38f7a47f-e253-48c8-aad6-70d40ff3d1d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:54.044572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-38f7a47f-e253-48c8-aad6-70d40ff3d1d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:54.045019 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-38f7a47f-e253-48c8-aad6-70d40ff3d1d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:54.045816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-38f7a47f-e253-48c8-aad6-70d40ff3d1d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:54.046264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-38f7a47f-e253-48c8-aad6-70d40ff3d1d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:54.124275 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-38f7a47f-e253-48c8-aad6-70d40ff3d1d3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "POST /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/action" status: 200 len: 82346 microversion: 2.1 time: 0.092199 Aug 04 04:49:54.129969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 617/1224] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:49:54 2022] POST /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/action => generated 82346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:49:54.139668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e2ad15e3-1b7a-4362-ab9c-722a3fd8c539 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:54.140060 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e2ad15e3-1b7a-4362-ab9c-722a3fd8c539 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:54.146740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e2ad15e3-1b7a-4362-ab9c-722a3fd8c539 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:54.147184 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e2ad15e3-1b7a-4362-ab9c-722a3fd8c539 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:54.147953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e2ad15e3-1b7a-4362-ab9c-722a3fd8c539 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:54.148393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e2ad15e3-1b7a-4362-ab9c-722a3fd8c539 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:54.233526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-e2ad15e3-1b7a-4362-ab9c-722a3fd8c539 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lazy-loading 'services' on Instance uuid af1762cb-4b08-41db-8302-59f56c67370a {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 04:49:54.239085 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:54.293958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-e2ad15e3-1b7a-4362-ab9c-722a3fd8c539 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76a929b5-d374-4324-b5c4-af1e9b9308af) Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e2ad15e3-1b7a-4362-ab9c-722a3fd8c539 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Request method failure captured: Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: DELETE /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments/294cbad6-59c9-4cdc-abda-2a60a0e77e44 HTTP/1.1 Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi603O-MfQb62xa8P7piHd9bpboGW7AL-QUXKffcL9qMnbc96Dt_yy1FMg4INQ8vuNOsHPG7wTrdEvMDTUoKA_gzs_rChkAqiBQzzBE7mPJ7v_-BKeWbk1q_XBQjA1bGjYMPyw4eMf5hfT_u023MjkvmiDqud8M1k1Ama2x_Is1jyIfdI Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: bd7fc43776684ea99eb660966ed97695 Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-TestMinimumBasicScenario-2001821501 Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 04:49:54.296695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 04:49:54.298208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bd7fc43776684ea99eb660966ed97695"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd7fc43776684ea99eb660966ed97695"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bd7fc43776684ea99eb660966ed97695", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd7fc43776684ea99eb660966ed97695"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:49:54.298208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-TestMinimumBasicScenario-2001821501 Aug 04 04:49:54.298208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: bd7fc43776684ea99eb660966ed97695 Aug 04 04:49:54.298208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2001821501 Aug 04 04:49:54.298208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-TestMinimumBasicScenario-2001821501-project Aug 04 04:49:54.298208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 04:49:54.298208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 04:49:54.298208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 2949f24248034487ada1e11bc9a9e4d7 Aug 04 04:49:54.298208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-TestMinimumBasicScenario-2001821501-project Aug 04 04:49:54.298208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76a929b5-d374-4324-b5c4-af1e9b9308af) Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'server_id': 'af1762cb-4b08-41db-8302-59f56c67370a', 'id': '294cbad6-59c9-4cdc-abda-2a60a0e77e44'} Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 04 04:49:54.298873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76a929b5-d374-4324-b5c4-af1e9b9308af) Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 04:49:54.299955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76a929b5-d374-4324-b5c4-af1e9b9308af) Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:54.302219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76a929b5-d374-4324-b5c4-af1e9b9308af) Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:54.303408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76a929b5-d374-4324-b5c4-af1e9b9308af) Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76a929b5-d374-4324-b5c4-af1e9b9308af) Aug 04 04:49:54.304793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:49:54.306510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e2ad15e3-1b7a-4362-ab9c-722a3fd8c539 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-76a929b5-d374-4324-b5c4-af1e9b9308af) {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:49:54.306510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e2ad15e3-1b7a-4362-ab9c-722a3fd8c539 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "DELETE /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments/294cbad6-59c9-4cdc-abda-2a60a0e77e44" status: 400 len: 269 microversion: 2.1 time: 0.166686 Aug 04 04:49:54.306510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 608/1225] 10.222.0.47 () {58 vars in 1416 bytes} [Thu Aug 4 04:49:54 2022] DELETE /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a/os-volume_attachments/294cbad6-59c9-4cdc-abda-2a60a0e77e44 => generated 269 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 04:49:54.314653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a1638d49-38c6-4a20-ab1c-8d3b8aad2ec4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:54.318372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a1638d49-38c6-4a20-ab1c-8d3b8aad2ec4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:54.325772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1638d49-38c6-4a20-ab1c-8d3b8aad2ec4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:54.326651 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1638d49-38c6-4a20-ab1c-8d3b8aad2ec4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:54.327457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1638d49-38c6-4a20-ab1c-8d3b8aad2ec4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:54.327895 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a1638d49-38c6-4a20-ab1c-8d3b8aad2ec4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:54.365152 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a1638d49-38c6-4a20-ab1c-8d3b8aad2ec4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054570 Aug 04 04:49:54.365993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 618/1226] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:54 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:54.559211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7c6f0c4b-eb78-43e8-8605-da8e00108a36 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Action: 'create', calling method: .version_select at 0x7fc9420ec5e0>, body: {"keypair": {"name": "tempest-keypair-94887190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQVdeDDRoY45sQ4qvWSNbaVPmdF7U6VBNpJsePb+nBS6tzG06ivCcs0Qy5aw3VakIj6p9CaBENTnVcVz2oV3lr1P8Dk+8zT7d7gmfa7tzucREHQvHK3+nxiRJEcL83P0w=="}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:54.575155 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-7c6f0c4b-eb78-43e8-8605-da8e00108a36 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for project 9124d19d48f44fe2a904a715e5db1223. Resources: {'key_pairs'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:49:54.579056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-7c6f0c4b-eb78-43e8-8605-da8e00108a36 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for user 49a7ce9a27734dc0a187d1b217206785 and project 9124d19d48f44fe2a904a715e5db1223. Resources: {'key_pairs'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:49:54.602387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7c6f0c4b-eb78-43e8-8605-da8e00108a36 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.047061 Aug 04 04:49:54.602972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 609/1227] 10.222.0.47 () {60 vars in 1159 bytes} [Thu Aug 4 04:49:54 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:55.377648 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c3345b77-b3ea-4c0d-9d9b-4de7c37c89e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:55.380591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c3345b77-b3ea-4c0d-9d9b-4de7c37c89e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:55.387289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c3345b77-b3ea-4c0d-9d9b-4de7c37c89e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:55.387949 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c3345b77-b3ea-4c0d-9d9b-4de7c37c89e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:55.389824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c3345b77-b3ea-4c0d-9d9b-4de7c37c89e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:55.390324 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c3345b77-b3ea-4c0d-9d9b-4de7c37c89e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:55.428490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c3345b77-b3ea-4c0d-9d9b-4de7c37c89e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054902 Aug 04 04:49:55.429427 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 619/1228] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:55 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:55.862324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1210889829", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67ecd182-cac3-46ef-97d0-ee767463d615"}], "security_groups": [{"name": "tempest-securitygroup--548742130"}], "key_name": "tempest-keypair-94887190", "user_data": "}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:55.967718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] validate_networks() for [('67ecd182-cac3-46ef-97d0-ee767463d615', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 04:49:56.386677 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 04:49:56.387101 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 04:49:56.387571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 04:49:56.387978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 04:49:56.388390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 04:49:56.397978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:56.398432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:56.399230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:56.399670 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:56.416884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for project 9124d19d48f44fe2a904a715e5db1223. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 04:49:56.420832 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Getting quotas for user 49a7ce9a27734dc0a187d1b217206785 and project 9124d19d48f44fe2a904a715e5db1223. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 04:49:56.431857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 04:49:56.434126 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 04:49:56.440415 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-28481213-d352-48d5-a345-e09d0b921466 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:56.442671 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-28481213-d352-48d5-a345-e09d0b921466 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:56.449409 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-28481213-d352-48d5-a345-e09d0b921466 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:56.449887 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-28481213-d352-48d5-a345-e09d0b921466 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:56.450650 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-28481213-d352-48d5-a345-e09d0b921466 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:56.451080 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-28481213-d352-48d5-a345-e09d0b921466 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:56.455134 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:56.482770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e080d464-4e77-44a1-90f7-56f5d8c99e8f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.625276 Aug 04 04:49:56.483646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 610/1229] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 04:49:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 04:49:56.488188 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-28481213-d352-48d5-a345-e09d0b921466 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051229 Aug 04 04:49:56.494179 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 620/1230] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:56 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:49:56.496258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fd4c51de-0599-480d-8050-f885341fe213 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:56.496866 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fd4c51de-0599-480d-8050-f885341fe213 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:56.559037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-fd4c51de-0599-480d-8050-f885341fe213 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:56.573071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fd4c51de-0599-480d-8050-f885341fe213 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 200 len: 1240 microversion: 2.1 time: 0.080544 Aug 04 04:49:56.573648 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 611/1231] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:56 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:49:57.515359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-40dbdedf-50c4-48a5-9ad1-d7600a8b46de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:57.518649 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-40dbdedf-50c4-48a5-9ad1-d7600a8b46de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:57.526824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-40dbdedf-50c4-48a5-9ad1-d7600a8b46de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:57.527355 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-40dbdedf-50c4-48a5-9ad1-d7600a8b46de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:57.528370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-40dbdedf-50c4-48a5-9ad1-d7600a8b46de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:57.528849 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-40dbdedf-50c4-48a5-9ad1-d7600a8b46de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:57.560186 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-40dbdedf-50c4-48a5-9ad1-d7600a8b46de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063355 Aug 04 04:49:57.561057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 621/1232] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:57 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:57.594890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8542ad1c-7774-4bdb-8f65-8c6730534dce tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:57.596329 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8542ad1c-7774-4bdb-8f65-8c6730534dce tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:57.604924 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8542ad1c-7774-4bdb-8f65-8c6730534dce tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:57.605518 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8542ad1c-7774-4bdb-8f65-8c6730534dce tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:57.606840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8542ad1c-7774-4bdb-8f65-8c6730534dce tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:57.607680 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8542ad1c-7774-4bdb-8f65-8c6730534dce tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:57.695856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8542ad1c-7774-4bdb-8f65-8c6730534dce tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:57.703407 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8542ad1c-7774-4bdb-8f65-8c6730534dce tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 200 len: 1298 microversion: 2.1 time: 0.113434 Aug 04 04:49:57.703963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 612/1233] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:57 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:58.572474 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5af6a1c3-979a-4efe-a3eb-dbb8302a93e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:58.574842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5af6a1c3-979a-4efe-a3eb-dbb8302a93e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:58.581078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5af6a1c3-979a-4efe-a3eb-dbb8302a93e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:58.582129 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5af6a1c3-979a-4efe-a3eb-dbb8302a93e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:58.582909 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5af6a1c3-979a-4efe-a3eb-dbb8302a93e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:58.583346 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5af6a1c3-979a-4efe-a3eb-dbb8302a93e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:58.614758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5af6a1c3-979a-4efe-a3eb-dbb8302a93e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046227 Aug 04 04:49:58.615330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 622/1234] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:58 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:58.726029 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5bd99eb2-d399-4fa2-bd80-7d1c52754fb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:58.726650 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5bd99eb2-d399-4fa2-bd80-7d1c52754fb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:58.733237 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5bd99eb2-d399-4fa2-bd80-7d1c52754fb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:58.733746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5bd99eb2-d399-4fa2-bd80-7d1c52754fb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:58.734522 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5bd99eb2-d399-4fa2-bd80-7d1c52754fb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:58.734959 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5bd99eb2-d399-4fa2-bd80-7d1c52754fb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:58.855910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-53b0ec73-707b-4c00-82ea-e1e1ab770bad req-0d2254ab-9963-4937-b10e-cafb4faa67ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c8e2da-dd45-499e-9704-5a6e5d507640", "tag": "3399152a-466f-40e5-afee-45921e9ea5de"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:49:58.866367 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-53b0ec73-707b-4c00-82ea-e1e1ab770bad req-0d2254ab-9963-4937-b10e-cafb4faa67ee service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:58.867113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-53b0ec73-707b-4c00-82ea-e1e1ab770bad req-0d2254ab-9963-4937-b10e-cafb4faa67ee service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:58.880325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-53b0ec73-707b-4c00-82ea-e1e1ab770bad req-0d2254ab-9963-4937-b10e-cafb4faa67ee service nova] Creating event network-changed:3399152a-466f-40e5-afee-45921e9ea5de for instance 47c8e2da-dd45-499e-9704-5a6e5d507640 on hv-cinder-85127 Aug 04 04:49:58.886647 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5bd99eb2-d399-4fa2-bd80-7d1c52754fb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:49:58.886842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-53b0ec73-707b-4c00-82ea-e1e1ab770bad req-0d2254ab-9963-4937-b10e-cafb4faa67ee service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034838 Aug 04 04:49:58.887709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 623/1235] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:49:58.895656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5bd99eb2-d399-4fa2-bd80-7d1c52754fb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 200 len: 1365 microversion: 2.1 time: 0.174503 Aug 04 04:49:58.896311 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 613/1236] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:58 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:49:59.631564 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dd7cda0a-2b06-47a2-ba3b-8557228db6a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:59.633810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dd7cda0a-2b06-47a2-ba3b-8557228db6a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:59.639991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd7cda0a-2b06-47a2-ba3b-8557228db6a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:59.640448 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd7cda0a-2b06-47a2-ba3b-8557228db6a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:59.641212 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd7cda0a-2b06-47a2-ba3b-8557228db6a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:59.641680 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd7cda0a-2b06-47a2-ba3b-8557228db6a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:59.670755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dd7cda0a-2b06-47a2-ba3b-8557228db6a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046145 Aug 04 04:49:59.671312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 624/1237] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:49:59 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:49:59.916823 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c3de54e4-eedf-4301-aff1-49bb92c3dc09 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:49:59.917437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c3de54e4-eedf-4301-aff1-49bb92c3dc09 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:49:59.924169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3de54e4-eedf-4301-aff1-49bb92c3dc09 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:59.924620 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3de54e4-eedf-4301-aff1-49bb92c3dc09 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:49:59.926163 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3de54e4-eedf-4301-aff1-49bb92c3dc09 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:49:59.926772 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3de54e4-eedf-4301-aff1-49bb92c3dc09 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:00.055586 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c3de54e4-eedf-4301-aff1-49bb92c3dc09 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:00.063146 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c3de54e4-eedf-4301-aff1-49bb92c3dc09 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 200 len: 1365 microversion: 2.1 time: 0.150396 Aug 04 04:50:00.063779 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 614/1238] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:49:59 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:00.683290 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d3ce055c-53a6-4280-b971-513d7f52bb9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:00.685418 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d3ce055c-53a6-4280-b971-513d7f52bb9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:00.692697 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3ce055c-53a6-4280-b971-513d7f52bb9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:00.693148 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3ce055c-53a6-4280-b971-513d7f52bb9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:00.693956 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3ce055c-53a6-4280-b971-513d7f52bb9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:00.694391 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3ce055c-53a6-4280-b971-513d7f52bb9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:00.723967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d3ce055c-53a6-4280-b971-513d7f52bb9e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044675 Aug 04 04:50:00.724534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 625/1239] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:00 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:01.083272 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5b015c62-7a73-4530-aca1-e814da364576 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:01.083891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5b015c62-7a73-4530-aca1-e814da364576 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:01.090630 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b015c62-7a73-4530-aca1-e814da364576 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:01.090994 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b015c62-7a73-4530-aca1-e814da364576 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:01.091755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b015c62-7a73-4530-aca1-e814da364576 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:01.092186 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b015c62-7a73-4530-aca1-e814da364576 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:01.224670 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5b015c62-7a73-4530-aca1-e814da364576 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:01.231999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5b015c62-7a73-4530-aca1-e814da364576 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 200 len: 1365 microversion: 2.1 time: 0.152748 Aug 04 04:50:01.232554 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 615/1240] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:01 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:01.736074 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bd31a242-24e7-43e9-bf01-9ce6d8cce4fb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:01.738850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bd31a242-24e7-43e9-bf01-9ce6d8cce4fb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:01.745494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd31a242-24e7-43e9-bf01-9ce6d8cce4fb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:01.746093 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd31a242-24e7-43e9-bf01-9ce6d8cce4fb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:01.746861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd31a242-24e7-43e9-bf01-9ce6d8cce4fb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:01.747304 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd31a242-24e7-43e9-bf01-9ce6d8cce4fb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:01.776181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bd31a242-24e7-43e9-bf01-9ce6d8cce4fb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044058 Aug 04 04:50:01.776729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 626/1241] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:01 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:02.252158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6476b2ca-c560-4ee3-9a3e-fd982e235425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:02.252790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6476b2ca-c560-4ee3-9a3e-fd982e235425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:02.259444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6476b2ca-c560-4ee3-9a3e-fd982e235425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:02.259891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6476b2ca-c560-4ee3-9a3e-fd982e235425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:02.260736 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6476b2ca-c560-4ee3-9a3e-fd982e235425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:02.261170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6476b2ca-c560-4ee3-9a3e-fd982e235425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:02.395963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6476b2ca-c560-4ee3-9a3e-fd982e235425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:02.403306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6476b2ca-c560-4ee3-9a3e-fd982e235425 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 200 len: 1365 microversion: 2.1 time: 0.154976 Aug 04 04:50:02.403864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 616/1242] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:02 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:02.788902 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-72ff9697-8047-47a1-b588-0c50f04ba39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:02.791500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-72ff9697-8047-47a1-b588-0c50f04ba39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:02.798242 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72ff9697-8047-47a1-b588-0c50f04ba39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:02.798692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72ff9697-8047-47a1-b588-0c50f04ba39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:02.799447 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72ff9697-8047-47a1-b588-0c50f04ba39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:02.799878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72ff9697-8047-47a1-b588-0c50f04ba39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:02.829224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-72ff9697-8047-47a1-b588-0c50f04ba39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Aug 04 04:50:02.829804 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 627/1243] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:02 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:03.424197 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-84ee63b5-4c5a-4181-afc2-77075636e2c4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:03.424841 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-84ee63b5-4c5a-4181-afc2-77075636e2c4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:03.432076 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-84ee63b5-4c5a-4181-afc2-77075636e2c4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:03.432530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-84ee63b5-4c5a-4181-afc2-77075636e2c4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:03.433344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-84ee63b5-4c5a-4181-afc2-77075636e2c4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:03.433761 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-84ee63b5-4c5a-4181-afc2-77075636e2c4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:03.572153 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-84ee63b5-4c5a-4181-afc2-77075636e2c4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:03.579823 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-84ee63b5-4c5a-4181-afc2-77075636e2c4 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 200 len: 1365 microversion: 2.1 time: 0.159474 Aug 04 04:50:03.580381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 617/1244] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:03 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:03.692557 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-cb986f0d-9554-4c1c-9502-55283a2fd039 req-998893e2-cbb0-4b6b-8c79-70c0fe2c62d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c8e2da-dd45-499e-9704-5a6e5d507640", "name": "network-vif-plugged", "status": "completed", "tag": "3399152a-466f-40e5-afee-45921e9ea5de"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:03.706966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-cb986f0d-9554-4c1c-9502-55283a2fd039 req-998893e2-cbb0-4b6b-8c79-70c0fe2c62d1 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:03.707473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-cb986f0d-9554-4c1c-9502-55283a2fd039 req-998893e2-cbb0-4b6b-8c79-70c0fe2c62d1 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:03.718258 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-cb986f0d-9554-4c1c-9502-55283a2fd039 req-998893e2-cbb0-4b6b-8c79-70c0fe2c62d1 service nova] Creating event network-vif-plugged:3399152a-466f-40e5-afee-45921e9ea5de for instance 47c8e2da-dd45-499e-9704-5a6e5d507640 on hv-cinder-85127 Aug 04 04:50:03.724035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-cb986f0d-9554-4c1c-9502-55283a2fd039 req-998893e2-cbb0-4b6b-8c79-70c0fe2c62d1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094584 Aug 04 04:50:03.724609 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 628/1245] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:03.842246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-04a74f42-f072-4173-bd35-634bce26195b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:03.844443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-04a74f42-f072-4173-bd35-634bce26195b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:03.851385 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-04a74f42-f072-4173-bd35-634bce26195b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:03.851837 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-04a74f42-f072-4173-bd35-634bce26195b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:03.852602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-04a74f42-f072-4173-bd35-634bce26195b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:03.853040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-04a74f42-f072-4173-bd35-634bce26195b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:03.883514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-04a74f42-f072-4173-bd35-634bce26195b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 Aug 04 04:50:03.884084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 618/1246] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:03 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:04.601477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-040a6f80-bbd8-42de-8c01-837949ec0b3f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:04.602229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-040a6f80-bbd8-42de-8c01-837949ec0b3f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:04.608411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-040a6f80-bbd8-42de-8c01-837949ec0b3f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:04.608855 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-040a6f80-bbd8-42de-8c01-837949ec0b3f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:04.609634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-040a6f80-bbd8-42de-8c01-837949ec0b3f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:04.610068 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-040a6f80-bbd8-42de-8c01-837949ec0b3f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:04.747074 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-040a6f80-bbd8-42de-8c01-837949ec0b3f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:04.755328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-040a6f80-bbd8-42de-8c01-837949ec0b3f tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 200 len: 1365 microversion: 2.1 time: 0.158752 Aug 04 04:50:04.755880 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 629/1247] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:04 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:04.895942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d0147138-a1a9-4d4b-ace7-93799a997a3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:04.898082 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d0147138-a1a9-4d4b-ace7-93799a997a3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:04.904242 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d0147138-a1a9-4d4b-ace7-93799a997a3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:04.904690 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d0147138-a1a9-4d4b-ace7-93799a997a3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:04.905449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d0147138-a1a9-4d4b-ace7-93799a997a3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:04.905908 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d0147138-a1a9-4d4b-ace7-93799a997a3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:04.935251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d0147138-a1a9-4d4b-ace7-93799a997a3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043451 Aug 04 04:50:04.935801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 619/1248] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:04 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:05.776191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-677e020d-ff38-40a0-a7d2-dc1f313ba55e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:05.776704 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-677e020d-ff38-40a0-a7d2-dc1f313ba55e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:05.783145 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-677e020d-ff38-40a0-a7d2-dc1f313ba55e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:05.783592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-677e020d-ff38-40a0-a7d2-dc1f313ba55e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:05.784343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-677e020d-ff38-40a0-a7d2-dc1f313ba55e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:05.784806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-677e020d-ff38-40a0-a7d2-dc1f313ba55e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:05.911162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-677e020d-ff38-40a0-a7d2-dc1f313ba55e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:50:05.918876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-677e020d-ff38-40a0-a7d2-dc1f313ba55e tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 200 len: 1556 microversion: 2.1 time: 0.146640 Aug 04 04:50:05.919433 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 630/1249] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:50:05 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:50:05.939114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a4770164-fc5a-4072-bdf1-80bf81c1d137 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:05.939600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a4770164-fc5a-4072-bdf1-80bf81c1d137 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:05.946784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-774e8211-2adb-498f-a214-3d4e99fad522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:05.947000 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a4770164-fc5a-4072-bdf1-80bf81c1d137 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:05.947458 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a4770164-fc5a-4072-bdf1-80bf81c1d137 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:05.948226 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a4770164-fc5a-4072-bdf1-80bf81c1d137 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:05.948703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a4770164-fc5a-4072-bdf1-80bf81c1d137 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:05.948909 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-774e8211-2adb-498f-a214-3d4e99fad522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:05.954766 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-774e8211-2adb-498f-a214-3d4e99fad522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:05.955207 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-774e8211-2adb-498f-a214-3d4e99fad522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:05.955962 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-774e8211-2adb-498f-a214-3d4e99fad522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:05.957046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-774e8211-2adb-498f-a214-3d4e99fad522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:05.985575 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-774e8211-2adb-498f-a214-3d4e99fad522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042601 Aug 04 04:50:05.986143 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 631/1250] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:05 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:06.029371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a4770164-fc5a-4072-bdf1-80bf81c1d137 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094094 Aug 04 04:50:06.029995 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 620/1251] 10.222.0.47 () {58 vars in 1275 bytes} [Thu Aug 4 04:50:05 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:06.994565 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:06.996236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=12 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:07.001444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-39977e1c-786f-4b7a-813e-96dff3f1a641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:07.004985 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-39977e1c-786f-4b7a-813e-96dff3f1a641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:07.012409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-39977e1c-786f-4b7a-813e-96dff3f1a641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:07.012935 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-39977e1c-786f-4b7a-813e-96dff3f1a641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:07.013863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-39977e1c-786f-4b7a-813e-96dff3f1a641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:07.014368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-39977e1c-786f-4b7a-813e-96dff3f1a641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:07.030822 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-6b2da8af-0514-4053-add2-e54dd5345ff6 req-1bcc3516-ac3b-4222-b133-5f2ef460e47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c8e2da-dd45-499e-9704-5a6e5d507640", "tag": "3399152a-466f-40e5-afee-45921e9ea5de"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:50:07.041572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-6b2da8af-0514-4053-add2-e54dd5345ff6 req-1bcc3516-ac3b-4222-b133-5f2ef460e47a service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:07.042026 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-6b2da8af-0514-4053-add2-e54dd5345ff6 req-1bcc3516-ac3b-4222-b133-5f2ef460e47a service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:07.059602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-6b2da8af-0514-4053-add2-e54dd5345ff6 req-1bcc3516-ac3b-4222-b133-5f2ef460e47a service nova] Creating event network-changed:3399152a-466f-40e5-afee-45921e9ea5de for instance 47c8e2da-dd45-499e-9704-5a6e5d507640 on hv-cinder-85127 Aug 04 04:50:07.059916 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-39977e1c-786f-4b7a-813e-96dff3f1a641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065729 Aug 04 04:50:07.064368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 621/1252] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:06 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:50:07.064773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-6b2da8af-0514-4053-add2-e54dd5345ff6 req-1bcc3516-ac3b-4222-b133-5f2ef460e47a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093617 Aug 04 04:50:07.065784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 632/1253] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:08.072768 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fa4d7156-3e8c-432f-b92f-ac1aa1216d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:08.075518 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fa4d7156-3e8c-432f-b92f-ac1aa1216d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:08.082455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fa4d7156-3e8c-432f-b92f-ac1aa1216d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:08.082908 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fa4d7156-3e8c-432f-b92f-ac1aa1216d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:08.083674 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fa4d7156-3e8c-432f-b92f-ac1aa1216d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:08.084111 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fa4d7156-3e8c-432f-b92f-ac1aa1216d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:08.113906 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fa4d7156-3e8c-432f-b92f-ac1aa1216d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045308 Aug 04 04:50:08.114836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 622/1254] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:08 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:09.127565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8b1477bb-9db0-40e3-96e3-58b307310bd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:09.131384 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8b1477bb-9db0-40e3-96e3-58b307310bd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:09.137503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b1477bb-9db0-40e3-96e3-58b307310bd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:09.139107 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b1477bb-9db0-40e3-96e3-58b307310bd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:09.139866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b1477bb-9db0-40e3-96e3-58b307310bd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:09.140302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b1477bb-9db0-40e3-96e3-58b307310bd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:09.176652 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8b1477bb-9db0-40e3-96e3-58b307310bd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053511 Aug 04 04:50:09.177232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 633/1255] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:09 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:10.189001 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-884d9e96-bda0-4339-b5c7-b11d5b5da7a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:10.191199 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-884d9e96-bda0-4339-b5c7-b11d5b5da7a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:10.198013 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-884d9e96-bda0-4339-b5c7-b11d5b5da7a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:10.198464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-884d9e96-bda0-4339-b5c7-b11d5b5da7a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:10.199225 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-884d9e96-bda0-4339-b5c7-b11d5b5da7a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:10.199661 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-884d9e96-bda0-4339-b5c7-b11d5b5da7a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:10.228891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-884d9e96-bda0-4339-b5c7-b11d5b5da7a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043995 Aug 04 04:50:10.229450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 623/1256] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:10 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:11.241251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-66c1c7c9-e551-458f-8ce2-091ea863faf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:11.243455 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-66c1c7c9-e551-458f-8ce2-091ea863faf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:11.249945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66c1c7c9-e551-458f-8ce2-091ea863faf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:11.250396 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66c1c7c9-e551-458f-8ce2-091ea863faf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:11.251158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66c1c7c9-e551-458f-8ce2-091ea863faf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:11.251596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66c1c7c9-e551-458f-8ce2-091ea863faf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:11.282348 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-66c1c7c9-e551-458f-8ce2-091ea863faf1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045923 Aug 04 04:50:11.282910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 634/1257] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:11 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:12.295522 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fef0d834-06c4-4cb3-beeb-075ec31fb5a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:12.297757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fef0d834-06c4-4cb3-beeb-075ec31fb5a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:12.305055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fef0d834-06c4-4cb3-beeb-075ec31fb5a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:12.305506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fef0d834-06c4-4cb3-beeb-075ec31fb5a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:12.306294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fef0d834-06c4-4cb3-beeb-075ec31fb5a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:12.306731 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fef0d834-06c4-4cb3-beeb-075ec31fb5a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:12.336748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fef0d834-06c4-4cb3-beeb-075ec31fb5a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045125 Aug 04 04:50:12.337303 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 624/1258] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:13.349418 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-32454218-f2df-4491-88e6-ff62b1bdef7a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:13.351593 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-32454218-f2df-4491-88e6-ff62b1bdef7a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:13.358023 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-32454218-f2df-4491-88e6-ff62b1bdef7a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.358468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-32454218-f2df-4491-88e6-ff62b1bdef7a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.359221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-32454218-f2df-4491-88e6-ff62b1bdef7a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:13.359651 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-32454218-f2df-4491-88e6-ff62b1bdef7a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:13.389010 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-32454218-f2df-4491-88e6-ff62b1bdef7a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Aug 04 04:50:13.389770 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 635/1259] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:13 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:14.465668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-37d3c2c0-59d2-455c-bf46-36f5bb131c44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:14.467934 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-37d3c2c0-59d2-455c-bf46-36f5bb131c44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:14.469948 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:14.476034 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37d3c2c0-59d2-455c-bf46-36f5bb131c44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.476489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37d3c2c0-59d2-455c-bf46-36f5bb131c44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.477262 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37d3c2c0-59d2-455c-bf46-36f5bb131c44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:14.477727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37d3c2c0-59d2-455c-bf46-36f5bb131c44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:14.510202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-37d3c2c0-59d2-455c-bf46-36f5bb131c44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112927 Aug 04 04:50:14.514604 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 625/1260] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:14 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:15.523570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2b613635-918e-4f3d-b238-10ceeaa3041b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:15.525259 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2b613635-918e-4f3d-b238-10ceeaa3041b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:15.532068 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b613635-918e-4f3d-b238-10ceeaa3041b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.532520 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b613635-918e-4f3d-b238-10ceeaa3041b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.533292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b613635-918e-4f3d-b238-10ceeaa3041b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:15.533761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2b613635-918e-4f3d-b238-10ceeaa3041b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:15.564853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2b613635-918e-4f3d-b238-10ceeaa3041b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046413 Aug 04 04:50:15.565410 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 636/1261] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:15 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:16.576406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-613f7f90-c2a6-4c22-8502-0534c11e379d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:16.579218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-613f7f90-c2a6-4c22-8502-0534c11e379d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:16.585988 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-613f7f90-c2a6-4c22-8502-0534c11e379d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:16.586437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-613f7f90-c2a6-4c22-8502-0534c11e379d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:16.587194 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-613f7f90-c2a6-4c22-8502-0534c11e379d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:16.587624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-613f7f90-c2a6-4c22-8502-0534c11e379d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:16.616660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-613f7f90-c2a6-4c22-8502-0534c11e379d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044297 Aug 04 04:50:16.617203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 626/1262] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:17.628362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3a802b56-7ad5-4af5-85c9-d8665d4c5fe1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:17.631087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3a802b56-7ad5-4af5-85c9-d8665d4c5fe1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:17.633597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:17.639132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3a802b56-7ad5-4af5-85c9-d8665d4c5fe1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:17.639583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3a802b56-7ad5-4af5-85c9-d8665d4c5fe1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:17.640411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3a802b56-7ad5-4af5-85c9-d8665d4c5fe1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:17.640847 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3a802b56-7ad5-4af5-85c9-d8665d4c5fe1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:17.671481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3a802b56-7ad5-4af5-85c9-d8665d4c5fe1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047113 Aug 04 04:50:17.672034 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 637/1263] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:17 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:18.685743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7738f3ae-8208-4055-adfe-9bbbb177792c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:18.688302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7738f3ae-8208-4055-adfe-9bbbb177792c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:18.696596 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7738f3ae-8208-4055-adfe-9bbbb177792c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:18.697042 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7738f3ae-8208-4055-adfe-9bbbb177792c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:18.697840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7738f3ae-8208-4055-adfe-9bbbb177792c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:18.698275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7738f3ae-8208-4055-adfe-9bbbb177792c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:18.729486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7738f3ae-8208-4055-adfe-9bbbb177792c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048738 Aug 04 04:50:18.730057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 627/1264] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:18 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:19.742483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f46c9f2b-ed56-4ca7-90b1-d702968b21ab tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:19.745614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f46c9f2b-ed56-4ca7-90b1-d702968b21ab tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:19.752069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f46c9f2b-ed56-4ca7-90b1-d702968b21ab tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:19.752511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f46c9f2b-ed56-4ca7-90b1-d702968b21ab tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:19.753263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f46c9f2b-ed56-4ca7-90b1-d702968b21ab tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:19.753816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f46c9f2b-ed56-4ca7-90b1-d702968b21ab tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:19.778435 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:19.783264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f46c9f2b-ed56-4ca7-90b1-d702968b21ab tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045595 Aug 04 04:50:19.783817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 638/1265] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:20.795740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e28aeeb7-3537-476b-bdbe-eb9a8c39f00e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:20.798003 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e28aeeb7-3537-476b-bdbe-eb9a8c39f00e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:20.804803 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e28aeeb7-3537-476b-bdbe-eb9a8c39f00e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:20.805251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e28aeeb7-3537-476b-bdbe-eb9a8c39f00e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:20.806034 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e28aeeb7-3537-476b-bdbe-eb9a8c39f00e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:20.806468 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e28aeeb7-3537-476b-bdbe-eb9a8c39f00e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:20.823117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:20.837998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e28aeeb7-3537-476b-bdbe-eb9a8c39f00e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046088 Aug 04 04:50:20.838540 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 628/1266] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:21.850779 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8d3ca553-d265-4a08-accb-0e8097d3bf47 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:21.852914 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8d3ca553-d265-4a08-accb-0e8097d3bf47 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:21.859295 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d3ca553-d265-4a08-accb-0e8097d3bf47 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:21.859744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d3ca553-d265-4a08-accb-0e8097d3bf47 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:21.860505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d3ca553-d265-4a08-accb-0e8097d3bf47 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:21.860937 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d3ca553-d265-4a08-accb-0e8097d3bf47 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:21.890076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8d3ca553-d265-4a08-accb-0e8097d3bf47 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043502 Aug 04 04:50:21.890622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 639/1267] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:21 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:22.902268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6537f213-22d7-4291-bbf0-910ba539ebc6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:22.904384 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6537f213-22d7-4291-bbf0-910ba539ebc6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:22.910810 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6537f213-22d7-4291-bbf0-910ba539ebc6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:22.911254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6537f213-22d7-4291-bbf0-910ba539ebc6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:22.912006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6537f213-22d7-4291-bbf0-910ba539ebc6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:22.912438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6537f213-22d7-4291-bbf0-910ba539ebc6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:22.940277 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6537f213-22d7-4291-bbf0-910ba539ebc6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041926 Aug 04 04:50:22.940818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 629/1268] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:22 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:23.952362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-677ed869-4cce-4753-8b2a-e602076536a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:23.954569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-677ed869-4cce-4753-8b2a-e602076536a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:23.961042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-677ed869-4cce-4753-8b2a-e602076536a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:23.961569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-677ed869-4cce-4753-8b2a-e602076536a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:23.962500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-677ed869-4cce-4753-8b2a-e602076536a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:23.963015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-677ed869-4cce-4753-8b2a-e602076536a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:23.993874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-677ed869-4cce-4753-8b2a-e602076536a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Aug 04 04:50:23.994432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 640/1269] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:23 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:25.006337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a82cdce1-5df1-4a7f-b122-c597bae1a098 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:25.008470 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a82cdce1-5df1-4a7f-b122-c597bae1a098 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:25.014949 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a82cdce1-5df1-4a7f-b122-c597bae1a098 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:25.015404 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a82cdce1-5df1-4a7f-b122-c597bae1a098 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:25.016169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a82cdce1-5df1-4a7f-b122-c597bae1a098 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:25.016611 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a82cdce1-5df1-4a7f-b122-c597bae1a098 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:25.045371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a82cdce1-5df1-4a7f-b122-c597bae1a098 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043579 Aug 04 04:50:25.045936 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 630/1270] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:25 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:26.056994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0bd42bd0-dcbf-4d72-bed8-ee729ca71c1a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:26.059170 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0bd42bd0-dcbf-4d72-bed8-ee729ca71c1a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:26.065649 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0bd42bd0-dcbf-4d72-bed8-ee729ca71c1a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:26.066103 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0bd42bd0-dcbf-4d72-bed8-ee729ca71c1a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:26.067808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0bd42bd0-dcbf-4d72-bed8-ee729ca71c1a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:26.068245 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0bd42bd0-dcbf-4d72-bed8-ee729ca71c1a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:26.099138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0bd42bd0-dcbf-4d72-bed8-ee729ca71c1a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046033 Aug 04 04:50:26.099681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 641/1271] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:26 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:50:27.111293 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b9dcabf2-e488-4839-9258-4f9098dd41a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:27.113601 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b9dcabf2-e488-4839-9258-4f9098dd41a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:27.120859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b9dcabf2-e488-4839-9258-4f9098dd41a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:27.121314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b9dcabf2-e488-4839-9258-4f9098dd41a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:27.122114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b9dcabf2-e488-4839-9258-4f9098dd41a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:27.122552 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b9dcabf2-e488-4839-9258-4f9098dd41a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:27.156382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b9dcabf2-e488-4839-9258-4f9098dd41a2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048973 Aug 04 04:50:27.156941 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 631/1272] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:27 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:28.169535 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e6523012-e1bb-443b-b9fc-bf7e1aaf7f0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:28.171700 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e6523012-e1bb-443b-b9fc-bf7e1aaf7f0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:28.179320 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e6523012-e1bb-443b-b9fc-bf7e1aaf7f0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:28.179771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e6523012-e1bb-443b-b9fc-bf7e1aaf7f0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:28.180529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e6523012-e1bb-443b-b9fc-bf7e1aaf7f0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:28.180966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e6523012-e1bb-443b-b9fc-bf7e1aaf7f0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:28.209905 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e6523012-e1bb-443b-b9fc-bf7e1aaf7f0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044483 Aug 04 04:50:28.210449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 642/1273] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:28 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:29.222077 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7fdd194c-4943-4258-8022-fb545cf753c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:29.225048 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7fdd194c-4943-4258-8022-fb545cf753c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:29.231572 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7fdd194c-4943-4258-8022-fb545cf753c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:29.232030 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7fdd194c-4943-4258-8022-fb545cf753c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:29.232795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7fdd194c-4943-4258-8022-fb545cf753c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:29.233251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7fdd194c-4943-4258-8022-fb545cf753c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:29.262932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7fdd194c-4943-4258-8022-fb545cf753c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Aug 04 04:50:29.263508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 632/1274] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:29 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:30.275238 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3dcc5ad8-7df5-452e-98be-fe5b6149db5f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:30.277399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3dcc5ad8-7df5-452e-98be-fe5b6149db5f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:30.283859 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3dcc5ad8-7df5-452e-98be-fe5b6149db5f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:30.284306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3dcc5ad8-7df5-452e-98be-fe5b6149db5f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:30.285062 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3dcc5ad8-7df5-452e-98be-fe5b6149db5f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:30.285493 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3dcc5ad8-7df5-452e-98be-fe5b6149db5f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:30.314710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3dcc5ad8-7df5-452e-98be-fe5b6149db5f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043372 Aug 04 04:50:30.315252 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 643/1275] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:30 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:50:31.326869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0e1310ea-faa1-46aa-8894-3a1da0508160 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:31.328921 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0e1310ea-faa1-46aa-8894-3a1da0508160 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:31.336069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e1310ea-faa1-46aa-8894-3a1da0508160 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:31.336515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e1310ea-faa1-46aa-8894-3a1da0508160 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:31.337451 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e1310ea-faa1-46aa-8894-3a1da0508160 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:31.337912 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e1310ea-faa1-46aa-8894-3a1da0508160 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:31.367324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0e1310ea-faa1-46aa-8894-3a1da0508160 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Aug 04 04:50:31.368351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 633/1276] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:31 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:32.380293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3b232463-273b-44e2-a317-4306f0149144 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:32.382449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3b232463-273b-44e2-a317-4306f0149144 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:32.388796 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3b232463-273b-44e2-a317-4306f0149144 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:32.389240 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3b232463-273b-44e2-a317-4306f0149144 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:32.390024 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3b232463-273b-44e2-a317-4306f0149144 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:32.390460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3b232463-273b-44e2-a317-4306f0149144 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:32.419615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3b232463-273b-44e2-a317-4306f0149144 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043269 Aug 04 04:50:32.420152 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 644/1277] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:32 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:33.431683 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-35f81b55-3852-41dc-b59a-07b35398d162 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:33.433836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-35f81b55-3852-41dc-b59a-07b35398d162 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:33.440208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-35f81b55-3852-41dc-b59a-07b35398d162 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:33.440656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-35f81b55-3852-41dc-b59a-07b35398d162 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:33.441459 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-35f81b55-3852-41dc-b59a-07b35398d162 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:33.441918 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-35f81b55-3852-41dc-b59a-07b35398d162 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:33.470798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-35f81b55-3852-41dc-b59a-07b35398d162 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043074 Aug 04 04:50:33.471335 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 634/1278] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:33 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:34.483903 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0570bbd6-99de-43fe-aa87-a550f2d19a60 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:34.486088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0570bbd6-99de-43fe-aa87-a550f2d19a60 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:34.492880 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0570bbd6-99de-43fe-aa87-a550f2d19a60 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:34.493338 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0570bbd6-99de-43fe-aa87-a550f2d19a60 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:34.494145 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0570bbd6-99de-43fe-aa87-a550f2d19a60 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:34.494588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0570bbd6-99de-43fe-aa87-a550f2d19a60 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:34.525379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0570bbd6-99de-43fe-aa87-a550f2d19a60 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045362 Aug 04 04:50:34.526247 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 645/1279] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:34 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:35.538657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0c55aa80-50a1-4a2b-b19e-23743ccc004c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:35.540782 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0c55aa80-50a1-4a2b-b19e-23743ccc004c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:35.547049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c55aa80-50a1-4a2b-b19e-23743ccc004c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:35.547504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c55aa80-50a1-4a2b-b19e-23743ccc004c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:35.548267 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c55aa80-50a1-4a2b-b19e-23743ccc004c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:35.548706 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c55aa80-50a1-4a2b-b19e-23743ccc004c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:35.577983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0c55aa80-50a1-4a2b-b19e-23743ccc004c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044406 Aug 04 04:50:35.578525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 635/1280] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:35 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:50:36.590787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5758e711-5781-4e08-bd3d-185dab94c5a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:36.592964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5758e711-5781-4e08-bd3d-185dab94c5a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:36.600145 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5758e711-5781-4e08-bd3d-185dab94c5a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:36.600602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5758e711-5781-4e08-bd3d-185dab94c5a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:36.601445 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5758e711-5781-4e08-bd3d-185dab94c5a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:36.602045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5758e711-5781-4e08-bd3d-185dab94c5a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:36.633764 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5758e711-5781-4e08-bd3d-185dab94c5a5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046836 Aug 04 04:50:36.634379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 646/1281] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:36 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:50:37.646692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a005d592-eb81-45ae-b96e-c7d58c598938 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:37.648911 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a005d592-eb81-45ae-b96e-c7d58c598938 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:37.655356 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a005d592-eb81-45ae-b96e-c7d58c598938 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:37.655804 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a005d592-eb81-45ae-b96e-c7d58c598938 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:37.656566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a005d592-eb81-45ae-b96e-c7d58c598938 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:37.656996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a005d592-eb81-45ae-b96e-c7d58c598938 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:37.685813 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a005d592-eb81-45ae-b96e-c7d58c598938 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Aug 04 04:50:37.686354 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 636/1282] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:37 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:38.698301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bd76722c-9f9e-4853-b718-6c4e387c9d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:38.700467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bd76722c-9f9e-4853-b718-6c4e387c9d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:38.707571 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd76722c-9f9e-4853-b718-6c4e387c9d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:38.708015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd76722c-9f9e-4853-b718-6c4e387c9d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:38.708776 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd76722c-9f9e-4853-b718-6c4e387c9d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:38.709208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd76722c-9f9e-4853-b718-6c4e387c9d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:38.738476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bd76722c-9f9e-4853-b718-6c4e387c9d88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044089 Aug 04 04:50:38.739028 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 647/1283] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:38 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:39.750148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-940fa917-95e4-4b6e-903a-0961a7e34587 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:39.752312 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-940fa917-95e4-4b6e-903a-0961a7e34587 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:39.759567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-940fa917-95e4-4b6e-903a-0961a7e34587 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:39.760315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-940fa917-95e4-4b6e-903a-0961a7e34587 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:39.761141 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-940fa917-95e4-4b6e-903a-0961a7e34587 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:39.761829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-940fa917-95e4-4b6e-903a-0961a7e34587 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:39.791825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-940fa917-95e4-4b6e-903a-0961a7e34587 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Aug 04 04:50:39.792371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 637/1284] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:39 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:40.805932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e2a7bae3-9af7-4191-8a03-6b86275c7e66 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:40.808078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e2a7bae3-9af7-4191-8a03-6b86275c7e66 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:40.814126 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e2a7bae3-9af7-4191-8a03-6b86275c7e66 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:40.814583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e2a7bae3-9af7-4191-8a03-6b86275c7e66 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:40.815350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e2a7bae3-9af7-4191-8a03-6b86275c7e66 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:40.815791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e2a7bae3-9af7-4191-8a03-6b86275c7e66 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:40.845773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e2a7bae3-9af7-4191-8a03-6b86275c7e66 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043964 Aug 04 04:50:40.846318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 648/1285] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:40 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:41.807856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dcd27165-3572-4405-92e6-d3b8c407c1a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:41.808366 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dcd27165-3572-4405-92e6-d3b8c407c1a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:41.814769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dcd27165-3572-4405-92e6-d3b8c407c1a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:41.815219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dcd27165-3572-4405-92e6-d3b8c407c1a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:41.815987 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dcd27165-3572-4405-92e6-d3b8c407c1a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:41.816519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dcd27165-3572-4405-92e6-d3b8c407c1a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:41.840698 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dcd27165-3572-4405-92e6-d3b8c407c1a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640/ips" status: 200 len: 151 microversion: 2.1 time: 0.036610 Aug 04 04:50:41.841265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 638/1286] 10.222.0.47 () {58 vars in 1248 bytes} [Thu Aug 4 04:50:41 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:41.858216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-75ec9f00-09da-4725-9cea-866edfe0b390 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:41.860407 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-75ec9f00-09da-4725-9cea-866edfe0b390 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:41.867641 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-75ec9f00-09da-4725-9cea-866edfe0b390 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:41.868100 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-75ec9f00-09da-4725-9cea-866edfe0b390 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:41.868876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-75ec9f00-09da-4725-9cea-866edfe0b390 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:41.869314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-75ec9f00-09da-4725-9cea-866edfe0b390 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:41.898733 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-75ec9f00-09da-4725-9cea-866edfe0b390 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044494 Aug 04 04:50:41.899512 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 649/1287] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:41 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:42.910836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ac7297ed-c409-415f-bfe4-c27bf5955fd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:42.912983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ac7297ed-c409-415f-bfe4-c27bf5955fd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:42.919750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ac7297ed-c409-415f-bfe4-c27bf5955fd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:42.920202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ac7297ed-c409-415f-bfe4-c27bf5955fd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:42.920961 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ac7297ed-c409-415f-bfe4-c27bf5955fd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:42.921400 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ac7297ed-c409-415f-bfe4-c27bf5955fd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:42.950755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ac7297ed-c409-415f-bfe4-c27bf5955fd9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044125 Aug 04 04:50:42.951292 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 639/1288] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:42 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:43.964242 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d3edd990-13dc-404c-b348-7fd0909227c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:43.966717 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d3edd990-13dc-404c-b348-7fd0909227c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:43.974177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3edd990-13dc-404c-b348-7fd0909227c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:43.974652 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3edd990-13dc-404c-b348-7fd0909227c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:43.975406 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3edd990-13dc-404c-b348-7fd0909227c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:43.975835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3edd990-13dc-404c-b348-7fd0909227c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:44.005924 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d3edd990-13dc-404c-b348-7fd0909227c3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Aug 04 04:50:44.006463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 650/1289] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:43 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:50:45.018067 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-89c1ab0a-548f-4d8b-8e56-2933533af1f2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:45.020762 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-89c1ab0a-548f-4d8b-8e56-2933533af1f2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:45.023098 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=30 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:45.028305 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89c1ab0a-548f-4d8b-8e56-2933533af1f2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:45.028759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89c1ab0a-548f-4d8b-8e56-2933533af1f2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:45.029519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89c1ab0a-548f-4d8b-8e56-2933533af1f2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:45.029983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89c1ab0a-548f-4d8b-8e56-2933533af1f2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:45.059464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-89c1ab0a-548f-4d8b-8e56-2933533af1f2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045458 Aug 04 04:50:45.060019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 640/1290] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:45 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:46.072033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-711d7026-6ba5-4f84-a7de-fda17a0145aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:46.074236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-711d7026-6ba5-4f84-a7de-fda17a0145aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:46.080634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-711d7026-6ba5-4f84-a7de-fda17a0145aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:46.081077 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-711d7026-6ba5-4f84-a7de-fda17a0145aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:46.081994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-711d7026-6ba5-4f84-a7de-fda17a0145aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:46.082482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-711d7026-6ba5-4f84-a7de-fda17a0145aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:46.111271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-711d7026-6ba5-4f84-a7de-fda17a0145aa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043175 Aug 04 04:50:46.111808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 651/1291] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:46 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:47.124202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-000f56be-4002-4aa2-97f2-bb08cb0eb7b3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:47.126381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-000f56be-4002-4aa2-97f2-bb08cb0eb7b3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:47.134024 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-000f56be-4002-4aa2-97f2-bb08cb0eb7b3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:47.134474 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-000f56be-4002-4aa2-97f2-bb08cb0eb7b3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:47.135230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-000f56be-4002-4aa2-97f2-bb08cb0eb7b3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:47.135666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-000f56be-4002-4aa2-97f2-bb08cb0eb7b3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:47.164301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-000f56be-4002-4aa2-97f2-bb08cb0eb7b3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044024 Aug 04 04:50:47.164844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 641/1292] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:47 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:48.176262 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b7017066-a196-4387-98f0-50eec0d0af88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:48.178658 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b7017066-a196-4387-98f0-50eec0d0af88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:48.180963 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=30 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:48.186530 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7017066-a196-4387-98f0-50eec0d0af88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:48.186981 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7017066-a196-4387-98f0-50eec0d0af88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:48.187748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7017066-a196-4387-98f0-50eec0d0af88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:48.188183 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7017066-a196-4387-98f0-50eec0d0af88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:48.218500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b7017066-a196-4387-98f0-50eec0d0af88 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046240 Aug 04 04:50:48.219055 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 652/1293] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:48 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:48.223264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:50:48.223500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 04:50:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:50:49.230679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0fb1397b-355c-406a-bea6-4241c14fe4a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:49.232826 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0fb1397b-355c-406a-bea6-4241c14fe4a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:49.240019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0fb1397b-355c-406a-bea6-4241c14fe4a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:49.240476 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0fb1397b-355c-406a-bea6-4241c14fe4a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:49.241248 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0fb1397b-355c-406a-bea6-4241c14fe4a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:49.241722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0fb1397b-355c-406a-bea6-4241c14fe4a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:49.269538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0fb1397b-355c-406a-bea6-4241c14fe4a1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042808 Aug 04 04:50:49.270145 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 642/1294] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:49 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:50.281748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8ea08427-cb7c-4578-a99a-8ba5a85d0ff5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:50.283930 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8ea08427-cb7c-4578-a99a-8ba5a85d0ff5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:50.290604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ea08427-cb7c-4578-a99a-8ba5a85d0ff5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:50.291061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ea08427-cb7c-4578-a99a-8ba5a85d0ff5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:50.292095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ea08427-cb7c-4578-a99a-8ba5a85d0ff5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:50.292537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8ea08427-cb7c-4578-a99a-8ba5a85d0ff5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:50.323518 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8ea08427-cb7c-4578-a99a-8ba5a85d0ff5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045777 Aug 04 04:50:50.324060 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 653/1295] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:50 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:51.336276 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-62a5d803-8b3a-43c5-b718-2d463b796a26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:51.338462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-62a5d803-8b3a-43c5-b718-2d463b796a26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:51.344967 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-62a5d803-8b3a-43c5-b718-2d463b796a26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:51.345418 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-62a5d803-8b3a-43c5-b718-2d463b796a26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:51.346228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-62a5d803-8b3a-43c5-b718-2d463b796a26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:51.346663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-62a5d803-8b3a-43c5-b718-2d463b796a26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:51.351148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=85 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:51.376238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-62a5d803-8b3a-43c5-b718-2d463b796a26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 Aug 04 04:50:51.376786 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 643/1296] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:51 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:52.388347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-249faa9c-6e52-4b17-ba12-71c5d7d01e7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:52.390523 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-249faa9c-6e52-4b17-ba12-71c5d7d01e7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:52.397147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-249faa9c-6e52-4b17-ba12-71c5d7d01e7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:52.397638 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-249faa9c-6e52-4b17-ba12-71c5d7d01e7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:52.398408 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-249faa9c-6e52-4b17-ba12-71c5d7d01e7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:52.398849 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-249faa9c-6e52-4b17-ba12-71c5d7d01e7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:52.401156 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=91 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:52.429530 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-249faa9c-6e52-4b17-ba12-71c5d7d01e7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Aug 04 04:50:52.430108 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 654/1297] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:52 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:53.441642 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-455b7e85-bd44-4bb0-9142-424e4b8f2edf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:53.444500 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-455b7e85-bd44-4bb0-9142-424e4b8f2edf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:53.450917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-455b7e85-bd44-4bb0-9142-424e4b8f2edf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:53.451363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-455b7e85-bd44-4bb0-9142-424e4b8f2edf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:53.452115 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-455b7e85-bd44-4bb0-9142-424e4b8f2edf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:53.452545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-455b7e85-bd44-4bb0-9142-424e4b8f2edf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:53.480624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-455b7e85-bd44-4bb0-9142-424e4b8f2edf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042950 Aug 04 04:50:53.481163 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 644/1298] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:53 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:54.492621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5cd4290b-b239-4e91-a560-10e92acf1c33 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:54.494788 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5cd4290b-b239-4e91-a560-10e92acf1c33 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:54.501277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5cd4290b-b239-4e91-a560-10e92acf1c33 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:54.501759 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5cd4290b-b239-4e91-a560-10e92acf1c33 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:54.502521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5cd4290b-b239-4e91-a560-10e92acf1c33 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:54.502951 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5cd4290b-b239-4e91-a560-10e92acf1c33 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:54.533405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5cd4290b-b239-4e91-a560-10e92acf1c33 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044725 Aug 04 04:50:54.533972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 655/1299] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:54 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:55.545878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-98347a45-402d-4026-a526-5e7b8d49dfdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:55.548217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-98347a45-402d-4026-a526-5e7b8d49dfdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:55.555286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-98347a45-402d-4026-a526-5e7b8d49dfdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:55.555730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-98347a45-402d-4026-a526-5e7b8d49dfdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:55.556490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-98347a45-402d-4026-a526-5e7b8d49dfdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:55.556920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-98347a45-402d-4026-a526-5e7b8d49dfdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:55.585526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-98347a45-402d-4026-a526-5e7b8d49dfdb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043994 Aug 04 04:50:55.586098 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 645/1300] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:55 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:56.598889 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f344b2f2-d4cb-484d-a3d9-e0507354ea73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:56.601398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f344b2f2-d4cb-484d-a3d9-e0507354ea73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:56.608834 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f344b2f2-d4cb-484d-a3d9-e0507354ea73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:56.609284 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f344b2f2-d4cb-484d-a3d9-e0507354ea73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:56.610082 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f344b2f2-d4cb-484d-a3d9-e0507354ea73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:56.610512 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f344b2f2-d4cb-484d-a3d9-e0507354ea73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:56.639878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f344b2f2-d4cb-484d-a3d9-e0507354ea73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045925 Aug 04 04:50:56.640423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 656/1301] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:56 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:57.652423 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-71260255-83ef-4c4c-bf8e-57a8a85dfd26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:57.654586 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-71260255-83ef-4c4c-bf8e-57a8a85dfd26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:57.661031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-71260255-83ef-4c4c-bf8e-57a8a85dfd26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:57.661474 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-71260255-83ef-4c4c-bf8e-57a8a85dfd26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:57.662267 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-71260255-83ef-4c4c-bf8e-57a8a85dfd26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:57.662696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-71260255-83ef-4c4c-bf8e-57a8a85dfd26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:57.690901 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-71260255-83ef-4c4c-bf8e-57a8a85dfd26 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042597 Aug 04 04:50:57.691433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 646/1302] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:57 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:58.542805 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:50:58.543282 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 04:50:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:50:58.703457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a0a8bf7a-8ca6-45c6-a59e-5906dc9b03ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:58.705687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a0a8bf7a-8ca6-45c6-a59e-5906dc9b03ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:58.712131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a0a8bf7a-8ca6-45c6-a59e-5906dc9b03ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:58.712576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a0a8bf7a-8ca6-45c6-a59e-5906dc9b03ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:58.713326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a0a8bf7a-8ca6-45c6-a59e-5906dc9b03ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:58.713857 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a0a8bf7a-8ca6-45c6-a59e-5906dc9b03ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:58.742923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a0a8bf7a-8ca6-45c6-a59e-5906dc9b03ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043341 Aug 04 04:50:58.743490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 657/1303] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:58 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:50:59.755800 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-873cd4ca-274a-464c-902f-6a8686700ddc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:50:59.757873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-873cd4ca-274a-464c-902f-6a8686700ddc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:50:59.764247 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-873cd4ca-274a-464c-902f-6a8686700ddc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:59.764695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-873cd4ca-274a-464c-902f-6a8686700ddc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:59.765450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-873cd4ca-274a-464c-902f-6a8686700ddc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:50:59.765908 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-873cd4ca-274a-464c-902f-6a8686700ddc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:50:59.794762 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-873cd4ca-274a-464c-902f-6a8686700ddc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043767 Aug 04 04:50:59.795296 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 647/1304] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:50:59 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:51:00.807472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8425690d-2157-49d3-87fb-cb2b883db80d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:00.809630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8425690d-2157-49d3-87fb-cb2b883db80d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:00.816243 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8425690d-2157-49d3-87fb-cb2b883db80d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:00.816700 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8425690d-2157-49d3-87fb-cb2b883db80d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:00.818365 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8425690d-2157-49d3-87fb-cb2b883db80d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:00.818831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8425690d-2157-49d3-87fb-cb2b883db80d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:00.847679 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8425690d-2157-49d3-87fb-cb2b883db80d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044151 Aug 04 04:51:00.848681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 658/1305] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:51:00 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:51:01.860256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-003a2e67-603b-43bb-8fae-7cbf4f3e8190 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:01.862405 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-003a2e67-603b-43bb-8fae-7cbf4f3e8190 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:01.870367 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-003a2e67-603b-43bb-8fae-7cbf4f3e8190 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:01.870823 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-003a2e67-603b-43bb-8fae-7cbf4f3e8190 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:01.871651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-003a2e67-603b-43bb-8fae-7cbf4f3e8190 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:01.872087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-003a2e67-603b-43bb-8fae-7cbf4f3e8190 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:01.902419 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-003a2e67-603b-43bb-8fae-7cbf4f3e8190 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046097 Aug 04 04:51:01.902964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 648/1306] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:51:01 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:51:02.914856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-98302eeb-565a-4f0a-ab72-798d414315ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:02.917233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-98302eeb-565a-4f0a-ab72-798d414315ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:02.923645 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98302eeb-565a-4f0a-ab72-798d414315ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:02.924097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98302eeb-565a-4f0a-ab72-798d414315ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:02.924852 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98302eeb-565a-4f0a-ab72-798d414315ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:02.925280 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98302eeb-565a-4f0a-ab72-798d414315ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:02.953833 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-98302eeb-565a-4f0a-ab72-798d414315ad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043165 Aug 04 04:51:02.954366 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 659/1307] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:51:02 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:51:03.967054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-599d895f-4970-4842-8895-3c62a275cf4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:03.969170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-599d895f-4970-4842-8895-3c62a275cf4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:03.976390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-599d895f-4970-4842-8895-3c62a275cf4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:03.976873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-599d895f-4970-4842-8895-3c62a275cf4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:03.977658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-599d895f-4970-4842-8895-3c62a275cf4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:03.978095 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-599d895f-4970-4842-8895-3c62a275cf4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:04.005941 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-599d895f-4970-4842-8895-3c62a275cf4d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042752 Aug 04 04:51:04.006484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 649/1308] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:51:03 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:51:05.007489 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-645b576d-950c-4429-aec1-03b766fea049 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:05.007995 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-645b576d-950c-4429-aec1-03b766fea049 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:05.014468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-645b576d-950c-4429-aec1-03b766fea049 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:05.014913 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-645b576d-950c-4429-aec1-03b766fea049 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:05.015678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-645b576d-950c-4429-aec1-03b766fea049 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:05.016113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-645b576d-950c-4429-aec1-03b766fea049 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:05.018031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-00031d9d-60b4-4bda-b383-47b041207772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:05.020164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-00031d9d-60b4-4bda-b383-47b041207772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:05.026084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-00031d9d-60b4-4bda-b383-47b041207772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:05.026526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-00031d9d-60b4-4bda-b383-47b041207772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:05.027291 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-00031d9d-60b4-4bda-b383-47b041207772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:05.027729 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-00031d9d-60b4-4bda-b383-47b041207772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:05.041012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-645b576d-950c-4429-aec1-03b766fea049 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Going to try to terminate instance {{(pid=134884) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:51:05.058406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-00031d9d-60b4-4bda-b383-47b041207772 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044398 Aug 04 04:51:05.058964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 650/1309] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:51:05 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:51:05.119016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-645b576d-950c-4429-aec1-03b766fea049 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 204 len: 0 microversion: 2.1 time: 0.115888 Aug 04 04:51:05.119721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 660/1310] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:51:05 2022] DELETE /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:51:05.127888 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-376d1437-6519-4549-be19-178f84d4f764 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:05.128498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-376d1437-6519-4549-be19-178f84d4f764 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:05.135021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-376d1437-6519-4549-be19-178f84d4f764 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:05.135466 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-376d1437-6519-4549-be19-178f84d4f764 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:05.136217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-376d1437-6519-4549-be19-178f84d4f764 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:05.136662 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-376d1437-6519-4549-be19-178f84d4f764 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:05.268714 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-376d1437-6519-4549-be19-178f84d4f764 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:05.276755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-376d1437-6519-4549-be19-178f84d4f764 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 200 len: 1671 microversion: 2.1 time: 0.152929 Aug 04 04:51:05.277306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 651/1311] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:05 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:06.072456 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-89673cfe-ee37-4f3a-b665-e30dfd39c189 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:06.074784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-89673cfe-ee37-4f3a-b665-e30dfd39c189 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:06.081090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-89673cfe-ee37-4f3a-b665-e30dfd39c189 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:06.081562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-89673cfe-ee37-4f3a-b665-e30dfd39c189 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:06.082340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-89673cfe-ee37-4f3a-b665-e30dfd39c189 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:06.082771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-89673cfe-ee37-4f3a-b665-e30dfd39c189 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:06.116971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-89673cfe-ee37-4f3a-b665-e30dfd39c189 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049466 Aug 04 04:51:06.121481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 661/1312] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:51:06 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:51:06.299824 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9c714fc3-7958-4d7f-ab91-553b4d124075 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:06.301038 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9c714fc3-7958-4d7f-ab91-553b4d124075 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:06.325258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c714fc3-7958-4d7f-ab91-553b4d124075 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:06.325822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c714fc3-7958-4d7f-ab91-553b4d124075 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:06.328929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c714fc3-7958-4d7f-ab91-553b4d124075 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:06.328929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c714fc3-7958-4d7f-ab91-553b4d124075 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:06.394156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9c714fc3-7958-4d7f-ab91-553b4d124075 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f7b1c19d824ac7b8207bf001b79057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a41f0f76c41cb8dfff71a14138534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:51:06.402491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9c714fc3-7958-4d7f-ab91-553b4d124075 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 200 len: 1603 microversion: 2.1 time: 0.106908 Aug 04 04:51:06.403148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 652/1313] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:06 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 1603 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:51:06.619239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-896d4a91-5408-463a-9cfe-2c61d08b9aa7 req-51b8cd56-6305-4807-aedd-32517438b718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b6588e-407b-44d5-ab86-395074db1c22", "name": "network-vif-deleted", "tag": "35f4f9e6-5967-4a03-9893-be7bccc37a83"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:51:06.643903 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-896d4a91-5408-463a-9cfe-2c61d08b9aa7 req-51b8cd56-6305-4807-aedd-32517438b718 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:06.644327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-896d4a91-5408-463a-9cfe-2c61d08b9aa7 req-51b8cd56-6305-4807-aedd-32517438b718 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:06.659985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-896d4a91-5408-463a-9cfe-2c61d08b9aa7 req-51b8cd56-6305-4807-aedd-32517438b718 service nova] Creating event network-vif-deleted:35f4f9e6-5967-4a03-9893-be7bccc37a83 for instance b1b6588e-407b-44d5-ab86-395074db1c22 on hv-cinder-85127 Aug 04 04:51:06.666066 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-896d4a91-5408-463a-9cfe-2c61d08b9aa7 req-51b8cd56-6305-4807-aedd-32517438b718 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051241 Aug 04 04:51:06.667670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 662/1314] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:51:07.129128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9d9dffff-ceba-457c-8aa9-5aa495ea36bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:07.131450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9d9dffff-ceba-457c-8aa9-5aa495ea36bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:07.137804 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d9dffff-ceba-457c-8aa9-5aa495ea36bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:07.138249 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d9dffff-ceba-457c-8aa9-5aa495ea36bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:07.139010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d9dffff-ceba-457c-8aa9-5aa495ea36bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:07.139442 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d9dffff-ceba-457c-8aa9-5aa495ea36bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:07.170809 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9d9dffff-ceba-457c-8aa9-5aa495ea36bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045549 Aug 04 04:51:07.171360 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 653/1315] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:51:07 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:51:07.425039 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-02159b55-8588-419f-bd6d-883f93c45517 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:07.425780 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-02159b55-8588-419f-bd6d-883f93c45517 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:07.433677 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02159b55-8588-419f-bd6d-883f93c45517 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:07.434138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02159b55-8588-419f-bd6d-883f93c45517 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:07.434920 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02159b55-8588-419f-bd6d-883f93c45517 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:07.435364 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02159b55-8588-419f-bd6d-883f93c45517 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:07.450213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-02159b55-8588-419f-bd6d-883f93c45517 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] HTTP exception thrown: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-02159b55-8588-419f-bd6d-883f93c45517 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Request method failure captured: Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 HTTP/1.1 Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601qv00E86gDF5SzueP9-B8uyKvLj0nc6Sro2hqNRnxqf2FFlVY_GJALo_D0NGRq_yIC65WvSXE_w16sIVtcZnCaKtgGOc7rRi-c_pAJDe7GccoFXaRba4f_54MB_ilclV0cxbNI5IM7M76SLtoy4xBpnigqD0YOU-aN8nNE7xHgrj4 Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 157a41f0f76c41cb8dfff71a14138534 Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeTestJSON-1618805094 Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:51:07.451884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:51:07.453573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_157a41f0f76c41cb8dfff71a14138534", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:51:07.453573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeTestJSON-1618805094 Aug 04 04:51:07.453573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 157a41f0f76c41cb8dfff71a14138534 Aug 04 04:51:07.453573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1618805094 Aug 04 04:51:07.453573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeTestJSON-1618805094-project Aug 04 04:51:07.453573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:51:07.453573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:51:07.453573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 12f7b1c19d824ac7b8207bf001b79057 Aug 04 04:51:07.453573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeTestJSON-1618805094-project Aug 04 04:51:07.453573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 04:51:07.453573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:51:07.453573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'b1b6588e-407b-44d5-ab86-395074db1c22'} Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:51:07.454486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:51:07.456075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:51:07.457349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-02159b55-8588-419f-bd6d-883f93c45517 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Returning 404 to user: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:51:07.457349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-02159b55-8588-419f-bd6d-883f93c45517 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 404 len: 111 microversion: 2.1 time: 0.033030 Aug 04 04:51:07.457349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 663/1316] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:51:07 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:51:07.463298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-49724859-05b5-4f7b-92b0-5dc4a48ecdde tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '.version_select at 0x7fc942191550>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:07.483654 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-49724859-05b5-4f7b-92b0-5dc4a48ecdde tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-587767176" status: 202 len: 0 microversion: 2.1 time: 0.024696 Aug 04 04:51:07.484296 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 654/1317] 10.222.0.47 () {58 vars in 1218 bytes} [Thu Aug 4 04:51:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-587767176 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:51:08.184270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-954f3a43-ede5-452d-9b58-1b4c598266f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:08.187581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-954f3a43-ede5-452d-9b58-1b4c598266f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:08.196233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-954f3a43-ede5-452d-9b58-1b4c598266f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:08.196686 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-954f3a43-ede5-452d-9b58-1b4c598266f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:08.197458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-954f3a43-ede5-452d-9b58-1b4c598266f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:08.197914 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-954f3a43-ede5-452d-9b58-1b4c598266f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:08.229333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-954f3a43-ede5-452d-9b58-1b4c598266f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048958 Aug 04 04:51:08.230028 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 664/1318] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:51:08 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:51:09.242070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4cac744c-e32a-4012-8975-401a2d610327 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:09.244492 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4cac744c-e32a-4012-8975-401a2d610327 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:09.251600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4cac744c-e32a-4012-8975-401a2d610327 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:09.252054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4cac744c-e32a-4012-8975-401a2d610327 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:09.252834 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4cac744c-e32a-4012-8975-401a2d610327 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:09.253275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4cac744c-e32a-4012-8975-401a2d610327 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:09.285898 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4cac744c-e32a-4012-8975-401a2d610327 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048344 Aug 04 04:51:09.286479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 655/1319] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:51:09 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:51:10.298786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a00d3de9-e218-4ce9-9a6f-f9f0f7eb0847 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:51:10.300956 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a00d3de9-e218-4ce9-9a6f-f9f0f7eb0847 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:10.308137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a00d3de9-e218-4ce9-9a6f-f9f0f7eb0847 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:10.308595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a00d3de9-e218-4ce9-9a6f-f9f0f7eb0847 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:10.309359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a00d3de9-e218-4ce9-9a6f-f9f0f7eb0847 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:10.309839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a00d3de9-e218-4ce9-9a6f-f9f0f7eb0847 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:10.339999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a00d3de9-e218-4ce9-9a6f-f9f0f7eb0847 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045345 Aug 04 04:51:10.340587 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 665/1320] 10.222.0.47 () {58 vars in 1302 bytes} [Thu Aug 4 04:51:10 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:51:11.353605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-046ac05a-f7b8-4971-af72-bddc4acaa79f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:51:11.355816 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-046ac05a-f7b8-4971-af72-bddc4acaa79f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:51:11.362345 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-046ac05a-f7b8-4971-af72-bddc4acaa79f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:11.362799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-046ac05a-f7b8-4971-af72-bddc4acaa79f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:11.363560 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-046ac05a-f7b8-4971-af72-bddc4acaa79f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:51:11.363996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-046ac05a-f7b8-4971-af72-bddc4acaa79f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:51:11.439669 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-046ac05a-f7b8-4971-af72-bddc4acaa79f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "POST /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/action" status: 200 len: 76666 microversion: 2.1 time: 0.091024 Aug 04 04:51:11.440311 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 656/1321] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 04:51:11 2022] POST /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943/action => generated 76666 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 04:52:19.762425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:52:19.763098 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 04:52:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:54:04.625773 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:54:04.626422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 04:54:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:54:08.231632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:54:08.232158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 04:54:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:54:18.551066 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:54:18.551680 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 04:54:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:54:20.264294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:54:20.264814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 04:54:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:55:21.495103 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd002c78-6a33-45a8-a101-bc6ad645af03] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 04:55:21.496076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:21.496952 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:21.501055 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b5959370-f21a-4bbc-b925-28ad3e250307 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:21.501570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b5959370-f21a-4bbc-b925-28ad3e250307 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:21.510103 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b5959370-f21a-4bbc-b925-28ad3e250307 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:21.510741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b5959370-f21a-4bbc-b925-28ad3e250307 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:21.511527 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b5959370-f21a-4bbc-b925-28ad3e250307 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:21.512021 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b5959370-f21a-4bbc-b925-28ad3e250307 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:21.540490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b5959370-f21a-4bbc-b925-28ad3e250307 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Going to try to terminate instance {{(pid=134884) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:55:21.616332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b5959370-f21a-4bbc-b925-28ad3e250307 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 204 len: 0 microversion: 2.1 time: 0.122898 Aug 04 04:55:21.616913 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 666/1322] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:55:21 2022] DELETE /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:55:21.623906 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR oslo.messaging._drivers.impl_rabbit [-] [086f8b94-79ce-49dc-aa60-e5aa4476d9c6] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 04:55:21.624837 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:21.625663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=75 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:21.629819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f973a267-ef97-4ae5-92b4-ff26e6c4d512 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:21.630534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f973a267-ef97-4ae5-92b4-ff26e6c4d512 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:21.638817 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f973a267-ef97-4ae5-92b4-ff26e6c4d512 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:21.639282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f973a267-ef97-4ae5-92b4-ff26e6c4d512 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:21.640048 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f973a267-ef97-4ae5-92b4-ff26e6c4d512 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:21.640490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f973a267-ef97-4ae5-92b4-ff26e6c4d512 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:21.879371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f973a267-ef97-4ae5-92b4-ff26e6c4d512 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:21.887927 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f973a267-ef97-4ae5-92b4-ff26e6c4d512 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.266058 Aug 04 04:55:21.888481 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 657/1323] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:21 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:22.909378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5bbd73cb-9c4f-411d-91de-beb7d7a8e8cf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:22.910238 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5bbd73cb-9c4f-411d-91de-beb7d7a8e8cf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:22.917934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5bbd73cb-9c4f-411d-91de-beb7d7a8e8cf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:22.918461 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5bbd73cb-9c4f-411d-91de-beb7d7a8e8cf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:22.919241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5bbd73cb-9c4f-411d-91de-beb7d7a8e8cf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:22.919676 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5bbd73cb-9c4f-411d-91de-beb7d7a8e8cf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:22.936718 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd002c78-6a33-45a8-a101-bc6ad645af03] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 37696. Aug 04 04:55:23.106095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5bbd73cb-9c4f-411d-91de-beb7d7a8e8cf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:23.114178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5bbd73cb-9c4f-411d-91de-beb7d7a8e8cf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.209166 Aug 04 04:55:23.114734 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 667/1324] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:22 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:24.135980 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cbf5341c-c01d-4d77-883b-341599471c77 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:24.136595 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cbf5341c-c01d-4d77-883b-341599471c77 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:24.143827 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cbf5341c-c01d-4d77-883b-341599471c77 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:24.144280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cbf5341c-c01d-4d77-883b-341599471c77 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:24.145045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cbf5341c-c01d-4d77-883b-341599471c77 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:24.145483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cbf5341c-c01d-4d77-883b-341599471c77 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:24.152159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] [086f8b94-79ce-49dc-aa60-e5aa4476d9c6] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 37710. Aug 04 04:55:24.282490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-cbf5341c-c01d-4d77-883b-341599471c77 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:24.290798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cbf5341c-c01d-4d77-883b-341599471c77 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.158781 Aug 04 04:55:24.291363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 658/1325] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:24 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:25.311959 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f6a67004-39bf-4f53-99d7-90c75e88bd69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:25.312571 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f6a67004-39bf-4f53-99d7-90c75e88bd69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:25.321568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f6a67004-39bf-4f53-99d7-90c75e88bd69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:25.322021 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f6a67004-39bf-4f53-99d7-90c75e88bd69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:25.322784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f6a67004-39bf-4f53-99d7-90c75e88bd69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:25.323221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f6a67004-39bf-4f53-99d7-90c75e88bd69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:25.453809 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f6a67004-39bf-4f53-99d7-90c75e88bd69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:25.462578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f6a67004-39bf-4f53-99d7-90c75e88bd69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154429 Aug 04 04:55:25.463130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 668/1326] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:25 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:26.483905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-02b2067b-c388-473e-ada3-c1f3ef5b9f9e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:26.484513 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-02b2067b-c388-473e-ada3-c1f3ef5b9f9e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:26.491501 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-02b2067b-c388-473e-ada3-c1f3ef5b9f9e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:26.491964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-02b2067b-c388-473e-ada3-c1f3ef5b9f9e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:26.492741 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-02b2067b-c388-473e-ada3-c1f3ef5b9f9e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:26.493184 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-02b2067b-c388-473e-ada3-c1f3ef5b9f9e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:26.636403 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-02b2067b-c388-473e-ada3-c1f3ef5b9f9e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:26.644452 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-02b2067b-c388-473e-ada3-c1f3ef5b9f9e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.164412 Aug 04 04:55:26.645001 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 659/1327] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:26 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:27.666212 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-16181e76-0496-42bf-91d4-b259054a4ec5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:27.666875 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-16181e76-0496-42bf-91d4-b259054a4ec5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:27.673690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-16181e76-0496-42bf-91d4-b259054a4ec5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:27.674170 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-16181e76-0496-42bf-91d4-b259054a4ec5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:27.674964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-16181e76-0496-42bf-91d4-b259054a4ec5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:27.675398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-16181e76-0496-42bf-91d4-b259054a4ec5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:27.802770 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-16181e76-0496-42bf-91d4-b259054a4ec5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:27.811259 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-16181e76-0496-42bf-91d4-b259054a4ec5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149228 Aug 04 04:55:27.811819 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 669/1328] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:27 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:28.833566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1e074a70-493c-4bd8-bb11-a0fc5a422cc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:28.834183 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1e074a70-493c-4bd8-bb11-a0fc5a422cc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:28.841378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1e074a70-493c-4bd8-bb11-a0fc5a422cc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:28.841863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1e074a70-493c-4bd8-bb11-a0fc5a422cc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:28.842617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1e074a70-493c-4bd8-bb11-a0fc5a422cc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:28.843057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1e074a70-493c-4bd8-bb11-a0fc5a422cc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:28.974705 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1e074a70-493c-4bd8-bb11-a0fc5a422cc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:28.982736 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1e074a70-493c-4bd8-bb11-a0fc5a422cc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.153073 Aug 04 04:55:28.983291 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 660/1329] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:28 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:30.003875 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-456cbe16-f2ea-431a-9cd5-b69140a9ac8b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:30.004426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-456cbe16-f2ea-431a-9cd5-b69140a9ac8b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:30.010847 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-456cbe16-f2ea-431a-9cd5-b69140a9ac8b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:30.011295 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-456cbe16-f2ea-431a-9cd5-b69140a9ac8b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:30.012058 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-456cbe16-f2ea-431a-9cd5-b69140a9ac8b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:30.012496 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-456cbe16-f2ea-431a-9cd5-b69140a9ac8b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:30.140141 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-456cbe16-f2ea-431a-9cd5-b69140a9ac8b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:30.148968 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-456cbe16-f2ea-431a-9cd5-b69140a9ac8b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148965 Aug 04 04:55:30.149529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 670/1330] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:29 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:31.170174 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-455f2e5a-7dad-4dc1-848d-401d656221a0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:31.170819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-455f2e5a-7dad-4dc1-848d-401d656221a0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:31.177781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-455f2e5a-7dad-4dc1-848d-401d656221a0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:31.178235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-455f2e5a-7dad-4dc1-848d-401d656221a0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:31.179617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-455f2e5a-7dad-4dc1-848d-401d656221a0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:31.180054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-455f2e5a-7dad-4dc1-848d-401d656221a0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:31.311433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-455f2e5a-7dad-4dc1-848d-401d656221a0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:31.319357 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-455f2e5a-7dad-4dc1-848d-401d656221a0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.153060 Aug 04 04:55:31.320215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 661/1331] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:31 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:32.341070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fdad4686-67ab-4014-832d-62d780c1ba8e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:32.341768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fdad4686-67ab-4014-832d-62d780c1ba8e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:32.348352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fdad4686-67ab-4014-832d-62d780c1ba8e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:32.348803 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fdad4686-67ab-4014-832d-62d780c1ba8e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:32.349599 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fdad4686-67ab-4014-832d-62d780c1ba8e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:32.350041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fdad4686-67ab-4014-832d-62d780c1ba8e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:32.479255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fdad4686-67ab-4014-832d-62d780c1ba8e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:32.487185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fdad4686-67ab-4014-832d-62d780c1ba8e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.150263 Aug 04 04:55:32.487745 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 671/1332] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:32 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:33.509522 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f9c0ff18-5362-4666-9190-c7c08b45e080 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:33.510214 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f9c0ff18-5362-4666-9190-c7c08b45e080 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:33.516859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9c0ff18-5362-4666-9190-c7c08b45e080 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:33.517382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9c0ff18-5362-4666-9190-c7c08b45e080 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:33.518134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9c0ff18-5362-4666-9190-c7c08b45e080 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:33.518576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9c0ff18-5362-4666-9190-c7c08b45e080 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:33.648432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f9c0ff18-5362-4666-9190-c7c08b45e080 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:33.656316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f9c0ff18-5362-4666-9190-c7c08b45e080 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151304 Aug 04 04:55:33.656863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 662/1333] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:33 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:34.677822 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-de7aa1ed-a4df-480f-a70f-9ff027ad01d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:34.678463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-de7aa1ed-a4df-480f-a70f-9ff027ad01d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:34.685095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de7aa1ed-a4df-480f-a70f-9ff027ad01d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:34.685630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de7aa1ed-a4df-480f-a70f-9ff027ad01d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:34.686313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de7aa1ed-a4df-480f-a70f-9ff027ad01d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:34.686744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de7aa1ed-a4df-480f-a70f-9ff027ad01d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:34.827139 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-de7aa1ed-a4df-480f-a70f-9ff027ad01d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:34.835942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-de7aa1ed-a4df-480f-a70f-9ff027ad01d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.161965 Aug 04 04:55:34.836501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 672/1334] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:34 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:35.856650 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-03b433f7-d48a-49d2-a879-9274282ec0f2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:35.857261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-03b433f7-d48a-49d2-a879-9274282ec0f2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:35.863630 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03b433f7-d48a-49d2-a879-9274282ec0f2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:35.864079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03b433f7-d48a-49d2-a879-9274282ec0f2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:35.864836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03b433f7-d48a-49d2-a879-9274282ec0f2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:35.865270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03b433f7-d48a-49d2-a879-9274282ec0f2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:35.992916 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-03b433f7-d48a-49d2-a879-9274282ec0f2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:36.000852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-03b433f7-d48a-49d2-a879-9274282ec0f2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.147937 Aug 04 04:55:36.001401 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 663/1335] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:35 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:37.021924 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-542484d6-203a-42b9-875a-89391f537646 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:37.022594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-542484d6-203a-42b9-875a-89391f537646 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:37.029577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-542484d6-203a-42b9-875a-89391f537646 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:37.030038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-542484d6-203a-42b9-875a-89391f537646 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:37.030815 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-542484d6-203a-42b9-875a-89391f537646 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:37.031255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-542484d6-203a-42b9-875a-89391f537646 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:37.161759 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-542484d6-203a-42b9-875a-89391f537646 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:37.170216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-542484d6-203a-42b9-875a-89391f537646 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152797 Aug 04 04:55:37.171346 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 673/1336] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:37 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:38.192208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ca421a23-2f2e-4e13-8f82-e0e8e480a25c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:38.192752 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ca421a23-2f2e-4e13-8f82-e0e8e480a25c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:38.200550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca421a23-2f2e-4e13-8f82-e0e8e480a25c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:38.201005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca421a23-2f2e-4e13-8f82-e0e8e480a25c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:38.201797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca421a23-2f2e-4e13-8f82-e0e8e480a25c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:38.202238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca421a23-2f2e-4e13-8f82-e0e8e480a25c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:38.332552 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ca421a23-2f2e-4e13-8f82-e0e8e480a25c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:38.341674 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ca421a23-2f2e-4e13-8f82-e0e8e480a25c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.153419 Aug 04 04:55:38.342236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 664/1337] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:38 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:39.363892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b3d2d829-39c1-4496-b648-531592d090d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:39.364547 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b3d2d829-39c1-4496-b648-531592d090d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:39.371277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b3d2d829-39c1-4496-b648-531592d090d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:39.371724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b3d2d829-39c1-4496-b648-531592d090d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:39.372492 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b3d2d829-39c1-4496-b648-531592d090d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:39.372928 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b3d2d829-39c1-4496-b648-531592d090d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:39.503948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b3d2d829-39c1-4496-b648-531592d090d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:39.512591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b3d2d829-39c1-4496-b648-531592d090d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152621 Aug 04 04:55:39.513155 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 674/1338] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:39 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:39.771368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:55:39.771813 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 04:55:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:55:40.534958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-317578f0-897e-4582-9079-851316b950b3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:40.535903 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-317578f0-897e-4582-9079-851316b950b3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:40.543024 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-317578f0-897e-4582-9079-851316b950b3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:40.543469 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-317578f0-897e-4582-9079-851316b950b3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:40.544218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-317578f0-897e-4582-9079-851316b950b3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:40.544649 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-317578f0-897e-4582-9079-851316b950b3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:40.676947 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-317578f0-897e-4582-9079-851316b950b3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:40.685729 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-317578f0-897e-4582-9079-851316b950b3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154674 Aug 04 04:55:40.686281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 665/1339] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:40 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:41.706666 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-692b8b11-b473-436b-a62e-027b0b0ae70e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:41.707208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-692b8b11-b473-436b-a62e-027b0b0ae70e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:41.714088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-692b8b11-b473-436b-a62e-027b0b0ae70e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:41.714536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-692b8b11-b473-436b-a62e-027b0b0ae70e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:41.715305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-692b8b11-b473-436b-a62e-027b0b0ae70e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:41.715741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-692b8b11-b473-436b-a62e-027b0b0ae70e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:41.842723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-692b8b11-b473-436b-a62e-027b0b0ae70e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:41.851111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-692b8b11-b473-436b-a62e-027b0b0ae70e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148207 Aug 04 04:55:41.851741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 675/1340] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:41 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:42.872223 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-342624c4-8e50-4510-b3b1-7a5049a15891 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:42.872872 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-342624c4-8e50-4510-b3b1-7a5049a15891 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:42.879351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-342624c4-8e50-4510-b3b1-7a5049a15891 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:42.879800 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-342624c4-8e50-4510-b3b1-7a5049a15891 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:42.880549 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-342624c4-8e50-4510-b3b1-7a5049a15891 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:42.880978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-342624c4-8e50-4510-b3b1-7a5049a15891 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:43.011758 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-342624c4-8e50-4510-b3b1-7a5049a15891 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:43.019564 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-342624c4-8e50-4510-b3b1-7a5049a15891 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151134 Aug 04 04:55:43.020114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 666/1341] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:42 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:44.041972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4e657fa6-5e89-4dae-ab2d-d96770d523ac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:44.042591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4e657fa6-5e89-4dae-ab2d-d96770d523ac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:44.049411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e657fa6-5e89-4dae-ab2d-d96770d523ac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:44.049894 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e657fa6-5e89-4dae-ab2d-d96770d523ac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:44.050658 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e657fa6-5e89-4dae-ab2d-d96770d523ac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:44.051092 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e657fa6-5e89-4dae-ab2d-d96770d523ac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:44.178324 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4e657fa6-5e89-4dae-ab2d-d96770d523ac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:44.186559 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4e657fa6-5e89-4dae-ab2d-d96770d523ac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149054 Aug 04 04:55:44.187146 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 676/1342] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:44 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:45.208182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-237acd9e-1c52-4cd3-8181-da58a145756b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:45.208781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-237acd9e-1c52-4cd3-8181-da58a145756b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:45.215380 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-237acd9e-1c52-4cd3-8181-da58a145756b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:45.215830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-237acd9e-1c52-4cd3-8181-da58a145756b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:45.216578 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-237acd9e-1c52-4cd3-8181-da58a145756b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:45.217008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-237acd9e-1c52-4cd3-8181-da58a145756b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:45.353009 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-237acd9e-1c52-4cd3-8181-da58a145756b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:45.361134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-237acd9e-1c52-4cd3-8181-da58a145756b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.156742 Aug 04 04:55:45.361797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 667/1343] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:45 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:46.383436 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0389d632-55a8-43cc-bcd2-c471f729317a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:46.384056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0389d632-55a8-43cc-bcd2-c471f729317a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:46.392770 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0389d632-55a8-43cc-bcd2-c471f729317a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:46.393201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0389d632-55a8-43cc-bcd2-c471f729317a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:46.393993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0389d632-55a8-43cc-bcd2-c471f729317a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:46.394425 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0389d632-55a8-43cc-bcd2-c471f729317a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:46.525629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0389d632-55a8-43cc-bcd2-c471f729317a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:46.533507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0389d632-55a8-43cc-bcd2-c471f729317a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154004 Aug 04 04:55:46.534088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 677/1344] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:46 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:47.555591 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fdcb1791-a968-48a5-ae76-289eb0a303a4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:47.556205 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fdcb1791-a968-48a5-ae76-289eb0a303a4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:47.562785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdcb1791-a968-48a5-ae76-289eb0a303a4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:47.563244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdcb1791-a968-48a5-ae76-289eb0a303a4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:47.564011 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdcb1791-a968-48a5-ae76-289eb0a303a4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:47.564455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdcb1791-a968-48a5-ae76-289eb0a303a4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:47.692173 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-fdcb1791-a968-48a5-ae76-289eb0a303a4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:47.700303 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fdcb1791-a968-48a5-ae76-289eb0a303a4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149235 Aug 04 04:55:47.700863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 668/1345] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:47 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:48.721467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-01a88943-a9d8-424a-bd6c-a365f0abb27d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:48.722169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-01a88943-a9d8-424a-bd6c-a365f0abb27d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:48.729247 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-01a88943-a9d8-424a-bd6c-a365f0abb27d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:48.729767 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-01a88943-a9d8-424a-bd6c-a365f0abb27d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:48.730533 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-01a88943-a9d8-424a-bd6c-a365f0abb27d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:48.730975 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-01a88943-a9d8-424a-bd6c-a365f0abb27d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:48.863720 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-01a88943-a9d8-424a-bd6c-a365f0abb27d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:48.872570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-01a88943-a9d8-424a-bd6c-a365f0abb27d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154895 Aug 04 04:55:48.873130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 678/1346] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:48 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:49.893345 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b2d60349-ef59-487b-8220-2c0a8008a058 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:49.893996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b2d60349-ef59-487b-8220-2c0a8008a058 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:49.901325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b2d60349-ef59-487b-8220-2c0a8008a058 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:49.901830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b2d60349-ef59-487b-8220-2c0a8008a058 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:49.902626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b2d60349-ef59-487b-8220-2c0a8008a058 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:49.903066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b2d60349-ef59-487b-8220-2c0a8008a058 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:50.029650 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b2d60349-ef59-487b-8220-2c0a8008a058 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:50.037457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b2d60349-ef59-487b-8220-2c0a8008a058 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148056 Aug 04 04:55:50.038716 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 669/1347] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:49 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:51.060604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2660fd3c-9d8d-421a-be95-273cbd4485e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:51.061209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2660fd3c-9d8d-421a-be95-273cbd4485e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:51.067657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2660fd3c-9d8d-421a-be95-273cbd4485e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:51.068100 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2660fd3c-9d8d-421a-be95-273cbd4485e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:51.068875 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2660fd3c-9d8d-421a-be95-273cbd4485e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:51.069407 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2660fd3c-9d8d-421a-be95-273cbd4485e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:51.200805 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2660fd3c-9d8d-421a-be95-273cbd4485e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:51.208640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2660fd3c-9d8d-421a-be95-273cbd4485e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151938 Aug 04 04:55:51.209199 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 679/1348] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:51 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:52.230151 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d9a47011-8bd0-42a5-a27c-a974c2e6c739 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:52.230704 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d9a47011-8bd0-42a5-a27c-a974c2e6c739 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:52.232932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=27 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:52.238278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9a47011-8bd0-42a5-a27c-a974c2e6c739 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:52.238720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9a47011-8bd0-42a5-a27c-a974c2e6c739 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:52.239476 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9a47011-8bd0-42a5-a27c-a974c2e6c739 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:52.239943 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9a47011-8bd0-42a5-a27c-a974c2e6c739 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:52.243182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=79 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:52.369661 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d9a47011-8bd0-42a5-a27c-a974c2e6c739 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:52.377461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d9a47011-8bd0-42a5-a27c-a974c2e6c739 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151332 Aug 04 04:55:52.378060 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 670/1349] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:52 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:53.399576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7c1c18d4-8b83-4f1d-8489-4e81cc61dcac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:53.400407 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7c1c18d4-8b83-4f1d-8489-4e81cc61dcac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:53.402312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:53.407710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c1c18d4-8b83-4f1d-8489-4e81cc61dcac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:53.408161 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c1c18d4-8b83-4f1d-8489-4e81cc61dcac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:53.408923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c1c18d4-8b83-4f1d-8489-4e81cc61dcac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:53.409359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c1c18d4-8b83-4f1d-8489-4e81cc61dcac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:53.412837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:55:53.539087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7c1c18d4-8b83-4f1d-8489-4e81cc61dcac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:53.547711 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7c1c18d4-8b83-4f1d-8489-4e81cc61dcac tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152956 Aug 04 04:55:53.548276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 680/1350] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:53 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:55:54.207426 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0e46f2ef-25ec-43c1-8643-026fa2d940c2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:54.207930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0e46f2ef-25ec-43c1-8643-026fa2d940c2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:54.214650 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e46f2ef-25ec-43c1-8643-026fa2d940c2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:54.215105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e46f2ef-25ec-43c1-8643-026fa2d940c2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:54.215868 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e46f2ef-25ec-43c1-8643-026fa2d940c2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:54.216310 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e46f2ef-25ec-43c1-8643-026fa2d940c2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:54.244647 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0e46f2ef-25ec-43c1-8643-026fa2d940c2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Going to try to terminate instance {{(pid=134883) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:55:54.324071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0e46f2ef-25ec-43c1-8643-026fa2d940c2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "DELETE /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 204 len: 0 microversion: 2.1 time: 0.120080 Aug 04 04:55:54.324759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 671/1351] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:55:54 2022] DELETE /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:55:54.332945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-625a7338-7564-419c-a119-1db2368db60d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:54.333582 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-625a7338-7564-419c-a119-1db2368db60d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:54.340578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-625a7338-7564-419c-a119-1db2368db60d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:54.341031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-625a7338-7564-419c-a119-1db2368db60d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:54.341831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-625a7338-7564-419c-a119-1db2368db60d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:54.342273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-625a7338-7564-419c-a119-1db2368db60d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:54.475960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-625a7338-7564-419c-a119-1db2368db60d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:54.484724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-625a7338-7564-419c-a119-1db2368db60d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1597 microversion: 2.1 time: 0.155636 Aug 04 04:55:54.485287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 681/1352] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:54 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1597 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:54.569972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-848e99d5-4e35-4a8c-b4ba-cebd68e355d4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:54.571494 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-848e99d5-4e35-4a8c-b4ba-cebd68e355d4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:54.577812 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-848e99d5-4e35-4a8c-b4ba-cebd68e355d4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:54.578202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-848e99d5-4e35-4a8c-b4ba-cebd68e355d4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:54.578967 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-848e99d5-4e35-4a8c-b4ba-cebd68e355d4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:54.579402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-848e99d5-4e35-4a8c-b4ba-cebd68e355d4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:54.710242 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-848e99d5-4e35-4a8c-b4ba-cebd68e355d4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:54.718489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-848e99d5-4e35-4a8c-b4ba-cebd68e355d4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152764 Aug 04 04:55:54.719053 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 672/1353] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:54 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:55.510673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-490979c1-3cfc-4db5-85f5-154e005b66f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:55.511425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-490979c1-3cfc-4db5-85f5-154e005b66f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:55.519472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-490979c1-3cfc-4db5-85f5-154e005b66f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:55.519923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-490979c1-3cfc-4db5-85f5-154e005b66f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:55.520689 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-490979c1-3cfc-4db5-85f5-154e005b66f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:55.521118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-490979c1-3cfc-4db5-85f5-154e005b66f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:55.549050 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-6682e0a3-86c5-4709-9f42-0d3648da975e req-683786c5-356e-436c-81ad-5d1f934fa81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1762cb-4b08-41db-8302-59f56c67370a", "name": "network-vif-deleted", "tag": "e652ee96-0575-4a05-ad13-04b1d7dbc6e7"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:55:55.560165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-6682e0a3-86c5-4709-9f42-0d3648da975e req-683786c5-356e-436c-81ad-5d1f934fa81d service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:55.560606 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-6682e0a3-86c5-4709-9f42-0d3648da975e req-683786c5-356e-436c-81ad-5d1f934fa81d service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:55.572393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-6682e0a3-86c5-4709-9f42-0d3648da975e req-683786c5-356e-436c-81ad-5d1f934fa81d service nova] Creating event network-vif-deleted:e652ee96-0575-4a05-ad13-04b1d7dbc6e7 for instance af1762cb-4b08-41db-8302-59f56c67370a on hv-cinder-85127 Aug 04 04:55:55.577476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-6682e0a3-86c5-4709-9f42-0d3648da975e req-683786c5-356e-436c-81ad-5d1f934fa81d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094316 Aug 04 04:55:55.579060 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 682/1354] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 04:55:55.598732 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-490979c1-3cfc-4db5-85f5-154e005b66f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:55.607324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-490979c1-3cfc-4db5-85f5-154e005b66f3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.105165 Aug 04 04:55:55.607952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 673/1355] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:55 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:55:55.741527 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b9403ca4-f0f7-4165-8601-445f86f20baf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:55.743054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b9403ca4-f0f7-4165-8601-445f86f20baf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:55.749791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b9403ca4-f0f7-4165-8601-445f86f20baf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:55.750463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b9403ca4-f0f7-4165-8601-445f86f20baf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:55.751491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b9403ca4-f0f7-4165-8601-445f86f20baf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:55.751861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b9403ca4-f0f7-4165-8601-445f86f20baf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:55.890365 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b9403ca4-f0f7-4165-8601-445f86f20baf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:55.898531 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b9403ca4-f0f7-4165-8601-445f86f20baf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.161835 Aug 04 04:55:55.899719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 683/1356] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:55 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:56.629433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d05fbbbf-7587-4b6c-8e97-94c983292453 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:56.630074 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d05fbbbf-7587-4b6c-8e97-94c983292453 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:56.637336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d05fbbbf-7587-4b6c-8e97-94c983292453 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:56.637892 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d05fbbbf-7587-4b6c-8e97-94c983292453 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:56.638658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d05fbbbf-7587-4b6c-8e97-94c983292453 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:56.639094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d05fbbbf-7587-4b6c-8e97-94c983292453 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:56.700374 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d05fbbbf-7587-4b6c-8e97-94c983292453 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:56.708381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d05fbbbf-7587-4b6c-8e97-94c983292453 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083067 Aug 04 04:55:56.708931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 674/1357] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:56 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:56.920638 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-56305788-e032-43eb-b8e1-3df3fea35564 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:56.921572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-56305788-e032-43eb-b8e1-3df3fea35564 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:56.928189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-56305788-e032-43eb-b8e1-3df3fea35564 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:56.928638 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-56305788-e032-43eb-b8e1-3df3fea35564 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:56.929403 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-56305788-e032-43eb-b8e1-3df3fea35564 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:56.930521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-56305788-e032-43eb-b8e1-3df3fea35564 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:57.297083 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-56305788-e032-43eb-b8e1-3df3fea35564 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:57.306112 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-56305788-e032-43eb-b8e1-3df3fea35564 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.388235 Aug 04 04:55:57.306679 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 684/1358] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:56 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:57.728740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a13e066a-ea03-447d-b3a0-46d8aafeffb8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:57.729265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a13e066a-ea03-447d-b3a0-46d8aafeffb8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:57.736215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a13e066a-ea03-447d-b3a0-46d8aafeffb8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:57.736746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a13e066a-ea03-447d-b3a0-46d8aafeffb8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:57.737486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a13e066a-ea03-447d-b3a0-46d8aafeffb8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:57.737952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a13e066a-ea03-447d-b3a0-46d8aafeffb8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:57.799443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a13e066a-ea03-447d-b3a0-46d8aafeffb8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:57.807654 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a13e066a-ea03-447d-b3a0-46d8aafeffb8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083014 Aug 04 04:55:57.808206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 675/1359] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:57 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:58.327082 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2f91becd-871d-4c54-a4fd-84287c093a3e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:58.327624 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2f91becd-871d-4c54-a4fd-84287c093a3e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:58.334206 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f91becd-871d-4c54-a4fd-84287c093a3e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:58.334658 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f91becd-871d-4c54-a4fd-84287c093a3e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:58.335421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f91becd-871d-4c54-a4fd-84287c093a3e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:58.335860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f91becd-871d-4c54-a4fd-84287c093a3e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:58.466907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2f91becd-871d-4c54-a4fd-84287c093a3e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:58.474903 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2f91becd-871d-4c54-a4fd-84287c093a3e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151785 Aug 04 04:55:58.475459 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 685/1360] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:58 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:58.828773 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a438653c-7054-47de-a117-49efda6a7c9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:58.829385 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a438653c-7054-47de-a117-49efda6a7c9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:58.835793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a438653c-7054-47de-a117-49efda6a7c9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:58.836756 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a438653c-7054-47de-a117-49efda6a7c9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:58.837726 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a438653c-7054-47de-a117-49efda6a7c9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:58.838160 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a438653c-7054-47de-a117-49efda6a7c9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:58.903442 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a438653c-7054-47de-a117-49efda6a7c9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:58.911378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a438653c-7054-47de-a117-49efda6a7c9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086448 Aug 04 04:55:58.911938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 676/1361] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:58 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:59.495993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-03fa2ada-d9d3-4d1c-aac7-e6143332e4f3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:59.496585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-03fa2ada-d9d3-4d1c-aac7-e6143332e4f3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:59.503104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03fa2ada-d9d3-4d1c-aac7-e6143332e4f3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:59.503553 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03fa2ada-d9d3-4d1c-aac7-e6143332e4f3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:59.504315 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03fa2ada-d9d3-4d1c-aac7-e6143332e4f3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:59.504777 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03fa2ada-d9d3-4d1c-aac7-e6143332e4f3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:59.632270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-03fa2ada-d9d3-4d1c-aac7-e6143332e4f3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:55:59.641137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-03fa2ada-d9d3-4d1c-aac7-e6143332e4f3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149071 Aug 04 04:55:59.641802 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 686/1362] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:59 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:55:59.932777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-55d7d80f-c239-44eb-afae-54a83302d6a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:55:59.933376 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-55d7d80f-c239-44eb-afae-54a83302d6a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:55:59.939843 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-55d7d80f-c239-44eb-afae-54a83302d6a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:59.940304 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-55d7d80f-c239-44eb-afae-54a83302d6a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:55:59.941195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-55d7d80f-c239-44eb-afae-54a83302d6a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:55:59.941691 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-55d7d80f-c239-44eb-afae-54a83302d6a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:00.003885 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-55d7d80f-c239-44eb-afae-54a83302d6a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:00.011842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-55d7d80f-c239-44eb-afae-54a83302d6a5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083519 Aug 04 04:56:00.012401 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 677/1363] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:55:59 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:00.663438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0f259f22-27dc-4bfa-ad8c-e8811747d835 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:00.664787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0f259f22-27dc-4bfa-ad8c-e8811747d835 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:00.671513 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f259f22-27dc-4bfa-ad8c-e8811747d835 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:00.671963 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f259f22-27dc-4bfa-ad8c-e8811747d835 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:00.672720 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f259f22-27dc-4bfa-ad8c-e8811747d835 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:00.673157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f259f22-27dc-4bfa-ad8c-e8811747d835 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:00.804353 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0f259f22-27dc-4bfa-ad8c-e8811747d835 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:00.812348 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0f259f22-27dc-4bfa-ad8c-e8811747d835 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152774 Aug 04 04:56:00.812911 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 687/1364] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:00 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:01.032443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5c8912db-736c-4ae6-af79-bceb963140cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:01.033060 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5c8912db-736c-4ae6-af79-bceb963140cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:01.039785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c8912db-736c-4ae6-af79-bceb963140cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:01.040238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c8912db-736c-4ae6-af79-bceb963140cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:01.041005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c8912db-736c-4ae6-af79-bceb963140cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:01.041444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c8912db-736c-4ae6-af79-bceb963140cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:01.105387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5c8912db-736c-4ae6-af79-bceb963140cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:01.113432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5c8912db-736c-4ae6-af79-bceb963140cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084881 Aug 04 04:56:01.114018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 678/1365] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:01 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:01.833885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b7bd92b8-f69a-47da-978f-f2b5f26e0b60 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:01.834504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b7bd92b8-f69a-47da-978f-f2b5f26e0b60 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:01.841469 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7bd92b8-f69a-47da-978f-f2b5f26e0b60 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:01.841947 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7bd92b8-f69a-47da-978f-f2b5f26e0b60 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:01.842704 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7bd92b8-f69a-47da-978f-f2b5f26e0b60 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:01.843144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b7bd92b8-f69a-47da-978f-f2b5f26e0b60 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:01.970708 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b7bd92b8-f69a-47da-978f-f2b5f26e0b60 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:01.979389 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b7bd92b8-f69a-47da-978f-f2b5f26e0b60 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149461 Aug 04 04:56:01.979954 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 688/1366] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:01 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:02.135166 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-897619ff-4fb2-4305-a3a9-caa7d3f34d06 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:02.135789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-897619ff-4fb2-4305-a3a9-caa7d3f34d06 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:02.142276 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-897619ff-4fb2-4305-a3a9-caa7d3f34d06 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:02.142730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-897619ff-4fb2-4305-a3a9-caa7d3f34d06 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:02.143497 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-897619ff-4fb2-4305-a3a9-caa7d3f34d06 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:02.143940 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-897619ff-4fb2-4305-a3a9-caa7d3f34d06 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:02.207522 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-897619ff-4fb2-4305-a3a9-caa7d3f34d06 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:02.216180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-897619ff-4fb2-4305-a3a9-caa7d3f34d06 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084937 Aug 04 04:56:02.216738 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 679/1367] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:02 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:02.999807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9e8f35eb-016f-4b33-bf66-6663c96e1def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:03.000414 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9e8f35eb-016f-4b33-bf66-6663c96e1def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:03.006853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9e8f35eb-016f-4b33-bf66-6663c96e1def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:03.007299 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9e8f35eb-016f-4b33-bf66-6663c96e1def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:03.008056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9e8f35eb-016f-4b33-bf66-6663c96e1def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:03.008480 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9e8f35eb-016f-4b33-bf66-6663c96e1def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:03.136171 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9e8f35eb-016f-4b33-bf66-6663c96e1def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:03.143956 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9e8f35eb-016f-4b33-bf66-6663c96e1def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148098 Aug 04 04:56:03.144506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 689/1368] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:02 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:03.236090 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8349f70d-0792-467c-9caf-19c5747f9538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:03.236703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8349f70d-0792-467c-9caf-19c5747f9538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:03.243938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8349f70d-0792-467c-9caf-19c5747f9538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:03.244390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8349f70d-0792-467c-9caf-19c5747f9538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:03.245148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8349f70d-0792-467c-9caf-19c5747f9538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:03.245606 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8349f70d-0792-467c-9caf-19c5747f9538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:03.308840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8349f70d-0792-467c-9caf-19c5747f9538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:03.316766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8349f70d-0792-467c-9caf-19c5747f9538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084433 Aug 04 04:56:03.317321 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 680/1369] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:03 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:04.164594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0d922e65-3860-4390-a101-e051023196f9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:04.165208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0d922e65-3860-4390-a101-e051023196f9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:04.171901 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d922e65-3860-4390-a101-e051023196f9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:04.172345 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d922e65-3860-4390-a101-e051023196f9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:04.173097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d922e65-3860-4390-a101-e051023196f9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:04.173529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d922e65-3860-4390-a101-e051023196f9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:04.301727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0d922e65-3860-4390-a101-e051023196f9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:04.310371 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0d922e65-3860-4390-a101-e051023196f9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149729 Aug 04 04:56:04.310932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 690/1370] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:04 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:04.337307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3c941ebb-50ac-4174-92d4-63e9e44f8f8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:04.338571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3c941ebb-50ac-4174-92d4-63e9e44f8f8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:04.345104 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3c941ebb-50ac-4174-92d4-63e9e44f8f8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:04.345575 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3c941ebb-50ac-4174-92d4-63e9e44f8f8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:04.346421 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3c941ebb-50ac-4174-92d4-63e9e44f8f8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:04.346854 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3c941ebb-50ac-4174-92d4-63e9e44f8f8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:04.408036 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3c941ebb-50ac-4174-92d4-63e9e44f8f8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:04.416846 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3c941ebb-50ac-4174-92d4-63e9e44f8f8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083337 Aug 04 04:56:04.417409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 681/1371] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:04 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:05.332215 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f85de6b4-9718-4f25-b03e-6090fabb2501 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:05.332832 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f85de6b4-9718-4f25-b03e-6090fabb2501 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:05.340406 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f85de6b4-9718-4f25-b03e-6090fabb2501 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:05.340858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f85de6b4-9718-4f25-b03e-6090fabb2501 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:05.341654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f85de6b4-9718-4f25-b03e-6090fabb2501 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:05.342091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f85de6b4-9718-4f25-b03e-6090fabb2501 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:05.438573 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-889f3bbb-a4b5-4a8e-a9b5-6fb82ac08503 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:05.439181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-889f3bbb-a4b5-4a8e-a9b5-6fb82ac08503 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:05.446753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-889f3bbb-a4b5-4a8e-a9b5-6fb82ac08503 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:05.447201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-889f3bbb-a4b5-4a8e-a9b5-6fb82ac08503 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:05.447961 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-889f3bbb-a4b5-4a8e-a9b5-6fb82ac08503 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:05.448393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-889f3bbb-a4b5-4a8e-a9b5-6fb82ac08503 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:05.473073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f85de6b4-9718-4f25-b03e-6090fabb2501 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:05.481183 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f85de6b4-9718-4f25-b03e-6090fabb2501 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152853 Aug 04 04:56:05.481770 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 691/1372] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:05 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:05.514251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-889f3bbb-a4b5-4a8e-a9b5-6fb82ac08503 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:05.522116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-889f3bbb-a4b5-4a8e-a9b5-6fb82ac08503 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.087373 Aug 04 04:56:05.522666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 682/1373] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:05 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:06.502375 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-751fd4a2-fc04-4042-860f-357f66e7466e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:06.503027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-751fd4a2-fc04-4042-860f-357f66e7466e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:06.510820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-751fd4a2-fc04-4042-860f-357f66e7466e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:06.511304 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-751fd4a2-fc04-4042-860f-357f66e7466e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:06.512057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-751fd4a2-fc04-4042-860f-357f66e7466e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:06.512492 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-751fd4a2-fc04-4042-860f-357f66e7466e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:06.544282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d14f791c-2018-4632-a886-c5876d05ac94 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:06.544897 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d14f791c-2018-4632-a886-c5876d05ac94 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:06.551672 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d14f791c-2018-4632-a886-c5876d05ac94 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:06.552112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d14f791c-2018-4632-a886-c5876d05ac94 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:06.552876 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d14f791c-2018-4632-a886-c5876d05ac94 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:06.553316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d14f791c-2018-4632-a886-c5876d05ac94 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:06.634178 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d14f791c-2018-4632-a886-c5876d05ac94 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:06.642156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d14f791c-2018-4632-a886-c5876d05ac94 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.101760 Aug 04 04:56:06.642727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 683/1374] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:06 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:06.664996 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-751fd4a2-fc04-4042-860f-357f66e7466e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:06.673247 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-751fd4a2-fc04-4042-860f-357f66e7466e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.174903 Aug 04 04:56:06.673838 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 692/1375] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:06 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:07.663808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5b556ad3-09d7-4309-8762-77ccc30848c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:07.665170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5b556ad3-09d7-4309-8762-77ccc30848c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:07.671952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b556ad3-09d7-4309-8762-77ccc30848c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:07.672393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b556ad3-09d7-4309-8762-77ccc30848c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:07.673142 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b556ad3-09d7-4309-8762-77ccc30848c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:07.673607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b556ad3-09d7-4309-8762-77ccc30848c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:07.694573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7706c2d2-a213-4e22-a183-78d3ecb537fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:07.695217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7706c2d2-a213-4e22-a183-78d3ecb537fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:07.701570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7706c2d2-a213-4e22-a183-78d3ecb537fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:07.702040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7706c2d2-a213-4e22-a183-78d3ecb537fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:07.703614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7706c2d2-a213-4e22-a183-78d3ecb537fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:07.704266 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7706c2d2-a213-4e22-a183-78d3ecb537fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:07.735270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5b556ad3-09d7-4309-8762-77ccc30848c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:07.744292 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5b556ad3-09d7-4309-8762-77ccc30848c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084318 Aug 04 04:56:07.744862 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 684/1376] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:07 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:07.837312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7706c2d2-a213-4e22-a183-78d3ecb537fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:07.845141 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7706c2d2-a213-4e22-a183-78d3ecb537fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154344 Aug 04 04:56:07.845720 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 693/1377] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:07 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:08.764392 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b9ff033f-cd6a-469f-b87c-845e86fbfd88 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:08.765090 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b9ff033f-cd6a-469f-b87c-845e86fbfd88 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:08.771498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b9ff033f-cd6a-469f-b87c-845e86fbfd88 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:08.771940 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b9ff033f-cd6a-469f-b87c-845e86fbfd88 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:08.772699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b9ff033f-cd6a-469f-b87c-845e86fbfd88 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:08.773127 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b9ff033f-cd6a-469f-b87c-845e86fbfd88 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:08.778601 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:08.838002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b9ff033f-cd6a-469f-b87c-845e86fbfd88 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:08.846039 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b9ff033f-cd6a-469f-b87c-845e86fbfd88 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085443 Aug 04 04:56:08.846595 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 685/1378] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:08.866324 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-03d7527f-b574-4e6f-812b-e27ec83afc52 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:08.866980 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-03d7527f-b574-4e6f-812b-e27ec83afc52 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:08.874289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03d7527f-b574-4e6f-812b-e27ec83afc52 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:08.874775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03d7527f-b574-4e6f-812b-e27ec83afc52 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:08.875550 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03d7527f-b574-4e6f-812b-e27ec83afc52 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:08.875993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03d7527f-b574-4e6f-812b-e27ec83afc52 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:09.006236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-03d7527f-b574-4e6f-812b-e27ec83afc52 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:09.014754 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-03d7527f-b574-4e6f-812b-e27ec83afc52 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152296 Aug 04 04:56:09.015618 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 694/1379] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:08 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:09.867731 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-72c23d3e-90f2-4453-9ca8-58c7f817e505 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:09.868333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-72c23d3e-90f2-4453-9ca8-58c7f817e505 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:09.874963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72c23d3e-90f2-4453-9ca8-58c7f817e505 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:09.875414 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72c23d3e-90f2-4453-9ca8-58c7f817e505 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:09.876175 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72c23d3e-90f2-4453-9ca8-58c7f817e505 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:09.876618 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72c23d3e-90f2-4453-9ca8-58c7f817e505 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:09.939807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-72c23d3e-90f2-4453-9ca8-58c7f817e505 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:09.948161 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-72c23d3e-90f2-4453-9ca8-58c7f817e505 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084310 Aug 04 04:56:09.948718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 686/1380] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:09 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:10.036133 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a01c722b-bd1b-4775-89db-684358099002 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:10.036753 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a01c722b-bd1b-4775-89db-684358099002 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:10.043826 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a01c722b-bd1b-4775-89db-684358099002 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:10.044275 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a01c722b-bd1b-4775-89db-684358099002 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:10.045038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a01c722b-bd1b-4775-89db-684358099002 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:10.045471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a01c722b-bd1b-4775-89db-684358099002 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:10.174836 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a01c722b-bd1b-4775-89db-684358099002 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:10.183349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a01c722b-bd1b-4775-89db-684358099002 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151120 Aug 04 04:56:10.183907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 695/1381] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:10 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:10.969335 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f1436a2c-c039-448e-a8cc-715747aefba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:10.970046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f1436a2c-c039-448e-a8cc-715747aefba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:10.976531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1436a2c-c039-448e-a8cc-715747aefba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:10.976977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1436a2c-c039-448e-a8cc-715747aefba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:10.977819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1436a2c-c039-448e-a8cc-715747aefba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:10.978776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1436a2c-c039-448e-a8cc-715747aefba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:11.038551 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f1436a2c-c039-448e-a8cc-715747aefba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:11.047730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f1436a2c-c039-448e-a8cc-715747aefba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082204 Aug 04 04:56:11.048288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 687/1382] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:11.204723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f5d769fc-5541-4f0f-acc8-1251d42e2f13 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:11.205338 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f5d769fc-5541-4f0f-acc8-1251d42e2f13 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:11.211830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f5d769fc-5541-4f0f-acc8-1251d42e2f13 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:11.213115 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f5d769fc-5541-4f0f-acc8-1251d42e2f13 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:11.213951 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f5d769fc-5541-4f0f-acc8-1251d42e2f13 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:11.214392 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f5d769fc-5541-4f0f-acc8-1251d42e2f13 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:11.346727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f5d769fc-5541-4f0f-acc8-1251d42e2f13 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:11.355301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f5d769fc-5541-4f0f-acc8-1251d42e2f13 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154475 Aug 04 04:56:11.355865 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 696/1383] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:11 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:12.068785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-614956e6-2f79-44f9-ba7b-e59a8d0fea73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:12.069397 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-614956e6-2f79-44f9-ba7b-e59a8d0fea73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:12.075928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-614956e6-2f79-44f9-ba7b-e59a8d0fea73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:12.076375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-614956e6-2f79-44f9-ba7b-e59a8d0fea73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:12.077123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-614956e6-2f79-44f9-ba7b-e59a8d0fea73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:12.077572 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-614956e6-2f79-44f9-ba7b-e59a8d0fea73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:12.137498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-614956e6-2f79-44f9-ba7b-e59a8d0fea73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:12.145287 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-614956e6-2f79-44f9-ba7b-e59a8d0fea73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080350 Aug 04 04:56:12.145881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 688/1384] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:12 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:12.376622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8b101bcb-ffe3-4948-af00-a103a52c6eb0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:12.377171 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8b101bcb-ffe3-4948-af00-a103a52c6eb0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:12.383622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b101bcb-ffe3-4948-af00-a103a52c6eb0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:12.384191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b101bcb-ffe3-4948-af00-a103a52c6eb0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:12.384965 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b101bcb-ffe3-4948-af00-a103a52c6eb0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:12.385409 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b101bcb-ffe3-4948-af00-a103a52c6eb0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:12.400398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:12.512887 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8b101bcb-ffe3-4948-af00-a103a52c6eb0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:12.520855 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8b101bcb-ffe3-4948-af00-a103a52c6eb0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148275 Aug 04 04:56:12.521415 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 697/1385] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:12 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:13.167054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9364b8b2-f4f0-4a1f-8d9f-0cb42b18dafa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:13.167667 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9364b8b2-f4f0-4a1f-8d9f-0cb42b18dafa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:13.177128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9364b8b2-f4f0-4a1f-8d9f-0cb42b18dafa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:13.177605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9364b8b2-f4f0-4a1f-8d9f-0cb42b18dafa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:13.178375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9364b8b2-f4f0-4a1f-8d9f-0cb42b18dafa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:13.180095 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9364b8b2-f4f0-4a1f-8d9f-0cb42b18dafa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:13.253295 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9364b8b2-f4f0-4a1f-8d9f-0cb42b18dafa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:13.262366 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9364b8b2-f4f0-4a1f-8d9f-0cb42b18dafa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.099117 Aug 04 04:56:13.262939 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 689/1386] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:13 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:13.543160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9c1c30b1-18c4-4755-9e16-dfac39c8046a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:13.543772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9c1c30b1-18c4-4755-9e16-dfac39c8046a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:13.550548 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9c1c30b1-18c4-4755-9e16-dfac39c8046a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:13.550998 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9c1c30b1-18c4-4755-9e16-dfac39c8046a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:13.551760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9c1c30b1-18c4-4755-9e16-dfac39c8046a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:13.552197 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9c1c30b1-18c4-4755-9e16-dfac39c8046a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:13.681698 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9c1c30b1-18c4-4755-9e16-dfac39c8046a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:13.689459 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9c1c30b1-18c4-4755-9e16-dfac39c8046a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.150809 Aug 04 04:56:13.690050 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 698/1387] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:13 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:14.284363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-03f93241-d35c-483a-b5bd-62a7fae1a863 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:14.284981 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-03f93241-d35c-483a-b5bd-62a7fae1a863 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:14.291527 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03f93241-d35c-483a-b5bd-62a7fae1a863 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:14.291976 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03f93241-d35c-483a-b5bd-62a7fae1a863 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:14.292739 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03f93241-d35c-483a-b5bd-62a7fae1a863 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:14.293201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-03f93241-d35c-483a-b5bd-62a7fae1a863 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:14.356999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-03f93241-d35c-483a-b5bd-62a7fae1a863 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:14.364939 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-03f93241-d35c-483a-b5bd-62a7fae1a863 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084693 Aug 04 04:56:14.365493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 690/1388] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:14 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:14.710814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d5bef779-8e79-4a69-959c-3d095fc2e961 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:14.711332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d5bef779-8e79-4a69-959c-3d095fc2e961 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:14.718293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d5bef779-8e79-4a69-959c-3d095fc2e961 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:14.718735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d5bef779-8e79-4a69-959c-3d095fc2e961 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:14.719494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d5bef779-8e79-4a69-959c-3d095fc2e961 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:14.719918 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d5bef779-8e79-4a69-959c-3d095fc2e961 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:14.850763 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d5bef779-8e79-4a69-959c-3d095fc2e961 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:14.859292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d5bef779-8e79-4a69-959c-3d095fc2e961 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152434 Aug 04 04:56:14.859852 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 699/1389] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:14 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:15.386450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-651d9a28-29d7-4a19-9e06-2771007e685d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:15.387125 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-651d9a28-29d7-4a19-9e06-2771007e685d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:15.393458 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-651d9a28-29d7-4a19-9e06-2771007e685d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:15.393929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-651d9a28-29d7-4a19-9e06-2771007e685d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:15.394683 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-651d9a28-29d7-4a19-9e06-2771007e685d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:15.395112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-651d9a28-29d7-4a19-9e06-2771007e685d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:15.455401 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-651d9a28-29d7-4a19-9e06-2771007e685d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:15.463427 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-651d9a28-29d7-4a19-9e06-2771007e685d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081595 Aug 04 04:56:15.463977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 691/1390] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:15 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:15.880482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-205f0e2b-1ef4-4f16-9855-f1a23a552cc4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:15.881095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-205f0e2b-1ef4-4f16-9855-f1a23a552cc4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:15.887702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-205f0e2b-1ef4-4f16-9855-f1a23a552cc4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:15.888145 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-205f0e2b-1ef4-4f16-9855-f1a23a552cc4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:15.888900 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-205f0e2b-1ef4-4f16-9855-f1a23a552cc4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:15.889332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-205f0e2b-1ef4-4f16-9855-f1a23a552cc4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:16.015904 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-205f0e2b-1ef4-4f16-9855-f1a23a552cc4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:16.023840 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-205f0e2b-1ef4-4f16-9855-f1a23a552cc4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.147210 Aug 04 04:56:16.024408 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 700/1391] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:15 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:16.484393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2ca2cfda-f09d-451b-91e1-3ba56a810fe3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:16.485004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2ca2cfda-f09d-451b-91e1-3ba56a810fe3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:16.491603 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ca2cfda-f09d-451b-91e1-3ba56a810fe3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:16.492054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ca2cfda-f09d-451b-91e1-3ba56a810fe3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:16.492819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ca2cfda-f09d-451b-91e1-3ba56a810fe3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:16.493489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ca2cfda-f09d-451b-91e1-3ba56a810fe3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:16.558395 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2ca2cfda-f09d-451b-91e1-3ba56a810fe3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:16.566278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2ca2cfda-f09d-451b-91e1-3ba56a810fe3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085730 Aug 04 04:56:16.566829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 692/1392] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:16 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:17.044266 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8eae213d-4668-4261-9c5c-0059bbc76c38 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:17.044855 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8eae213d-4668-4261-9c5c-0059bbc76c38 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:17.051647 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8eae213d-4668-4261-9c5c-0059bbc76c38 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:17.052089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8eae213d-4668-4261-9c5c-0059bbc76c38 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:17.052845 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8eae213d-4668-4261-9c5c-0059bbc76c38 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:17.053279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8eae213d-4668-4261-9c5c-0059bbc76c38 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:17.183741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8eae213d-4668-4261-9c5c-0059bbc76c38 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:17.191620 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8eae213d-4668-4261-9c5c-0059bbc76c38 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151277 Aug 04 04:56:17.192185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 701/1393] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:17 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:17.588839 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d0384e46-daaa-43aa-ab38-4af140b0f3cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:17.589454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d0384e46-daaa-43aa-ab38-4af140b0f3cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:17.595966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d0384e46-daaa-43aa-ab38-4af140b0f3cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:17.596415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d0384e46-daaa-43aa-ab38-4af140b0f3cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:17.597176 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d0384e46-daaa-43aa-ab38-4af140b0f3cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:17.597679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d0384e46-daaa-43aa-ab38-4af140b0f3cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:17.659786 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d0384e46-daaa-43aa-ab38-4af140b0f3cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:17.667600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d0384e46-daaa-43aa-ab38-4af140b0f3cf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083715 Aug 04 04:56:17.668187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 693/1394] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:17 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:18.213228 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1a2f1f17-2a2b-4fb2-b4ae-a0db488adb70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:18.213869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1a2f1f17-2a2b-4fb2-b4ae-a0db488adb70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:18.220341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a2f1f17-2a2b-4fb2-b4ae-a0db488adb70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:18.220794 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a2f1f17-2a2b-4fb2-b4ae-a0db488adb70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:18.221574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a2f1f17-2a2b-4fb2-b4ae-a0db488adb70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:18.222020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a2f1f17-2a2b-4fb2-b4ae-a0db488adb70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:18.355197 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1a2f1f17-2a2b-4fb2-b4ae-a0db488adb70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:18.363061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1a2f1f17-2a2b-4fb2-b4ae-a0db488adb70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154472 Aug 04 04:56:18.363626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 702/1395] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:18 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:18.688948 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e6c945ca-2adc-4cf6-8fed-52de0e34bec3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:18.689661 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e6c945ca-2adc-4cf6-8fed-52de0e34bec3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:18.696165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6c945ca-2adc-4cf6-8fed-52de0e34bec3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:18.697259 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6c945ca-2adc-4cf6-8fed-52de0e34bec3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:18.698051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6c945ca-2adc-4cf6-8fed-52de0e34bec3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:18.698493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e6c945ca-2adc-4cf6-8fed-52de0e34bec3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:18.757623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e6c945ca-2adc-4cf6-8fed-52de0e34bec3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:18.766457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e6c945ca-2adc-4cf6-8fed-52de0e34bec3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082043 Aug 04 04:56:18.767020 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 694/1396] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:18 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:19.384804 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4e977d56-4bae-4a39-bb4c-888022259d37 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:19.385410 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4e977d56-4bae-4a39-bb4c-888022259d37 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:19.391897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e977d56-4bae-4a39-bb4c-888022259d37 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:19.392340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e977d56-4bae-4a39-bb4c-888022259d37 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:19.393095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e977d56-4bae-4a39-bb4c-888022259d37 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:19.393528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e977d56-4bae-4a39-bb4c-888022259d37 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:19.521248 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4e977d56-4bae-4a39-bb4c-888022259d37 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:19.529533 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4e977d56-4bae-4a39-bb4c-888022259d37 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149134 Aug 04 04:56:19.530114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 703/1397] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:19 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:19.787840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dfd77977-907d-45b3-abb3-9a3518d16d99 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:19.788452 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dfd77977-907d-45b3-abb3-9a3518d16d99 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:19.795705 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dfd77977-907d-45b3-abb3-9a3518d16d99 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:19.796159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dfd77977-907d-45b3-abb3-9a3518d16d99 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:19.797273 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dfd77977-907d-45b3-abb3-9a3518d16d99 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:19.797750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dfd77977-907d-45b3-abb3-9a3518d16d99 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:19.862339 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dfd77977-907d-45b3-abb3-9a3518d16d99 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:19.870513 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dfd77977-907d-45b3-abb3-9a3518d16d99 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086607 Aug 04 04:56:19.871074 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 695/1398] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:19 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:20.551031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-357ce267-f7ba-4c79-9782-553183367cc9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:20.551646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-357ce267-f7ba-4c79-9782-553183367cc9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:20.559341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-357ce267-f7ba-4c79-9782-553183367cc9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:20.559787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-357ce267-f7ba-4c79-9782-553183367cc9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:20.560582 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-357ce267-f7ba-4c79-9782-553183367cc9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:20.561023 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-357ce267-f7ba-4c79-9782-553183367cc9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:20.688547 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-357ce267-f7ba-4c79-9782-553183367cc9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:20.696994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-357ce267-f7ba-4c79-9782-553183367cc9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149197 Aug 04 04:56:20.697581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 704/1399] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:20 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:20.891231 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-711acd2c-e781-4c62-8ae4-a74a025ab327 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:20.891857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-711acd2c-e781-4c62-8ae4-a74a025ab327 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:20.898422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-711acd2c-e781-4c62-8ae4-a74a025ab327 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:20.898870 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-711acd2c-e781-4c62-8ae4-a74a025ab327 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:20.899856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-711acd2c-e781-4c62-8ae4-a74a025ab327 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:20.900443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-711acd2c-e781-4c62-8ae4-a74a025ab327 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:20.961997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-711acd2c-e781-4c62-8ae4-a74a025ab327 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:20.969986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-711acd2c-e781-4c62-8ae4-a74a025ab327 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082611 Aug 04 04:56:20.970541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 696/1400] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:20 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:21.718893 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7153119a-a48d-4c1e-be5a-e49c48545628 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:21.719536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7153119a-a48d-4c1e-be5a-e49c48545628 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:21.725985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7153119a-a48d-4c1e-be5a-e49c48545628 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:21.726465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7153119a-a48d-4c1e-be5a-e49c48545628 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:21.727215 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7153119a-a48d-4c1e-be5a-e49c48545628 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:21.727646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7153119a-a48d-4c1e-be5a-e49c48545628 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:21.857750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7153119a-a48d-4c1e-be5a-e49c48545628 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:21.865660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7153119a-a48d-4c1e-be5a-e49c48545628 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.150757 Aug 04 04:56:21.866222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 705/1401] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:21 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:21.991204 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d9c64820-7260-4299-963d-24a2c5b3fca6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:21.991819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d9c64820-7260-4299-963d-24a2c5b3fca6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:21.998419 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9c64820-7260-4299-963d-24a2c5b3fca6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:21.998877 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9c64820-7260-4299-963d-24a2c5b3fca6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:21.999642 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9c64820-7260-4299-963d-24a2c5b3fca6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:22.000078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9c64820-7260-4299-963d-24a2c5b3fca6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:22.061623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d9c64820-7260-4299-963d-24a2c5b3fca6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:22.069714 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d9c64820-7260-4299-963d-24a2c5b3fca6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082363 Aug 04 04:56:22.070267 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 697/1402] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:21 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:22.887439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3162a43c-78b9-4e6a-8b16-f7d2c603f945 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:22.888052 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3162a43c-78b9-4e6a-8b16-f7d2c603f945 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:22.894514 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3162a43c-78b9-4e6a-8b16-f7d2c603f945 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:22.894961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3162a43c-78b9-4e6a-8b16-f7d2c603f945 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:22.895715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3162a43c-78b9-4e6a-8b16-f7d2c603f945 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:22.896148 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3162a43c-78b9-4e6a-8b16-f7d2c603f945 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:23.023573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3162a43c-78b9-4e6a-8b16-f7d2c603f945 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:23.031672 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3162a43c-78b9-4e6a-8b16-f7d2c603f945 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148660 Aug 04 04:56:23.032246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 706/1403] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:22 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:23.090080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-35f6d05c-7411-4960-b8da-678d76cfdfb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:23.090710 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-35f6d05c-7411-4960-b8da-678d76cfdfb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:23.092964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:23.098263 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-35f6d05c-7411-4960-b8da-678d76cfdfb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:23.098706 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-35f6d05c-7411-4960-b8da-678d76cfdfb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:23.099462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-35f6d05c-7411-4960-b8da-678d76cfdfb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:23.099897 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-35f6d05c-7411-4960-b8da-678d76cfdfb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:23.164004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-35f6d05c-7411-4960-b8da-678d76cfdfb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:23.172753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-35f6d05c-7411-4960-b8da-678d76cfdfb1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086563 Aug 04 04:56:23.173295 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 698/1404] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:23 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:24.052559 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-99387228-8583-46bf-b948-6bd7324649eb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:24.053171 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-99387228-8583-46bf-b948-6bd7324649eb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:24.055561 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=54 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:24.061151 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99387228-8583-46bf-b948-6bd7324649eb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:24.061617 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99387228-8583-46bf-b948-6bd7324649eb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:24.062385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99387228-8583-46bf-b948-6bd7324649eb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:24.062814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99387228-8583-46bf-b948-6bd7324649eb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:24.194180 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-99387228-8583-46bf-b948-6bd7324649eb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:24.195845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1d130c09-9cfc-4345-9986-ccabf5c1dda2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:24.197192 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1d130c09-9cfc-4345-9986-ccabf5c1dda2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:24.203319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-99387228-8583-46bf-b948-6bd7324649eb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154635 Aug 04 04:56:24.203498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d130c09-9cfc-4345-9986-ccabf5c1dda2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:24.203765 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d130c09-9cfc-4345-9986-ccabf5c1dda2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:24.204647 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 707/1405] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:24 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:24.204797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d130c09-9cfc-4345-9986-ccabf5c1dda2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:24.204959 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d130c09-9cfc-4345-9986-ccabf5c1dda2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:24.266080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1d130c09-9cfc-4345-9986-ccabf5c1dda2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:24.273790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1d130c09-9cfc-4345-9986-ccabf5c1dda2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081684 Aug 04 04:56:24.274348 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 699/1406] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:24 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:25.225567 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-155ec11d-5a99-420b-843b-65edb7d5bb05 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:25.226161 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-155ec11d-5a99-420b-843b-65edb7d5bb05 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:25.233391 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-155ec11d-5a99-420b-843b-65edb7d5bb05 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:25.233865 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-155ec11d-5a99-420b-843b-65edb7d5bb05 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:25.234617 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-155ec11d-5a99-420b-843b-65edb7d5bb05 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:25.235046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-155ec11d-5a99-420b-843b-65edb7d5bb05 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:25.295697 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fccf01a1-2dee-4cb5-a3b1-d4cc8892241f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:25.296579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fccf01a1-2dee-4cb5-a3b1-d4cc8892241f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:25.303153 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fccf01a1-2dee-4cb5-a3b1-d4cc8892241f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:25.303603 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fccf01a1-2dee-4cb5-a3b1-d4cc8892241f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:25.304367 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fccf01a1-2dee-4cb5-a3b1-d4cc8892241f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:25.304802 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fccf01a1-2dee-4cb5-a3b1-d4cc8892241f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:25.373127 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-fccf01a1-2dee-4cb5-a3b1-d4cc8892241f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:25.380977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fccf01a1-2dee-4cb5-a3b1-d4cc8892241f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.089300 Aug 04 04:56:25.381554 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 700/1407] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:25 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:25.394891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-155ec11d-5a99-420b-843b-65edb7d5bb05 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:25.402902 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-155ec11d-5a99-420b-843b-65edb7d5bb05 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.181771 Aug 04 04:56:25.403452 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 708/1408] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:25 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:26.404186 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a1e1c159-55bc-4f3c-8945-643fbf7890fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:26.404808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a1e1c159-55bc-4f3c-8945-643fbf7890fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:26.411184 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1e1c159-55bc-4f3c-8945-643fbf7890fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:26.411632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1e1c159-55bc-4f3c-8945-643fbf7890fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:26.412391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1e1c159-55bc-4f3c-8945-643fbf7890fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:26.412863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1e1c159-55bc-4f3c-8945-643fbf7890fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:26.424918 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-02948dea-fef1-4354-962d-c12f4b5df74c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:26.425534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-02948dea-fef1-4354-962d-c12f4b5df74c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:26.433208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02948dea-fef1-4354-962d-c12f4b5df74c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:26.433688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02948dea-fef1-4354-962d-c12f4b5df74c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:26.434453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02948dea-fef1-4354-962d-c12f4b5df74c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:26.434882 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02948dea-fef1-4354-962d-c12f4b5df74c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:26.479055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a1e1c159-55bc-4f3c-8945-643fbf7890fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:26.481269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:26.488831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a1e1c159-55bc-4f3c-8945-643fbf7890fa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.090185 Aug 04 04:56:26.489591 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 701/1409] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:26 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:26.576255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-02948dea-fef1-4354-962d-c12f4b5df74c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:26.584414 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-02948dea-fef1-4354-962d-c12f4b5df74c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.163552 Aug 04 04:56:26.585003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 709/1410] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:26 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:27.511438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3abf26f2-baff-4c5e-8c37-ad1de0ae9917 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:27.512051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3abf26f2-baff-4c5e-8c37-ad1de0ae9917 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:27.518660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3abf26f2-baff-4c5e-8c37-ad1de0ae9917 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:27.519103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3abf26f2-baff-4c5e-8c37-ad1de0ae9917 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:27.519860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3abf26f2-baff-4c5e-8c37-ad1de0ae9917 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:27.520286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3abf26f2-baff-4c5e-8c37-ad1de0ae9917 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:27.583416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3abf26f2-baff-4c5e-8c37-ad1de0ae9917 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:27.592043 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3abf26f2-baff-4c5e-8c37-ad1de0ae9917 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085155 Aug 04 04:56:27.592610 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 702/1411] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:27 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:27.605941 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-12cff504-82fd-4f68-9573-1792b536a9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:27.606591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-12cff504-82fd-4f68-9573-1792b536a9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:27.613222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-12cff504-82fd-4f68-9573-1792b536a9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:27.613719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-12cff504-82fd-4f68-9573-1792b536a9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:27.614484 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-12cff504-82fd-4f68-9573-1792b536a9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:27.614923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-12cff504-82fd-4f68-9573-1792b536a9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:27.744846 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-12cff504-82fd-4f68-9573-1792b536a9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:27.755430 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-12cff504-82fd-4f68-9573-1792b536a9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.153728 Aug 04 04:56:27.756649 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 710/1412] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:27 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:28.613324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-37d60c38-3155-4784-b17c-613069f7a2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:28.613964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-37d60c38-3155-4784-b17c-613069f7a2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:28.621947 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37d60c38-3155-4784-b17c-613069f7a2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:28.622393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37d60c38-3155-4784-b17c-613069f7a2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:28.623153 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37d60c38-3155-4784-b17c-613069f7a2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:28.623584 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37d60c38-3155-4784-b17c-613069f7a2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:28.686196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-37d60c38-3155-4784-b17c-613069f7a2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:28.694787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-37d60c38-3155-4784-b17c-613069f7a2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085287 Aug 04 04:56:28.695351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 703/1413] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:28 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:28.777915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bab95ec0-9199-4acf-a079-2715efac1840 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:28.778467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bab95ec0-9199-4acf-a079-2715efac1840 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:28.785044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bab95ec0-9199-4acf-a079-2715efac1840 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:28.785492 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bab95ec0-9199-4acf-a079-2715efac1840 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:28.786281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bab95ec0-9199-4acf-a079-2715efac1840 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:28.786715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bab95ec0-9199-4acf-a079-2715efac1840 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:28.917977 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bab95ec0-9199-4acf-a079-2715efac1840 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:28.925944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bab95ec0-9199-4acf-a079-2715efac1840 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152550 Aug 04 04:56:28.926504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 711/1414] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:28 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:29.715584 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-54ab9a89-c077-42b5-9d8c-1a3327544acb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:29.716225 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-54ab9a89-c077-42b5-9d8c-1a3327544acb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:29.722734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-54ab9a89-c077-42b5-9d8c-1a3327544acb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:29.723177 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-54ab9a89-c077-42b5-9d8c-1a3327544acb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:29.723926 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-54ab9a89-c077-42b5-9d8c-1a3327544acb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:29.724355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-54ab9a89-c077-42b5-9d8c-1a3327544acb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:29.789625 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-54ab9a89-c077-42b5-9d8c-1a3327544acb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:29.798199 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-54ab9a89-c077-42b5-9d8c-1a3327544acb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086519 Aug 04 04:56:29.798761 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 704/1415] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:29 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:29.947195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4585bca2-2f47-4b63-bbb1-ede9a20bdff6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:29.947843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4585bca2-2f47-4b63-bbb1-ede9a20bdff6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:29.954336 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4585bca2-2f47-4b63-bbb1-ede9a20bdff6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:29.954784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4585bca2-2f47-4b63-bbb1-ede9a20bdff6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:29.955545 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4585bca2-2f47-4b63-bbb1-ede9a20bdff6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:29.955981 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4585bca2-2f47-4b63-bbb1-ede9a20bdff6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:30.083338 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4585bca2-2f47-4b63-bbb1-ede9a20bdff6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:30.091338 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4585bca2-2f47-4b63-bbb1-ede9a20bdff6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148183 Aug 04 04:56:30.091898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 712/1416] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:29 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:30.819923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d9ba0ff3-c843-400a-b0fa-06febf9fb982 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:30.820541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d9ba0ff3-c843-400a-b0fa-06febf9fb982 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:30.827899 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9ba0ff3-c843-400a-b0fa-06febf9fb982 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:30.828461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9ba0ff3-c843-400a-b0fa-06febf9fb982 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:30.829224 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9ba0ff3-c843-400a-b0fa-06febf9fb982 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:30.829693 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9ba0ff3-c843-400a-b0fa-06febf9fb982 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:30.892550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d9ba0ff3-c843-400a-b0fa-06febf9fb982 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:30.901230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d9ba0ff3-c843-400a-b0fa-06febf9fb982 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085233 Aug 04 04:56:30.901983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 705/1417] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:30 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:31.113005 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f2d76bbf-8941-41c5-a245-738b535ff662 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:31.113661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f2d76bbf-8941-41c5-a245-738b535ff662 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:31.120908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f2d76bbf-8941-41c5-a245-738b535ff662 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:31.121358 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f2d76bbf-8941-41c5-a245-738b535ff662 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:31.122158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f2d76bbf-8941-41c5-a245-738b535ff662 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:31.122597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f2d76bbf-8941-41c5-a245-738b535ff662 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:31.249985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f2d76bbf-8941-41c5-a245-738b535ff662 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:31.257915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f2d76bbf-8941-41c5-a245-738b535ff662 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148749 Aug 04 04:56:31.258487 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 713/1418] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:31 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:31.922609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9c23baba-b98a-4cc4-bf07-fc4c3e4b61b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:31.923218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9c23baba-b98a-4cc4-bf07-fc4c3e4b61b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:31.929631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c23baba-b98a-4cc4-bf07-fc4c3e4b61b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:31.930096 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c23baba-b98a-4cc4-bf07-fc4c3e4b61b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:31.931122 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c23baba-b98a-4cc4-bf07-fc4c3e4b61b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:31.931556 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c23baba-b98a-4cc4-bf07-fc4c3e4b61b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:31.991895 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9c23baba-b98a-4cc4-bf07-fc4c3e4b61b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:31.999907 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9c23baba-b98a-4cc4-bf07-fc4c3e4b61b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081418 Aug 04 04:56:32.000438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 706/1419] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:31 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:32.280343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4bf9baba-cbbe-4306-8520-eba1fb4a15fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:32.280956 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4bf9baba-cbbe-4306-8520-eba1fb4a15fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:32.287465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bf9baba-cbbe-4306-8520-eba1fb4a15fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:32.287909 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bf9baba-cbbe-4306-8520-eba1fb4a15fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:32.288666 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bf9baba-cbbe-4306-8520-eba1fb4a15fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:32.289101 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4bf9baba-cbbe-4306-8520-eba1fb4a15fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:32.291614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:32.425156 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4bf9baba-cbbe-4306-8520-eba1fb4a15fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:32.432987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4bf9baba-cbbe-4306-8520-eba1fb4a15fc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.156491 Aug 04 04:56:32.433570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 714/1420] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:32 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:33.020723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-666e5689-ab4c-4dee-a517-cefe24cf462f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:33.021314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-666e5689-ab4c-4dee-a517-cefe24cf462f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:33.027863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-666e5689-ab4c-4dee-a517-cefe24cf462f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:33.028306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-666e5689-ab4c-4dee-a517-cefe24cf462f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:33.029057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-666e5689-ab4c-4dee-a517-cefe24cf462f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:33.029486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-666e5689-ab4c-4dee-a517-cefe24cf462f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:33.089822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-666e5689-ab4c-4dee-a517-cefe24cf462f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:33.097624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-666e5689-ab4c-4dee-a517-cefe24cf462f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080782 Aug 04 04:56:33.098173 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 707/1421] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:33 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:33.455431 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-850915b8-874f-44e3-82f2-b41a7dcbc303 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:33.456042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-850915b8-874f-44e3-82f2-b41a7dcbc303 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:33.463457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-850915b8-874f-44e3-82f2-b41a7dcbc303 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:33.463909 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-850915b8-874f-44e3-82f2-b41a7dcbc303 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:33.464689 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-850915b8-874f-44e3-82f2-b41a7dcbc303 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:33.465125 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-850915b8-874f-44e3-82f2-b41a7dcbc303 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:33.595275 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-850915b8-874f-44e3-82f2-b41a7dcbc303 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:33.603756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-850915b8-874f-44e3-82f2-b41a7dcbc303 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152196 Aug 04 04:56:33.604315 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 715/1422] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:33 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:34.119149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f6087724-6b4a-44ca-9122-aa440acaeea5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:34.119863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f6087724-6b4a-44ca-9122-aa440acaeea5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:34.126315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6087724-6b4a-44ca-9122-aa440acaeea5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.126767 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6087724-6b4a-44ca-9122-aa440acaeea5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:34.127523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6087724-6b4a-44ca-9122-aa440acaeea5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.127956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6087724-6b4a-44ca-9122-aa440acaeea5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:34.194403 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f6087724-6b4a-44ca-9122-aa440acaeea5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:34.203122 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f6087724-6b4a-44ca-9122-aa440acaeea5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.088329 Aug 04 04:56:34.203679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 708/1423] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:34 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:34.624757 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f87744b0-6fe2-4408-9718-0a7c7ae7fc83 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:34.625369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f87744b0-6fe2-4408-9718-0a7c7ae7fc83 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:34.631866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f87744b0-6fe2-4408-9718-0a7c7ae7fc83 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.632314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f87744b0-6fe2-4408-9718-0a7c7ae7fc83 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:34.633067 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f87744b0-6fe2-4408-9718-0a7c7ae7fc83 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:34.633579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f87744b0-6fe2-4408-9718-0a7c7ae7fc83 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:34.763954 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f87744b0-6fe2-4408-9718-0a7c7ae7fc83 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:34.772225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f87744b0-6fe2-4408-9718-0a7c7ae7fc83 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151227 Aug 04 04:56:34.772793 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 716/1424] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:34 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:35.224050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d99f6c88-99d1-40dd-ae8f-2d94d329d895 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:35.224660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d99f6c88-99d1-40dd-ae8f-2d94d329d895 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:35.231451 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d99f6c88-99d1-40dd-ae8f-2d94d329d895 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:35.231901 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d99f6c88-99d1-40dd-ae8f-2d94d329d895 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:35.232659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d99f6c88-99d1-40dd-ae8f-2d94d329d895 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:35.233091 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d99f6c88-99d1-40dd-ae8f-2d94d329d895 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:35.294375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d99f6c88-99d1-40dd-ae8f-2d94d329d895 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:35.302557 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d99f6c88-99d1-40dd-ae8f-2d94d329d895 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082389 Aug 04 04:56:35.303116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 709/1425] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:35 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:35.924421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b1ad8c42-7513-4daf-87b8-09e1b8a6e3a9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:35.925067 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b1ad8c42-7513-4daf-87b8-09e1b8a6e3a9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:35.931881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1ad8c42-7513-4daf-87b8-09e1b8a6e3a9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:35.932331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1ad8c42-7513-4daf-87b8-09e1b8a6e3a9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:35.933092 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1ad8c42-7513-4daf-87b8-09e1b8a6e3a9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:35.933528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1ad8c42-7513-4daf-87b8-09e1b8a6e3a9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:36.063985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b1ad8c42-7513-4daf-87b8-09e1b8a6e3a9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:36.072079 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b1ad8c42-7513-4daf-87b8-09e1b8a6e3a9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.282335 Aug 04 04:56:36.072638 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 717/1426] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:35 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:36.324080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-87f6540b-4d10-45cf-a686-8e17901d3088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:36.324730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-87f6540b-4d10-45cf-a686-8e17901d3088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:36.331506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-87f6540b-4d10-45cf-a686-8e17901d3088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:36.331932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-87f6540b-4d10-45cf-a686-8e17901d3088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:36.332691 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-87f6540b-4d10-45cf-a686-8e17901d3088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:36.333124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-87f6540b-4d10-45cf-a686-8e17901d3088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:36.393084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-87f6540b-4d10-45cf-a686-8e17901d3088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:36.401518 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-87f6540b-4d10-45cf-a686-8e17901d3088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082231 Aug 04 04:56:36.402098 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 710/1427] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:36 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:37.092725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-03b44299-e3a8-478b-8efa-60d253e47ffc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:37.093336 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-03b44299-e3a8-478b-8efa-60d253e47ffc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:37.099940 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03b44299-e3a8-478b-8efa-60d253e47ffc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:37.100381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03b44299-e3a8-478b-8efa-60d253e47ffc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:37.101131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03b44299-e3a8-478b-8efa-60d253e47ffc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:37.101575 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03b44299-e3a8-478b-8efa-60d253e47ffc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:37.231969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-03b44299-e3a8-478b-8efa-60d253e47ffc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:37.239922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-03b44299-e3a8-478b-8efa-60d253e47ffc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151073 Aug 04 04:56:37.240480 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 718/1428] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:37 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:37.423993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0fc5b7a3-13b1-40be-bb55-4f8a63fe1db6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:37.424561 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0fc5b7a3-13b1-40be-bb55-4f8a63fe1db6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:37.431489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0fc5b7a3-13b1-40be-bb55-4f8a63fe1db6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:37.432041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0fc5b7a3-13b1-40be-bb55-4f8a63fe1db6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:37.432809 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0fc5b7a3-13b1-40be-bb55-4f8a63fe1db6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:37.433250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0fc5b7a3-13b1-40be-bb55-4f8a63fe1db6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:37.496489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0fc5b7a3-13b1-40be-bb55-4f8a63fe1db6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:37.504549 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0fc5b7a3-13b1-40be-bb55-4f8a63fe1db6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084799 Aug 04 04:56:37.505632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 711/1429] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:37 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:38.260255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ba03b447-2407-43a8-acd2-f51e9563fb94 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:38.260862 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ba03b447-2407-43a8-acd2-f51e9563fb94 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:38.267473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba03b447-2407-43a8-acd2-f51e9563fb94 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:38.267917 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba03b447-2407-43a8-acd2-f51e9563fb94 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:38.268678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba03b447-2407-43a8-acd2-f51e9563fb94 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:38.269114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba03b447-2407-43a8-acd2-f51e9563fb94 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:38.396343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ba03b447-2407-43a8-acd2-f51e9563fb94 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:38.404292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ba03b447-2407-43a8-acd2-f51e9563fb94 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.147964 Aug 04 04:56:38.404856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 719/1430] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:38 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:38.527006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-534a589f-b5a8-4e44-81b4-f79438066ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:38.527562 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-534a589f-b5a8-4e44-81b4-f79438066ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:38.534195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-534a589f-b5a8-4e44-81b4-f79438066ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:38.534650 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-534a589f-b5a8-4e44-81b4-f79438066ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:38.535442 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-534a589f-b5a8-4e44-81b4-f79438066ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:38.535885 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-534a589f-b5a8-4e44-81b4-f79438066ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:38.596311 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-534a589f-b5a8-4e44-81b4-f79438066ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:38.604378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-534a589f-b5a8-4e44-81b4-f79438066ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081970 Aug 04 04:56:38.604937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 712/1431] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:38 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:39.426655 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4e91c34f-80f1-41be-8016-73d32a03aafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:39.427273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4e91c34f-80f1-41be-8016-73d32a03aafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:39.437275 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e91c34f-80f1-41be-8016-73d32a03aafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:39.437882 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e91c34f-80f1-41be-8016-73d32a03aafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:39.438646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e91c34f-80f1-41be-8016-73d32a03aafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:39.439086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e91c34f-80f1-41be-8016-73d32a03aafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:39.572387 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4e91c34f-80f1-41be-8016-73d32a03aafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:39.580447 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4e91c34f-80f1-41be-8016-73d32a03aafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.158383 Aug 04 04:56:39.581025 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 720/1432] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:39 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:39.625398 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-48edb027-9e72-4229-a384-cb790c05a5b4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:39.626038 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-48edb027-9e72-4229-a384-cb790c05a5b4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:39.632439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48edb027-9e72-4229-a384-cb790c05a5b4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:39.632886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48edb027-9e72-4229-a384-cb790c05a5b4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:39.633669 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48edb027-9e72-4229-a384-cb790c05a5b4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:39.634641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48edb027-9e72-4229-a384-cb790c05a5b4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:39.694672 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-48edb027-9e72-4229-a384-cb790c05a5b4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:39.703287 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-48edb027-9e72-4229-a384-cb790c05a5b4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081721 Aug 04 04:56:39.703844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 713/1433] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:40.601963 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cdd4aa72-5dfd-4671-b4f0-aa583a330b6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:40.602645 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cdd4aa72-5dfd-4671-b4f0-aa583a330b6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:40.609086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cdd4aa72-5dfd-4671-b4f0-aa583a330b6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:40.609535 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cdd4aa72-5dfd-4671-b4f0-aa583a330b6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:40.610338 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cdd4aa72-5dfd-4671-b4f0-aa583a330b6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:40.610772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cdd4aa72-5dfd-4671-b4f0-aa583a330b6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:40.730284 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c0e7143c-98db-4117-bbd2-a688e072ba55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:40.730910 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c0e7143c-98db-4117-bbd2-a688e072ba55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:40.737337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c0e7143c-98db-4117-bbd2-a688e072ba55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:40.737834 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c0e7143c-98db-4117-bbd2-a688e072ba55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:40.738607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c0e7143c-98db-4117-bbd2-a688e072ba55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:40.739048 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c0e7143c-98db-4117-bbd2-a688e072ba55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:40.739328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-cdd4aa72-5dfd-4671-b4f0-aa583a330b6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:40.747851 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cdd4aa72-5dfd-4671-b4f0-aa583a330b6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149712 Aug 04 04:56:40.748404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 721/1434] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:40 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:40.804253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c0e7143c-98db-4117-bbd2-a688e072ba55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:40.813469 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c0e7143c-98db-4117-bbd2-a688e072ba55 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.087871 Aug 04 04:56:40.814053 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 714/1435] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:40 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:41.768741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fc6c3b2a-e072-4908-a3cb-e6e705afa5ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:41.769359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fc6c3b2a-e072-4908-a3cb-e6e705afa5ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:41.775856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc6c3b2a-e072-4908-a3cb-e6e705afa5ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:41.776307 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc6c3b2a-e072-4908-a3cb-e6e705afa5ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:41.777070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc6c3b2a-e072-4908-a3cb-e6e705afa5ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:41.777506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc6c3b2a-e072-4908-a3cb-e6e705afa5ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:41.834281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dd9a4251-9417-4b53-a42e-d51c04b3ffb4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:41.834902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dd9a4251-9417-4b53-a42e-d51c04b3ffb4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:41.841417 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dd9a4251-9417-4b53-a42e-d51c04b3ffb4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:41.841907 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dd9a4251-9417-4b53-a42e-d51c04b3ffb4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:41.842678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dd9a4251-9417-4b53-a42e-d51c04b3ffb4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:41.843118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dd9a4251-9417-4b53-a42e-d51c04b3ffb4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:41.907022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dd9a4251-9417-4b53-a42e-d51c04b3ffb4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:41.914859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dd9a4251-9417-4b53-a42e-d51c04b3ffb4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084506 Aug 04 04:56:41.915965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 715/1436] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:41 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:41.929783 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fc6c3b2a-e072-4908-a3cb-e6e705afa5ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:41.938503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fc6c3b2a-e072-4908-a3cb-e6e705afa5ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.173602 Aug 04 04:56:41.939074 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 722/1437] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:41 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:42.943161 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ef13a07c-091d-47f2-a3ec-bbf68526df0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:42.943807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ef13a07c-091d-47f2-a3ec-bbf68526df0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:42.950873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ef13a07c-091d-47f2-a3ec-bbf68526df0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:42.951325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ef13a07c-091d-47f2-a3ec-bbf68526df0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:42.952084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ef13a07c-091d-47f2-a3ec-bbf68526df0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:42.952519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ef13a07c-091d-47f2-a3ec-bbf68526df0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:42.959173 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8318d0a9-f577-4fa0-ba77-8e6029b229ab tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:42.959793 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8318d0a9-f577-4fa0-ba77-8e6029b229ab tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:42.967022 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8318d0a9-f577-4fa0-ba77-8e6029b229ab tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:42.967481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8318d0a9-f577-4fa0-ba77-8e6029b229ab tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:42.968261 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8318d0a9-f577-4fa0-ba77-8e6029b229ab tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:42.968696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8318d0a9-f577-4fa0-ba77-8e6029b229ab tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:43.015747 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ef13a07c-091d-47f2-a3ec-bbf68526df0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:43.023658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ef13a07c-091d-47f2-a3ec-bbf68526df0c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084401 Aug 04 04:56:43.024258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 716/1438] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:42 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:43.112634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8318d0a9-f577-4fa0-ba77-8e6029b229ab tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:43.120988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8318d0a9-f577-4fa0-ba77-8e6029b229ab tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.165655 Aug 04 04:56:43.121572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 723/1439] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:42 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:44.044875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3c73dfd5-57d0-4fc9-926a-5f846a4f124f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:44.045484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3c73dfd5-57d0-4fc9-926a-5f846a4f124f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:44.052189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3c73dfd5-57d0-4fc9-926a-5f846a4f124f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:44.052634 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3c73dfd5-57d0-4fc9-926a-5f846a4f124f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:44.053386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3c73dfd5-57d0-4fc9-926a-5f846a4f124f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:44.053844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3c73dfd5-57d0-4fc9-926a-5f846a4f124f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:44.113740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3c73dfd5-57d0-4fc9-926a-5f846a4f124f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:44.122089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3c73dfd5-57d0-4fc9-926a-5f846a4f124f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081091 Aug 04 04:56:44.122644 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 717/1440] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:44 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:44.143433 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d3d8d962-99cc-4884-a20d-d3cdf4f8bb2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:44.144084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d3d8d962-99cc-4884-a20d-d3cdf4f8bb2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:44.150741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3d8d962-99cc-4884-a20d-d3cdf4f8bb2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:44.151203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3d8d962-99cc-4884-a20d-d3cdf4f8bb2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:44.151971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3d8d962-99cc-4884-a20d-d3cdf4f8bb2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:44.152412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3d8d962-99cc-4884-a20d-d3cdf4f8bb2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:44.277434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d3d8d962-99cc-4884-a20d-d3cdf4f8bb2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:44.285310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d3d8d962-99cc-4884-a20d-d3cdf4f8bb2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.145727 Aug 04 04:56:44.286015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 724/1441] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:44 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:45.143294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-896d03ee-13dc-430d-9ea8-6cbce65685bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:45.143912 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-896d03ee-13dc-430d-9ea8-6cbce65685bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:45.150432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-896d03ee-13dc-430d-9ea8-6cbce65685bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:45.150886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-896d03ee-13dc-430d-9ea8-6cbce65685bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:45.151669 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-896d03ee-13dc-430d-9ea8-6cbce65685bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:45.152719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-896d03ee-13dc-430d-9ea8-6cbce65685bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:45.167336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:45.217066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-896d03ee-13dc-430d-9ea8-6cbce65685bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:45.225063 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-896d03ee-13dc-430d-9ea8-6cbce65685bd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085621 Aug 04 04:56:45.225647 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 718/1442] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:45 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:45.307774 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1d790472-0cd1-4a75-94b1-c926bd87fae8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:45.309450 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1d790472-0cd1-4a75-94b1-c926bd87fae8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:45.316087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1d790472-0cd1-4a75-94b1-c926bd87fae8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:45.316540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1d790472-0cd1-4a75-94b1-c926bd87fae8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:45.317300 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1d790472-0cd1-4a75-94b1-c926bd87fae8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:45.317771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1d790472-0cd1-4a75-94b1-c926bd87fae8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:45.446505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1d790472-0cd1-4a75-94b1-c926bd87fae8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:45.454711 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1d790472-0cd1-4a75-94b1-c926bd87fae8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.150861 Aug 04 04:56:45.455292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 725/1443] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:45 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:46.246398 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2639804f-5736-4833-ac9a-8d1b232fdf61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:46.247158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2639804f-5736-4833-ac9a-8d1b232fdf61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:46.253492 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2639804f-5736-4833-ac9a-8d1b232fdf61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:46.253968 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2639804f-5736-4833-ac9a-8d1b232fdf61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:46.254718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2639804f-5736-4833-ac9a-8d1b232fdf61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:46.255150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2639804f-5736-4833-ac9a-8d1b232fdf61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:46.317183 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2639804f-5736-4833-ac9a-8d1b232fdf61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:46.326439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2639804f-5736-4833-ac9a-8d1b232fdf61 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084348 Aug 04 04:56:46.327001 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 719/1444] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:46 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:46.476060 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3bb77883-c6a4-4d5a-aad8-ed87de7b360b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:46.476665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3bb77883-c6a4-4d5a-aad8-ed87de7b360b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:46.483854 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3bb77883-c6a4-4d5a-aad8-ed87de7b360b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:46.484298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3bb77883-c6a4-4d5a-aad8-ed87de7b360b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:46.485108 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3bb77883-c6a4-4d5a-aad8-ed87de7b360b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:46.485539 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3bb77883-c6a4-4d5a-aad8-ed87de7b360b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:46.617030 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3bb77883-c6a4-4d5a-aad8-ed87de7b360b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:46.624906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3bb77883-c6a4-4d5a-aad8-ed87de7b360b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152652 Aug 04 04:56:46.625472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 726/1445] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:46 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:47.347043 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-73cd064e-408d-4ff9-99cc-694c9288989a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:47.347685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-73cd064e-408d-4ff9-99cc-694c9288989a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:47.354154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73cd064e-408d-4ff9-99cc-694c9288989a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:47.354599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73cd064e-408d-4ff9-99cc-694c9288989a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:47.356011 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73cd064e-408d-4ff9-99cc-694c9288989a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:47.356437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73cd064e-408d-4ff9-99cc-694c9288989a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:47.416391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-73cd064e-408d-4ff9-99cc-694c9288989a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:47.425055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-73cd064e-408d-4ff9-99cc-694c9288989a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081877 Aug 04 04:56:47.425623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 720/1446] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:47 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:47.647008 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0dd4e5cb-f439-4226-ab95-ed4e6fe0d4b5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:47.647538 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0dd4e5cb-f439-4226-ab95-ed4e6fe0d4b5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:47.654781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0dd4e5cb-f439-4226-ab95-ed4e6fe0d4b5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:47.655223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0dd4e5cb-f439-4226-ab95-ed4e6fe0d4b5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:47.655984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0dd4e5cb-f439-4226-ab95-ed4e6fe0d4b5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:47.656417 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0dd4e5cb-f439-4226-ab95-ed4e6fe0d4b5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:47.786050 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0dd4e5cb-f439-4226-ab95-ed4e6fe0d4b5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:47.794843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0dd4e5cb-f439-4226-ab95-ed4e6fe0d4b5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151899 Aug 04 04:56:47.795397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 727/1447] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:47 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:48.446322 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1b6fc7d7-597b-4351-a7fa-3a6f6e524081 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:48.446931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1b6fc7d7-597b-4351-a7fa-3a6f6e524081 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:48.454172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1b6fc7d7-597b-4351-a7fa-3a6f6e524081 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:48.454619 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1b6fc7d7-597b-4351-a7fa-3a6f6e524081 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:48.455369 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1b6fc7d7-597b-4351-a7fa-3a6f6e524081 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:48.455803 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1b6fc7d7-597b-4351-a7fa-3a6f6e524081 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:48.518997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1b6fc7d7-597b-4351-a7fa-3a6f6e524081 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:48.527049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1b6fc7d7-597b-4351-a7fa-3a6f6e524081 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084538 Aug 04 04:56:48.527606 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 721/1448] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:48 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:48.815869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8eb4345a-57b1-46c5-919e-02f0ac8eb976 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:48.816487 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8eb4345a-57b1-46c5-919e-02f0ac8eb976 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:48.822980 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8eb4345a-57b1-46c5-919e-02f0ac8eb976 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:48.823428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8eb4345a-57b1-46c5-919e-02f0ac8eb976 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:48.824199 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8eb4345a-57b1-46c5-919e-02f0ac8eb976 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:48.824632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8eb4345a-57b1-46c5-919e-02f0ac8eb976 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:48.952642 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8eb4345a-57b1-46c5-919e-02f0ac8eb976 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:48.960397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8eb4345a-57b1-46c5-919e-02f0ac8eb976 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148441 Aug 04 04:56:48.960967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 728/1449] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:48 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:49.548891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9669a15a-46cf-41f2-8ad1-845783e5ba1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:49.549511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9669a15a-46cf-41f2-8ad1-845783e5ba1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:49.556077 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9669a15a-46cf-41f2-8ad1-845783e5ba1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:49.556534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9669a15a-46cf-41f2-8ad1-845783e5ba1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:49.557294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9669a15a-46cf-41f2-8ad1-845783e5ba1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:49.557765 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9669a15a-46cf-41f2-8ad1-845783e5ba1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:49.618231 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9669a15a-46cf-41f2-8ad1-845783e5ba1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:49.626735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9669a15a-46cf-41f2-8ad1-845783e5ba1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082011 Aug 04 04:56:49.627282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 722/1450] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:49 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:49.983874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ed47e4aa-0920-41a2-a094-c8a101d0f569 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:49.984488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ed47e4aa-0920-41a2-a094-c8a101d0f569 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:49.991032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ed47e4aa-0920-41a2-a094-c8a101d0f569 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:49.991487 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ed47e4aa-0920-41a2-a094-c8a101d0f569 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:49.992244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ed47e4aa-0920-41a2-a094-c8a101d0f569 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:49.992677 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ed47e4aa-0920-41a2-a094-c8a101d0f569 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:50.123271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ed47e4aa-0920-41a2-a094-c8a101d0f569 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:50.131239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ed47e4aa-0920-41a2-a094-c8a101d0f569 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152274 Aug 04 04:56:50.131796 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 729/1451] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:49 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:50.647076 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-efa14d1c-006d-467a-bd4d-759ed11b21b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:50.647687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-efa14d1c-006d-467a-bd4d-759ed11b21b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:50.654345 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-efa14d1c-006d-467a-bd4d-759ed11b21b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:50.654788 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-efa14d1c-006d-467a-bd4d-759ed11b21b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:50.655541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-efa14d1c-006d-467a-bd4d-759ed11b21b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:50.655974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-efa14d1c-006d-467a-bd4d-759ed11b21b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:50.715928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-efa14d1c-006d-467a-bd4d-759ed11b21b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:50.723758 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-efa14d1c-006d-467a-bd4d-759ed11b21b9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080543 Aug 04 04:56:50.724309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 723/1452] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:50 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:51.152351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-50f880c7-82b4-474e-92f0-53dd8fb7d092 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:51.152961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-50f880c7-82b4-474e-92f0-53dd8fb7d092 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:51.159423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-50f880c7-82b4-474e-92f0-53dd8fb7d092 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:51.159869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-50f880c7-82b4-474e-92f0-53dd8fb7d092 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:51.160622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-50f880c7-82b4-474e-92f0-53dd8fb7d092 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:51.161053 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-50f880c7-82b4-474e-92f0-53dd8fb7d092 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:51.288345 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-50f880c7-82b4-474e-92f0-53dd8fb7d092 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:51.290565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:51.298587 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-50f880c7-82b4-474e-92f0-53dd8fb7d092 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.150141 Aug 04 04:56:51.299151 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 730/1453] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:51 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:51.744977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-754e40b2-d03f-4ca7-b93e-c07d6e0d3c2a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:51.745700 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-754e40b2-d03f-4ca7-b93e-c07d6e0d3c2a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:51.752180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-754e40b2-d03f-4ca7-b93e-c07d6e0d3c2a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:51.752627 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-754e40b2-d03f-4ca7-b93e-c07d6e0d3c2a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:51.753377 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-754e40b2-d03f-4ca7-b93e-c07d6e0d3c2a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:51.753834 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-754e40b2-d03f-4ca7-b93e-c07d6e0d3c2a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:51.816649 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-754e40b2-d03f-4ca7-b93e-c07d6e0d3c2a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:51.825132 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-754e40b2-d03f-4ca7-b93e-c07d6e0d3c2a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083996 Aug 04 04:56:51.825717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 724/1454] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:51 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:52.319958 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ec2dfb81-5cb6-4f26-aeb6-49f44c03dc4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:52.320611 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ec2dfb81-5cb6-4f26-aeb6-49f44c03dc4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:52.328086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ec2dfb81-5cb6-4f26-aeb6-49f44c03dc4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:52.328536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ec2dfb81-5cb6-4f26-aeb6-49f44c03dc4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:52.329301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ec2dfb81-5cb6-4f26-aeb6-49f44c03dc4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:52.329771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ec2dfb81-5cb6-4f26-aeb6-49f44c03dc4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:52.458420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ec2dfb81-5cb6-4f26-aeb6-49f44c03dc4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:52.466423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ec2dfb81-5cb6-4f26-aeb6-49f44c03dc4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.150318 Aug 04 04:56:52.466981 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 731/1455] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:52 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:52.846055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6eb7698c-f198-4d49-a1fa-1eb6a00a66b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:52.846668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6eb7698c-f198-4d49-a1fa-1eb6a00a66b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:52.853087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6eb7698c-f198-4d49-a1fa-1eb6a00a66b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:52.853536 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6eb7698c-f198-4d49-a1fa-1eb6a00a66b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:52.854317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6eb7698c-f198-4d49-a1fa-1eb6a00a66b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:52.854753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6eb7698c-f198-4d49-a1fa-1eb6a00a66b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:52.915603 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6eb7698c-f198-4d49-a1fa-1eb6a00a66b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:52.923920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6eb7698c-f198-4d49-a1fa-1eb6a00a66b8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081710 Aug 04 04:56:52.924472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 725/1456] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:52 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:53.487221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-273359f0-4797-45af-8cb7-f34de263930b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:53.487839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-273359f0-4797-45af-8cb7-f34de263930b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:53.494129 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-273359f0-4797-45af-8cb7-f34de263930b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:53.494579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-273359f0-4797-45af-8cb7-f34de263930b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:53.495641 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-273359f0-4797-45af-8cb7-f34de263930b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:53.496395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-273359f0-4797-45af-8cb7-f34de263930b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:53.626362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-273359f0-4797-45af-8cb7-f34de263930b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:53.634149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-273359f0-4797-45af-8cb7-f34de263930b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.150905 Aug 04 04:56:53.634703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 732/1457] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:53 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:53.945183 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d3baf85f-6dc6-45a4-87d0-95ac7e8abf38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:53.945850 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d3baf85f-6dc6-45a4-87d0-95ac7e8abf38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:53.948105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=56 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:53.954278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d3baf85f-6dc6-45a4-87d0-95ac7e8abf38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:53.954723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d3baf85f-6dc6-45a4-87d0-95ac7e8abf38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:53.955472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d3baf85f-6dc6-45a4-87d0-95ac7e8abf38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:53.955906 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d3baf85f-6dc6-45a4-87d0-95ac7e8abf38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:54.016065 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d3baf85f-6dc6-45a4-87d0-95ac7e8abf38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:54.024039 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d3baf85f-6dc6-45a4-87d0-95ac7e8abf38 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082686 Aug 04 04:56:54.024525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 726/1458] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:53 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:54.655728 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d5244016-d865-4be9-8b96-b026275797b7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:54.656345 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d5244016-d865-4be9-8b96-b026275797b7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:54.658667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=52 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:56:54.663899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d5244016-d865-4be9-8b96-b026275797b7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:54.664356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d5244016-d865-4be9-8b96-b026275797b7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:54.665116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d5244016-d865-4be9-8b96-b026275797b7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:54.665606 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d5244016-d865-4be9-8b96-b026275797b7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:54.795028 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d5244016-d865-4be9-8b96-b026275797b7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:54.803186 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d5244016-d865-4be9-8b96-b026275797b7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151636 Aug 04 04:56:54.803766 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 733/1459] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:54 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:55.053975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0d292e1e-bdc4-4e03-b618-0039d4abbd32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:55.054517 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0d292e1e-bdc4-4e03-b618-0039d4abbd32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:55.061190 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d292e1e-bdc4-4e03-b618-0039d4abbd32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:55.061663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d292e1e-bdc4-4e03-b618-0039d4abbd32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:55.062419 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d292e1e-bdc4-4e03-b618-0039d4abbd32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:55.062856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d292e1e-bdc4-4e03-b618-0039d4abbd32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:55.126094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0d292e1e-bdc4-4e03-b618-0039d4abbd32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:55.134007 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0d292e1e-bdc4-4e03-b618-0039d4abbd32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083967 Aug 04 04:56:55.134560 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 727/1460] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:55 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:55.824760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b42d1c3e-776e-4b7c-a5f9-1fcc13f6165b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:55.825376 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b42d1c3e-776e-4b7c-a5f9-1fcc13f6165b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:55.831857 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b42d1c3e-776e-4b7c-a5f9-1fcc13f6165b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:55.832304 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b42d1c3e-776e-4b7c-a5f9-1fcc13f6165b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:55.833055 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b42d1c3e-776e-4b7c-a5f9-1fcc13f6165b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:55.833484 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b42d1c3e-776e-4b7c-a5f9-1fcc13f6165b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:55.962683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b42d1c3e-776e-4b7c-a5f9-1fcc13f6165b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:55.971158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b42d1c3e-776e-4b7c-a5f9-1fcc13f6165b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.150284 Aug 04 04:56:55.971714 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 734/1461] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:55 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:56.155982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9d47bbbc-7b72-45d0-b331-e7bca65f1c0e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:56.156601 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9d47bbbc-7b72-45d0-b331-e7bca65f1c0e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:56.163133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d47bbbc-7b72-45d0-b331-e7bca65f1c0e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:56.163587 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d47bbbc-7b72-45d0-b331-e7bca65f1c0e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:56.164378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d47bbbc-7b72-45d0-b331-e7bca65f1c0e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:56.164820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d47bbbc-7b72-45d0-b331-e7bca65f1c0e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:56.225616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9d47bbbc-7b72-45d0-b331-e7bca65f1c0e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:56.234034 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9d47bbbc-7b72-45d0-b331-e7bca65f1c0e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082697 Aug 04 04:56:56.234600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 728/1462] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:56 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:56.992682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bcb5bbb7-3cc3-45ca-883d-155be6bf3a71 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:56.993279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bcb5bbb7-3cc3-45ca-883d-155be6bf3a71 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:57.000537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bcb5bbb7-3cc3-45ca-883d-155be6bf3a71 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:57.000978 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bcb5bbb7-3cc3-45ca-883d-155be6bf3a71 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:57.001765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bcb5bbb7-3cc3-45ca-883d-155be6bf3a71 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:57.002223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bcb5bbb7-3cc3-45ca-883d-155be6bf3a71 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:57.130986 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bcb5bbb7-3cc3-45ca-883d-155be6bf3a71 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:57.138854 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bcb5bbb7-3cc3-45ca-883d-155be6bf3a71 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.150008 Aug 04 04:56:57.139425 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 735/1463] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:56 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:57.254334 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4f792992-0548-4f15-a9e5-761a93257e3c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:57.254898 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4f792992-0548-4f15-a9e5-761a93257e3c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:57.261337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f792992-0548-4f15-a9e5-761a93257e3c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:57.261823 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f792992-0548-4f15-a9e5-761a93257e3c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:57.262590 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f792992-0548-4f15-a9e5-761a93257e3c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:57.263029 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f792992-0548-4f15-a9e5-761a93257e3c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:57.323419 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4f792992-0548-4f15-a9e5-761a93257e3c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:57.331451 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4f792992-0548-4f15-a9e5-761a93257e3c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080985 Aug 04 04:56:57.332015 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 729/1464] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:57 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:56:58.159935 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5984977c-f713-4427-981c-75990fe6a69b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:58.160579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5984977c-f713-4427-981c-75990fe6a69b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:58.167195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5984977c-f713-4427-981c-75990fe6a69b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:58.167744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5984977c-f713-4427-981c-75990fe6a69b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:58.168510 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5984977c-f713-4427-981c-75990fe6a69b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:58.168950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5984977c-f713-4427-981c-75990fe6a69b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:58.299478 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5984977c-f713-4427-981c-75990fe6a69b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:58.307334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5984977c-f713-4427-981c-75990fe6a69b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151253 Aug 04 04:56:58.308065 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 736/1465] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:58 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:58.352108 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f49bfffc-0bdc-4e0d-8833-d551242599d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:58.352789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f49bfffc-0bdc-4e0d-8833-d551242599d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:58.359352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f49bfffc-0bdc-4e0d-8833-d551242599d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:58.359870 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f49bfffc-0bdc-4e0d-8833-d551242599d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:58.360548 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f49bfffc-0bdc-4e0d-8833-d551242599d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:58.360978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f49bfffc-0bdc-4e0d-8833-d551242599d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:58.426427 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f49bfffc-0bdc-4e0d-8833-d551242599d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:58.434211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f49bfffc-0bdc-4e0d-8833-d551242599d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085904 Aug 04 04:56:58.434766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 730/1466] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:58 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:59.329161 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-30de4683-23ba-4d82-99af-6e0d69a76da0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:59.329815 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-30de4683-23ba-4d82-99af-6e0d69a76da0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:59.336351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-30de4683-23ba-4d82-99af-6e0d69a76da0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:59.336811 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-30de4683-23ba-4d82-99af-6e0d69a76da0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:59.337635 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-30de4683-23ba-4d82-99af-6e0d69a76da0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:59.338078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-30de4683-23ba-4d82-99af-6e0d69a76da0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:59.455104 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b3ea8790-2c51-4554-915b-675309c3edeb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:56:59.455719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b3ea8790-2c51-4554-915b-675309c3edeb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:56:59.462181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b3ea8790-2c51-4554-915b-675309c3edeb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:59.462629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b3ea8790-2c51-4554-915b-675309c3edeb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:59.463387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b3ea8790-2c51-4554-915b-675309c3edeb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:56:59.463817 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b3ea8790-2c51-4554-915b-675309c3edeb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:56:59.469293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-30de4683-23ba-4d82-99af-6e0d69a76da0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:59.477223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-30de4683-23ba-4d82-99af-6e0d69a76da0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152167 Aug 04 04:56:59.477836 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 737/1467] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:59 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:56:59.525666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b3ea8790-2c51-4554-915b-675309c3edeb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:56:59.533860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b3ea8790-2c51-4554-915b-675309c3edeb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082582 Aug 04 04:56:59.534289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 731/1468] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:56:59 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:00.499261 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-03431098-cd66-4aa0-bcc2-b2db36bb15c0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:00.499888 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-03431098-cd66-4aa0-bcc2-b2db36bb15c0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:00.506562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03431098-cd66-4aa0-bcc2-b2db36bb15c0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:00.507016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03431098-cd66-4aa0-bcc2-b2db36bb15c0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:00.507824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03431098-cd66-4aa0-bcc2-b2db36bb15c0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:00.508326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03431098-cd66-4aa0-bcc2-b2db36bb15c0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:00.554473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b5288923-96a2-4b30-8a5c-7efc14048151 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:00.555110 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b5288923-96a2-4b30-8a5c-7efc14048151 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:00.562563 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b5288923-96a2-4b30-8a5c-7efc14048151 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:00.563016 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b5288923-96a2-4b30-8a5c-7efc14048151 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:00.563774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b5288923-96a2-4b30-8a5c-7efc14048151 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:00.564212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b5288923-96a2-4b30-8a5c-7efc14048151 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:00.637498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b5288923-96a2-4b30-8a5c-7efc14048151 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:00.645388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b5288923-96a2-4b30-8a5c-7efc14048151 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.094737 Aug 04 04:57:00.645979 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 732/1469] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:00 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:00.664731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-03431098-cd66-4aa0-bcc2-b2db36bb15c0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:00.673772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-03431098-cd66-4aa0-bcc2-b2db36bb15c0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.179168 Aug 04 04:57:00.674274 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 738/1470] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:00 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:01.666498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fca96250-49f5-4a66-b36b-1c73b2d9c79e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:01.667117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fca96250-49f5-4a66-b36b-1c73b2d9c79e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:01.674034 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fca96250-49f5-4a66-b36b-1c73b2d9c79e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:01.674490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fca96250-49f5-4a66-b36b-1c73b2d9c79e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:01.675263 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fca96250-49f5-4a66-b36b-1c73b2d9c79e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:01.675708 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fca96250-49f5-4a66-b36b-1c73b2d9c79e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:01.695249 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8e7495e2-bf26-4f03-877d-0f4d1f678a51 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:01.695857 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8e7495e2-bf26-4f03-877d-0f4d1f678a51 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:01.703051 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8e7495e2-bf26-4f03-877d-0f4d1f678a51 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:01.703494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8e7495e2-bf26-4f03-877d-0f4d1f678a51 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:01.704256 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8e7495e2-bf26-4f03-877d-0f4d1f678a51 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:01.704690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8e7495e2-bf26-4f03-877d-0f4d1f678a51 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:01.737124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-fca96250-49f5-4a66-b36b-1c73b2d9c79e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:01.745077 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fca96250-49f5-4a66-b36b-1c73b2d9c79e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082435 Aug 04 04:57:01.746454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 733/1471] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:01 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:01.834708 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8e7495e2-bf26-4f03-877d-0f4d1f678a51 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:01.842684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8e7495e2-bf26-4f03-877d-0f4d1f678a51 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151318 Aug 04 04:57:01.843236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 739/1472] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:01 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:02.767404 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d74feb7b-1ed7-4041-b06e-3be86b13c08d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:02.767942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d74feb7b-1ed7-4041-b06e-3be86b13c08d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:02.774504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d74feb7b-1ed7-4041-b06e-3be86b13c08d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:02.775056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d74feb7b-1ed7-4041-b06e-3be86b13c08d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:02.776063 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d74feb7b-1ed7-4041-b06e-3be86b13c08d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:02.776497 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d74feb7b-1ed7-4041-b06e-3be86b13c08d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:02.837843 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d74feb7b-1ed7-4041-b06e-3be86b13c08d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:02.845982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d74feb7b-1ed7-4041-b06e-3be86b13c08d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082490 Aug 04 04:57:02.846532 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 734/1473] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:02 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:02.863268 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-93b47f7d-4f16-4df4-bbb5-ddf1f964ab5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:02.863886 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-93b47f7d-4f16-4df4-bbb5-ddf1f964ab5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:02.870408 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-93b47f7d-4f16-4df4-bbb5-ddf1f964ab5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:02.871587 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-93b47f7d-4f16-4df4-bbb5-ddf1f964ab5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:02.872369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-93b47f7d-4f16-4df4-bbb5-ddf1f964ab5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:02.872805 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-93b47f7d-4f16-4df4-bbb5-ddf1f964ab5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:03.000334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-93b47f7d-4f16-4df4-bbb5-ddf1f964ab5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:03.008246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-93b47f7d-4f16-4df4-bbb5-ddf1f964ab5c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148854 Aug 04 04:57:03.008817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 740/1474] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:02 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:03.867008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a0ba77fb-a403-425c-892e-adb22073070e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:03.867629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a0ba77fb-a403-425c-892e-adb22073070e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:03.874794 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0ba77fb-a403-425c-892e-adb22073070e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:03.875246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0ba77fb-a403-425c-892e-adb22073070e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:03.876012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0ba77fb-a403-425c-892e-adb22073070e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:03.876448 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0ba77fb-a403-425c-892e-adb22073070e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:03.879025 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:03.938062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a0ba77fb-a403-425c-892e-adb22073070e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:03.945892 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a0ba77fb-a403-425c-892e-adb22073070e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082705 Aug 04 04:57:03.946447 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 735/1475] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:03 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:04.030332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f4bf9791-4994-45fe-854c-7ed27b0203dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:04.030878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f4bf9791-4994-45fe-854c-7ed27b0203dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:04.037310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4bf9791-4994-45fe-854c-7ed27b0203dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:04.037796 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4bf9791-4994-45fe-854c-7ed27b0203dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:04.038570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4bf9791-4994-45fe-854c-7ed27b0203dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:04.039007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4bf9791-4994-45fe-854c-7ed27b0203dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:04.170687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f4bf9791-4994-45fe-854c-7ed27b0203dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:04.178763 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f4bf9791-4994-45fe-854c-7ed27b0203dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.153124 Aug 04 04:57:04.179328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 741/1476] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:04 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:04.967505 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-253e5271-8909-4835-80d4-83cecbe5c8af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:04.968126 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-253e5271-8909-4835-80d4-83cecbe5c8af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:04.974659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-253e5271-8909-4835-80d4-83cecbe5c8af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:04.975106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-253e5271-8909-4835-80d4-83cecbe5c8af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:04.975868 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-253e5271-8909-4835-80d4-83cecbe5c8af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:04.976307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-253e5271-8909-4835-80d4-83cecbe5c8af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:05.044803 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-253e5271-8909-4835-80d4-83cecbe5c8af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:05.052961 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-253e5271-8909-4835-80d4-83cecbe5c8af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.089639 Aug 04 04:57:05.053522 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 736/1477] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:04 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:05.200939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-235da7c3-8238-46d9-860d-cc39f9398c0a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:05.201570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-235da7c3-8238-46d9-860d-cc39f9398c0a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:05.208075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-235da7c3-8238-46d9-860d-cc39f9398c0a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:05.208527 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-235da7c3-8238-46d9-860d-cc39f9398c0a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:05.209281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-235da7c3-8238-46d9-860d-cc39f9398c0a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:05.209750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-235da7c3-8238-46d9-860d-cc39f9398c0a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:05.341350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-235da7c3-8238-46d9-860d-cc39f9398c0a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:05.349453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-235da7c3-8238-46d9-860d-cc39f9398c0a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152370 Aug 04 04:57:05.350059 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 742/1478] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:05 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:06.075821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-389c4957-184c-4bdc-a14d-38cce89101d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:06.076463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-389c4957-184c-4bdc-a14d-38cce89101d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:06.083096 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-389c4957-184c-4bdc-a14d-38cce89101d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:06.083564 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-389c4957-184c-4bdc-a14d-38cce89101d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:06.084397 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-389c4957-184c-4bdc-a14d-38cce89101d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:06.084832 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-389c4957-184c-4bdc-a14d-38cce89101d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:06.149672 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-389c4957-184c-4bdc-a14d-38cce89101d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:06.163062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-389c4957-184c-4bdc-a14d-38cce89101d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.091557 Aug 04 04:57:06.163658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 737/1479] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:06 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:06.371454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-247d8af7-3e78-4493-98e8-af071b7fea63 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:06.372129 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-247d8af7-3e78-4493-98e8-af071b7fea63 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:06.378514 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-247d8af7-3e78-4493-98e8-af071b7fea63 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:06.378969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-247d8af7-3e78-4493-98e8-af071b7fea63 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:06.379729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-247d8af7-3e78-4493-98e8-af071b7fea63 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:06.380161 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-247d8af7-3e78-4493-98e8-af071b7fea63 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:06.510660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-247d8af7-3e78-4493-98e8-af071b7fea63 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:06.518670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-247d8af7-3e78-4493-98e8-af071b7fea63 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151830 Aug 04 04:57:06.519230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 743/1480] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:06 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:07.186324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f19dd66e-fe33-4cce-afad-ac5609b82c10 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:07.186972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f19dd66e-fe33-4cce-afad-ac5609b82c10 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:07.193472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f19dd66e-fe33-4cce-afad-ac5609b82c10 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:07.193962 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f19dd66e-fe33-4cce-afad-ac5609b82c10 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:07.194730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f19dd66e-fe33-4cce-afad-ac5609b82c10 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:07.195170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f19dd66e-fe33-4cce-afad-ac5609b82c10 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:07.255265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f19dd66e-fe33-4cce-afad-ac5609b82c10 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:07.264217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f19dd66e-fe33-4cce-afad-ac5609b82c10 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082365 Aug 04 04:57:07.264788 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 738/1481] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:07 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:07.539323 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5f6e1311-9287-43c7-af24-71639a11a734 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:07.539935 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5f6e1311-9287-43c7-af24-71639a11a734 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:07.547275 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f6e1311-9287-43c7-af24-71639a11a734 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:07.547720 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f6e1311-9287-43c7-af24-71639a11a734 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:07.548474 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f6e1311-9287-43c7-af24-71639a11a734 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:07.548905 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f6e1311-9287-43c7-af24-71639a11a734 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:07.678403 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5f6e1311-9287-43c7-af24-71639a11a734 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:07.686848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5f6e1311-9287-43c7-af24-71639a11a734 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151484 Aug 04 04:57:07.687412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 744/1482] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:07 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:08.285182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-49b46f44-966f-4f0e-b97b-bb7e1772bff9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:08.285832 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-49b46f44-966f-4f0e-b97b-bb7e1772bff9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:08.292977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49b46f44-966f-4f0e-b97b-bb7e1772bff9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:08.293444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49b46f44-966f-4f0e-b97b-bb7e1772bff9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:08.294241 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49b46f44-966f-4f0e-b97b-bb7e1772bff9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:08.294679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49b46f44-966f-4f0e-b97b-bb7e1772bff9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:08.354670 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-49b46f44-966f-4f0e-b97b-bb7e1772bff9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:08.363266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-49b46f44-966f-4f0e-b97b-bb7e1772bff9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082329 Aug 04 04:57:08.363901 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 739/1483] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:08.707737 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-99410465-5b99-454f-901b-83b4468e7885 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:08.708459 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-99410465-5b99-454f-901b-83b4468e7885 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:08.715745 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99410465-5b99-454f-901b-83b4468e7885 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:08.716185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99410465-5b99-454f-901b-83b4468e7885 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:08.716944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99410465-5b99-454f-901b-83b4468e7885 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:08.717378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99410465-5b99-454f-901b-83b4468e7885 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:08.850143 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-99410465-5b99-454f-901b-83b4468e7885 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:08.858076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-99410465-5b99-454f-901b-83b4468e7885 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154219 Aug 04 04:57:08.858629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 745/1484] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:08 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:09.384865 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5b3ee2dc-48b0-4e4d-a392-da93b0e4996c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:09.385492 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5b3ee2dc-48b0-4e4d-a392-da93b0e4996c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:09.392954 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b3ee2dc-48b0-4e4d-a392-da93b0e4996c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:09.393409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b3ee2dc-48b0-4e4d-a392-da93b0e4996c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:09.394204 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b3ee2dc-48b0-4e4d-a392-da93b0e4996c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:09.394646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b3ee2dc-48b0-4e4d-a392-da93b0e4996c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:09.454568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5b3ee2dc-48b0-4e4d-a392-da93b0e4996c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:09.462547 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5b3ee2dc-48b0-4e4d-a392-da93b0e4996c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081483 Aug 04 04:57:09.463103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 740/1485] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:09 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:09.879043 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3850a4e1-a87f-4937-9fb0-a65535aabe57 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:09.879652 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3850a4e1-a87f-4937-9fb0-a65535aabe57 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:09.886730 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3850a4e1-a87f-4937-9fb0-a65535aabe57 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:09.887243 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3850a4e1-a87f-4937-9fb0-a65535aabe57 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:09.887998 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3850a4e1-a87f-4937-9fb0-a65535aabe57 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:09.888429 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3850a4e1-a87f-4937-9fb0-a65535aabe57 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:10.014159 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3850a4e1-a87f-4937-9fb0-a65535aabe57 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:10.021999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3850a4e1-a87f-4937-9fb0-a65535aabe57 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.146781 Aug 04 04:57:10.022565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 746/1486] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:09 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:10.484357 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f78a378d-3030-4007-b5aa-9aee9a316e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:10.485079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f78a378d-3030-4007-b5aa-9aee9a316e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:10.491313 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f78a378d-3030-4007-b5aa-9aee9a316e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:10.491761 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f78a378d-3030-4007-b5aa-9aee9a316e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:10.492516 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f78a378d-3030-4007-b5aa-9aee9a316e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:10.492950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f78a378d-3030-4007-b5aa-9aee9a316e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:10.559630 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f78a378d-3030-4007-b5aa-9aee9a316e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:10.567719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f78a378d-3030-4007-b5aa-9aee9a316e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.087902 Aug 04 04:57:10.568313 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 741/1487] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:11.044570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-63870122-86eb-4f04-ae5e-261a048d4d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:11.045191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-63870122-86eb-4f04-ae5e-261a048d4d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:11.051919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-63870122-86eb-4f04-ae5e-261a048d4d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:11.052368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-63870122-86eb-4f04-ae5e-261a048d4d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:11.053130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-63870122-86eb-4f04-ae5e-261a048d4d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:11.053596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-63870122-86eb-4f04-ae5e-261a048d4d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:11.070341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:11.186421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-63870122-86eb-4f04-ae5e-261a048d4d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:11.194190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-63870122-86eb-4f04-ae5e-261a048d4d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154653 Aug 04 04:57:11.194744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 747/1488] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:11 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:11.588178 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8baf41dd-7841-455c-8e49-6ac9c20bb036 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:11.588788 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8baf41dd-7841-455c-8e49-6ac9c20bb036 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:11.595318 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8baf41dd-7841-455c-8e49-6ac9c20bb036 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:11.595761 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8baf41dd-7841-455c-8e49-6ac9c20bb036 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:11.596512 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8baf41dd-7841-455c-8e49-6ac9c20bb036 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:11.596939 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8baf41dd-7841-455c-8e49-6ac9c20bb036 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:11.656617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8baf41dd-7841-455c-8e49-6ac9c20bb036 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:11.664476 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8baf41dd-7841-455c-8e49-6ac9c20bb036 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080153 Aug 04 04:57:11.665059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 742/1489] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:11 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:12.216370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-acf732a9-f693-48dc-81e4-d22ce112abe7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:12.216981 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-acf732a9-f693-48dc-81e4-d22ce112abe7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:12.223558 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-acf732a9-f693-48dc-81e4-d22ce112abe7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:12.224003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-acf732a9-f693-48dc-81e4-d22ce112abe7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:12.224758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-acf732a9-f693-48dc-81e4-d22ce112abe7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:12.225197 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-acf732a9-f693-48dc-81e4-d22ce112abe7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:12.357317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-acf732a9-f693-48dc-81e4-d22ce112abe7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:12.365389 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-acf732a9-f693-48dc-81e4-d22ce112abe7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.153754 Aug 04 04:57:12.365986 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 748/1490] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:12 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:12.685715 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a1c7549b-2582-4a2b-9092-a4ffd07f5085 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:12.686333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a1c7549b-2582-4a2b-9092-a4ffd07f5085 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:12.692836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1c7549b-2582-4a2b-9092-a4ffd07f5085 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:12.693287 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1c7549b-2582-4a2b-9092-a4ffd07f5085 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:12.694062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1c7549b-2582-4a2b-9092-a4ffd07f5085 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:12.694497 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1c7549b-2582-4a2b-9092-a4ffd07f5085 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:12.753721 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a1c7549b-2582-4a2b-9092-a4ffd07f5085 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:12.762485 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a1c7549b-2582-4a2b-9092-a4ffd07f5085 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.079744 Aug 04 04:57:12.762994 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 743/1491] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:12 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:13.387127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a0ef3676-d239-445f-8c0c-bdf36672b8e5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:13.387766 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a0ef3676-d239-445f-8c0c-bdf36672b8e5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:13.394278 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a0ef3676-d239-445f-8c0c-bdf36672b8e5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:13.394721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a0ef3676-d239-445f-8c0c-bdf36672b8e5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:13.395473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a0ef3676-d239-445f-8c0c-bdf36672b8e5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:13.395901 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a0ef3676-d239-445f-8c0c-bdf36672b8e5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:13.523175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a0ef3676-d239-445f-8c0c-bdf36672b8e5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:13.531794 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a0ef3676-d239-445f-8c0c-bdf36672b8e5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148625 Aug 04 04:57:13.532345 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 749/1492] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:13 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:13.783706 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ffbd6079-f330-443e-944c-82d5d52538ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:13.784322 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ffbd6079-f330-443e-944c-82d5d52538ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:13.790874 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ffbd6079-f330-443e-944c-82d5d52538ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:13.791320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ffbd6079-f330-443e-944c-82d5d52538ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:13.792083 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ffbd6079-f330-443e-944c-82d5d52538ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:13.793311 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ffbd6079-f330-443e-944c-82d5d52538ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:13.853014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ffbd6079-f330-443e-944c-82d5d52538ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:13.862035 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ffbd6079-f330-443e-944c-82d5d52538ae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082148 Aug 04 04:57:13.862608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 744/1493] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:13 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:14.552504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a182081f-006f-4412-b81e-cd137985da34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:14.553115 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a182081f-006f-4412-b81e-cd137985da34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:14.559811 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a182081f-006f-4412-b81e-cd137985da34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:14.560250 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a182081f-006f-4412-b81e-cd137985da34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:14.561061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a182081f-006f-4412-b81e-cd137985da34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:14.561490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a182081f-006f-4412-b81e-cd137985da34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:14.693829 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a182081f-006f-4412-b81e-cd137985da34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:14.702001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a182081f-006f-4412-b81e-cd137985da34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.153256 Aug 04 04:57:14.702565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 750/1494] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:14 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:14.883294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1d9e840e-709d-4ddc-9c78-cdf3ef112039 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:14.883913 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1d9e840e-709d-4ddc-9c78-cdf3ef112039 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:14.891836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d9e840e-709d-4ddc-9c78-cdf3ef112039 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:14.892696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d9e840e-709d-4ddc-9c78-cdf3ef112039 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:14.893565 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d9e840e-709d-4ddc-9c78-cdf3ef112039 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:14.894019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d9e840e-709d-4ddc-9c78-cdf3ef112039 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:14.967095 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1d9e840e-709d-4ddc-9c78-cdf3ef112039 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:14.975725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1d9e840e-709d-4ddc-9c78-cdf3ef112039 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.096251 Aug 04 04:57:14.976298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 745/1495] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:14 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:15.725450 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ddb507c6-383d-4e5a-988c-e73a77016ac7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:15.726026 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ddb507c6-383d-4e5a-988c-e73a77016ac7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:15.732948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ddb507c6-383d-4e5a-988c-e73a77016ac7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:15.733399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ddb507c6-383d-4e5a-988c-e73a77016ac7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:15.734192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ddb507c6-383d-4e5a-988c-e73a77016ac7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:15.734628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ddb507c6-383d-4e5a-988c-e73a77016ac7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:15.871536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ddb507c6-383d-4e5a-988c-e73a77016ac7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:15.879357 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ddb507c6-383d-4e5a-988c-e73a77016ac7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.159526 Aug 04 04:57:15.879915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 751/1496] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:15 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:15.997942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-50c39a09-9576-48af-923e-ba59d38d075b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:15.998582 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-50c39a09-9576-48af-923e-ba59d38d075b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:16.004973 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-50c39a09-9576-48af-923e-ba59d38d075b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:16.005440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-50c39a09-9576-48af-923e-ba59d38d075b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:16.006232 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-50c39a09-9576-48af-923e-ba59d38d075b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:16.006665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-50c39a09-9576-48af-923e-ba59d38d075b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:16.069592 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-50c39a09-9576-48af-923e-ba59d38d075b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:16.077494 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-50c39a09-9576-48af-923e-ba59d38d075b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084349 Aug 04 04:57:16.078066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 746/1497] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:15 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:16.902230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ee6a26cf-a189-4e92-bd7f-87412c42b32c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:16.903030 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ee6a26cf-a189-4e92-bd7f-87412c42b32c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:16.910082 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ee6a26cf-a189-4e92-bd7f-87412c42b32c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:16.910536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ee6a26cf-a189-4e92-bd7f-87412c42b32c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:16.911322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ee6a26cf-a189-4e92-bd7f-87412c42b32c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:16.911770 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ee6a26cf-a189-4e92-bd7f-87412c42b32c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:17.044073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ee6a26cf-a189-4e92-bd7f-87412c42b32c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:17.052750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ee6a26cf-a189-4e92-bd7f-87412c42b32c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.155175 Aug 04 04:57:17.053301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 752/1498] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:16 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:17.098577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8cfe32e7-27b0-4a62-805c-62e9d11c4818 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:17.099198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8cfe32e7-27b0-4a62-805c-62e9d11c4818 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:17.105740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8cfe32e7-27b0-4a62-805c-62e9d11c4818 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:17.106192 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8cfe32e7-27b0-4a62-805c-62e9d11c4818 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:17.106964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8cfe32e7-27b0-4a62-805c-62e9d11c4818 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:17.107401 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8cfe32e7-27b0-4a62-805c-62e9d11c4818 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:17.168410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8cfe32e7-27b0-4a62-805c-62e9d11c4818 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:17.176511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8cfe32e7-27b0-4a62-805c-62e9d11c4818 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082123 Aug 04 04:57:17.177074 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 747/1499] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:17 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:18.073984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-de2ce782-8e2d-4939-a632-06e7bcf213a2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:18.074540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-de2ce782-8e2d-4939-a632-06e7bcf213a2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:18.081061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de2ce782-8e2d-4939-a632-06e7bcf213a2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:18.081514 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de2ce782-8e2d-4939-a632-06e7bcf213a2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:18.082314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de2ce782-8e2d-4939-a632-06e7bcf213a2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:18.082752 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de2ce782-8e2d-4939-a632-06e7bcf213a2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:18.198327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-55acc029-b7c8-4c7a-8c89-4dcebffdef8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:18.199093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-55acc029-b7c8-4c7a-8c89-4dcebffdef8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:18.206879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-55acc029-b7c8-4c7a-8c89-4dcebffdef8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:18.207347 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-55acc029-b7c8-4c7a-8c89-4dcebffdef8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:18.208131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-55acc029-b7c8-4c7a-8c89-4dcebffdef8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:18.208574 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-55acc029-b7c8-4c7a-8c89-4dcebffdef8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:18.430931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-55acc029-b7c8-4c7a-8c89-4dcebffdef8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:18.439258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-55acc029-b7c8-4c7a-8c89-4dcebffdef8f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.244852 Aug 04 04:57:18.439824 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 748/1500] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:18 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:18.485294 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-de2ce782-8e2d-4939-a632-06e7bcf213a2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:18.493117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-de2ce782-8e2d-4939-a632-06e7bcf213a2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.423276 Aug 04 04:57:18.493795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 753/1501] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:18 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:19.460279 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b843fb29-3857-439f-9dfe-79d74ec9c4cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:19.460891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b843fb29-3857-439f-9dfe-79d74ec9c4cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:19.467675 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b843fb29-3857-439f-9dfe-79d74ec9c4cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:19.468126 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b843fb29-3857-439f-9dfe-79d74ec9c4cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:19.468889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b843fb29-3857-439f-9dfe-79d74ec9c4cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:19.469333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b843fb29-3857-439f-9dfe-79d74ec9c4cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:19.515245 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a32897ac-7409-4f7e-b7bf-ce50ffd82fe3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:19.515872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a32897ac-7409-4f7e-b7bf-ce50ffd82fe3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:19.522529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a32897ac-7409-4f7e-b7bf-ce50ffd82fe3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:19.522979 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a32897ac-7409-4f7e-b7bf-ce50ffd82fe3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:19.523751 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a32897ac-7409-4f7e-b7bf-ce50ffd82fe3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:19.524187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a32897ac-7409-4f7e-b7bf-ce50ffd82fe3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:19.535301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b843fb29-3857-439f-9dfe-79d74ec9c4cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:19.543290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b843fb29-3857-439f-9dfe-79d74ec9c4cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086877 Aug 04 04:57:19.543864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 749/1502] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:19 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:19.653083 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a32897ac-7409-4f7e-b7bf-ce50ffd82fe3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:19.660941 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a32897ac-7409-4f7e-b7bf-ce50ffd82fe3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.150576 Aug 04 04:57:19.661499 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 754/1503] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:19 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:20.564937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c52a3f4a-f6e3-4286-b08a-1ae9db30ea9c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:20.565601 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c52a3f4a-f6e3-4286-b08a-1ae9db30ea9c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:20.572148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c52a3f4a-f6e3-4286-b08a-1ae9db30ea9c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:20.572596 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c52a3f4a-f6e3-4286-b08a-1ae9db30ea9c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:20.573355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c52a3f4a-f6e3-4286-b08a-1ae9db30ea9c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:20.573814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c52a3f4a-f6e3-4286-b08a-1ae9db30ea9c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:20.636421 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c52a3f4a-f6e3-4286-b08a-1ae9db30ea9c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:20.647072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c52a3f4a-f6e3-4286-b08a-1ae9db30ea9c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085940 Aug 04 04:57:20.647640 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 750/1504] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:20 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:20.682780 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0ae97cd5-527b-4bcf-93ce-adc0baf49caf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:20.683391 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0ae97cd5-527b-4bcf-93ce-adc0baf49caf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:20.690425 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ae97cd5-527b-4bcf-93ce-adc0baf49caf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:20.690868 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ae97cd5-527b-4bcf-93ce-adc0baf49caf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:20.691621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ae97cd5-527b-4bcf-93ce-adc0baf49caf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:20.692049 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ae97cd5-527b-4bcf-93ce-adc0baf49caf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:20.820922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0ae97cd5-527b-4bcf-93ce-adc0baf49caf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:20.829506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0ae97cd5-527b-4bcf-93ce-adc0baf49caf tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.150678 Aug 04 04:57:20.830072 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 755/1505] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:20 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:21.668443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8d526ca5-b9be-456e-ac8a-2c3f8a90bd76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:21.669133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8d526ca5-b9be-456e-ac8a-2c3f8a90bd76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:21.675914 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d526ca5-b9be-456e-ac8a-2c3f8a90bd76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:21.676369 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d526ca5-b9be-456e-ac8a-2c3f8a90bd76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:21.677137 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d526ca5-b9be-456e-ac8a-2c3f8a90bd76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:21.677597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d526ca5-b9be-456e-ac8a-2c3f8a90bd76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:21.737380 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8d526ca5-b9be-456e-ac8a-2c3f8a90bd76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:21.739557 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:21.746584 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8d526ca5-b9be-456e-ac8a-2c3f8a90bd76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081983 Aug 04 04:57:21.747682 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 751/1506] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:21 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:21.850578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2181c10e-7b6c-4c82-8d72-f392b55582fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:21.851362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2181c10e-7b6c-4c82-8d72-f392b55582fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:21.859113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2181c10e-7b6c-4c82-8d72-f392b55582fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:21.859562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2181c10e-7b6c-4c82-8d72-f392b55582fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:21.860344 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2181c10e-7b6c-4c82-8d72-f392b55582fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:21.860772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2181c10e-7b6c-4c82-8d72-f392b55582fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:21.987390 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2181c10e-7b6c-4c82-8d72-f392b55582fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:21.995241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2181c10e-7b6c-4c82-8d72-f392b55582fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148767 Aug 04 04:57:21.995799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 756/1507] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:21 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:22.768697 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7854ebc1-66e7-4234-a97a-f443a49f47f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:22.769353 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7854ebc1-66e7-4234-a97a-f443a49f47f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:22.775947 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7854ebc1-66e7-4234-a97a-f443a49f47f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:22.776402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7854ebc1-66e7-4234-a97a-f443a49f47f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:22.777163 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7854ebc1-66e7-4234-a97a-f443a49f47f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:22.777626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7854ebc1-66e7-4234-a97a-f443a49f47f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:22.839032 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7854ebc1-66e7-4234-a97a-f443a49f47f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:22.847178 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7854ebc1-66e7-4234-a97a-f443a49f47f1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082337 Aug 04 04:57:22.847742 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 752/1508] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:22 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:23.017781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9f20dd8b-3a21-47c0-b8c7-db14c7b5283d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:23.018326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9f20dd8b-3a21-47c0-b8c7-db14c7b5283d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:23.024592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f20dd8b-3a21-47c0-b8c7-db14c7b5283d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:23.025037 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f20dd8b-3a21-47c0-b8c7-db14c7b5283d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:23.025811 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f20dd8b-3a21-47c0-b8c7-db14c7b5283d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:23.026242 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f20dd8b-3a21-47c0-b8c7-db14c7b5283d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:23.156283 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9f20dd8b-3a21-47c0-b8c7-db14c7b5283d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:23.164191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9f20dd8b-3a21-47c0-b8c7-db14c7b5283d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.150943 Aug 04 04:57:23.164744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 757/1509] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:23 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:23.867938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-25ce4f42-b0d6-49d6-a54f-f587c7e9ccae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:23.868559 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-25ce4f42-b0d6-49d6-a54f-f587c7e9ccae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:23.876099 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25ce4f42-b0d6-49d6-a54f-f587c7e9ccae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:23.876550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25ce4f42-b0d6-49d6-a54f-f587c7e9ccae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:23.877312 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25ce4f42-b0d6-49d6-a54f-f587c7e9ccae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:23.877774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25ce4f42-b0d6-49d6-a54f-f587c7e9ccae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:23.939575 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-25ce4f42-b0d6-49d6-a54f-f587c7e9ccae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:23.947428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-25ce4f42-b0d6-49d6-a54f-f587c7e9ccae tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083364 Aug 04 04:57:23.947990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 753/1510] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:23 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:24.186192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-67cce419-f642-4502-bbc9-f739924c8478 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:24.186743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-67cce419-f642-4502-bbc9-f739924c8478 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:24.193088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67cce419-f642-4502-bbc9-f739924c8478 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:24.193532 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67cce419-f642-4502-bbc9-f739924c8478 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:24.194312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67cce419-f642-4502-bbc9-f739924c8478 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:24.194742 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67cce419-f642-4502-bbc9-f739924c8478 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:24.326481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-67cce419-f642-4502-bbc9-f739924c8478 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:24.334312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-67cce419-f642-4502-bbc9-f739924c8478 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152064 Aug 04 04:57:24.334871 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 758/1511] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:24 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:24.634803 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:57:24.634998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 04:57:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:57:24.968399 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4884a48e-13b7-49cc-a78a-fe4116ba124a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:24.969083 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4884a48e-13b7-49cc-a78a-fe4116ba124a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:24.970872 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=56 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:24.976366 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4884a48e-13b7-49cc-a78a-fe4116ba124a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:24.976808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4884a48e-13b7-49cc-a78a-fe4116ba124a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:24.977582 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4884a48e-13b7-49cc-a78a-fe4116ba124a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:24.978019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4884a48e-13b7-49cc-a78a-fe4116ba124a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:25.038714 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4884a48e-13b7-49cc-a78a-fe4116ba124a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:25.046937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4884a48e-13b7-49cc-a78a-fe4116ba124a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082268 Aug 04 04:57:25.047489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 754/1512] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:24 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:25.356548 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2599f824-ef74-422b-b639-ee12d677198b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:25.357496 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2599f824-ef74-422b-b639-ee12d677198b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:25.359920 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=52 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:25.365705 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2599f824-ef74-422b-b639-ee12d677198b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:25.366194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2599f824-ef74-422b-b639-ee12d677198b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:25.366965 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2599f824-ef74-422b-b639-ee12d677198b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:25.367437 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2599f824-ef74-422b-b639-ee12d677198b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:25.495986 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2599f824-ef74-422b-b639-ee12d677198b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:25.504875 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2599f824-ef74-422b-b639-ee12d677198b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152702 Aug 04 04:57:25.505662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 759/1513] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:25 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:26.068019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e01eefa3-6e7d-4f69-a78f-491ac0c67a57 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:26.068559 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e01eefa3-6e7d-4f69-a78f-491ac0c67a57 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:26.075670 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e01eefa3-6e7d-4f69-a78f-491ac0c67a57 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:26.076125 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e01eefa3-6e7d-4f69-a78f-491ac0c67a57 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:26.076879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e01eefa3-6e7d-4f69-a78f-491ac0c67a57 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:26.077310 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e01eefa3-6e7d-4f69-a78f-491ac0c67a57 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:26.136845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e01eefa3-6e7d-4f69-a78f-491ac0c67a57 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:26.145420 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e01eefa3-6e7d-4f69-a78f-491ac0c67a57 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081304 Aug 04 04:57:26.146014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 755/1514] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:26 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:26.525708 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-135f9e48-6c72-4203-813c-3a430f875310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:26.526329 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-135f9e48-6c72-4203-813c-3a430f875310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:26.533481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-135f9e48-6c72-4203-813c-3a430f875310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:26.533961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-135f9e48-6c72-4203-813c-3a430f875310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:26.534735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-135f9e48-6c72-4203-813c-3a430f875310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:26.535172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-135f9e48-6c72-4203-813c-3a430f875310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:26.673439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-135f9e48-6c72-4203-813c-3a430f875310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:26.681705 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-135f9e48-6c72-4203-813c-3a430f875310 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.159949 Aug 04 04:57:26.682335 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 760/1515] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:26 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:27.167227 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-763ac2e4-3124-4363-866a-9ca30ae8d7ed tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:27.167875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-763ac2e4-3124-4363-866a-9ca30ae8d7ed tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:27.175466 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-763ac2e4-3124-4363-866a-9ca30ae8d7ed tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:27.175919 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-763ac2e4-3124-4363-866a-9ca30ae8d7ed tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:27.176685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-763ac2e4-3124-4363-866a-9ca30ae8d7ed tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:27.177132 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-763ac2e4-3124-4363-866a-9ca30ae8d7ed tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:27.239357 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-763ac2e4-3124-4363-866a-9ca30ae8d7ed tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:27.247420 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-763ac2e4-3124-4363-866a-9ca30ae8d7ed tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083958 Aug 04 04:57:27.247975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 756/1516] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:27 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:27.703580 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cead1de7-3cb3-4eb7-8098-51371ca3884a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:27.704227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cead1de7-3cb3-4eb7-8098-51371ca3884a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:27.710715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cead1de7-3cb3-4eb7-8098-51371ca3884a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:27.711162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cead1de7-3cb3-4eb7-8098-51371ca3884a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:27.711920 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cead1de7-3cb3-4eb7-8098-51371ca3884a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:27.712355 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cead1de7-3cb3-4eb7-8098-51371ca3884a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:27.840632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-cead1de7-3cb3-4eb7-8098-51371ca3884a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:27.848631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cead1de7-3cb3-4eb7-8098-51371ca3884a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149019 Aug 04 04:57:27.849193 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 761/1517] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:27 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:28.241454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:57:28.241677 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 04:57:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:57:28.268544 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6f7a6577-d9a6-4918-b9e4-614d83c71b26 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:28.269155 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6f7a6577-d9a6-4918-b9e4-614d83c71b26 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:28.275631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f7a6577-d9a6-4918-b9e4-614d83c71b26 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:28.276073 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f7a6577-d9a6-4918-b9e4-614d83c71b26 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:28.276824 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f7a6577-d9a6-4918-b9e4-614d83c71b26 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:28.277256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f7a6577-d9a6-4918-b9e4-614d83c71b26 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:28.346009 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6f7a6577-d9a6-4918-b9e4-614d83c71b26 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:28.353914 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6f7a6577-d9a6-4918-b9e4-614d83c71b26 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.089127 Aug 04 04:57:28.354472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 757/1518] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:28 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:28.870128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a92d1abc-a205-497b-ae06-05fdec3400e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:28.870740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a92d1abc-a205-497b-ae06-05fdec3400e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:28.877178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a92d1abc-a205-497b-ae06-05fdec3400e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:28.877654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a92d1abc-a205-497b-ae06-05fdec3400e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:28.878405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a92d1abc-a205-497b-ae06-05fdec3400e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:28.878840 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a92d1abc-a205-497b-ae06-05fdec3400e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:29.010473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a92d1abc-a205-497b-ae06-05fdec3400e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:29.019203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a92d1abc-a205-497b-ae06-05fdec3400e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152909 Aug 04 04:57:29.019763 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 762/1519] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:28 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:29.375425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e66e01c5-2046-4298-9b54-baa3a9bb3c44 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:29.376036 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e66e01c5-2046-4298-9b54-baa3a9bb3c44 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:29.382561 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e66e01c5-2046-4298-9b54-baa3a9bb3c44 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:29.383006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e66e01c5-2046-4298-9b54-baa3a9bb3c44 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:29.383762 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e66e01c5-2046-4298-9b54-baa3a9bb3c44 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:29.384199 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e66e01c5-2046-4298-9b54-baa3a9bb3c44 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:29.445093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e66e01c5-2046-4298-9b54-baa3a9bb3c44 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:29.453011 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e66e01c5-2046-4298-9b54-baa3a9bb3c44 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082112 Aug 04 04:57:29.453592 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 758/1520] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:29 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:30.040663 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7e8d5cc1-a301-44df-933c-11f8a836d54f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:30.041330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7e8d5cc1-a301-44df-933c-11f8a836d54f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:30.048993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7e8d5cc1-a301-44df-933c-11f8a836d54f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:30.049442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7e8d5cc1-a301-44df-933c-11f8a836d54f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:30.050228 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7e8d5cc1-a301-44df-933c-11f8a836d54f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:30.050663 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7e8d5cc1-a301-44df-933c-11f8a836d54f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:30.179904 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7e8d5cc1-a301-44df-933c-11f8a836d54f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:30.188657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7e8d5cc1-a301-44df-933c-11f8a836d54f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152046 Aug 04 04:57:30.189216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 763/1521] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:30 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:30.475015 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6767cb78-79e8-4905-b262-47493984ea4c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:30.475629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6767cb78-79e8-4905-b262-47493984ea4c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:30.482057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6767cb78-79e8-4905-b262-47493984ea4c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:30.482504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6767cb78-79e8-4905-b262-47493984ea4c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:30.483261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6767cb78-79e8-4905-b262-47493984ea4c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:30.483695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6767cb78-79e8-4905-b262-47493984ea4c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:30.544720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6767cb78-79e8-4905-b262-47493984ea4c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:30.552888 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6767cb78-79e8-4905-b262-47493984ea4c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081745 Aug 04 04:57:30.553436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 759/1522] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:30 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:31.209851 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-462205ee-6b73-450c-984f-a834d4d44852 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:31.210615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-462205ee-6b73-450c-984f-a834d4d44852 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:31.217782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-462205ee-6b73-450c-984f-a834d4d44852 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:31.218226 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-462205ee-6b73-450c-984f-a834d4d44852 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:31.218982 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-462205ee-6b73-450c-984f-a834d4d44852 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:31.219411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-462205ee-6b73-450c-984f-a834d4d44852 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:31.221910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:31.350747 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-462205ee-6b73-450c-984f-a834d4d44852 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:31.359281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-462205ee-6b73-450c-984f-a834d4d44852 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.153286 Aug 04 04:57:31.359846 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 764/1523] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:31 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:31.574206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f6401472-5d07-44cb-b057-a3ff893eb104 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:31.574872 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f6401472-5d07-44cb-b057-a3ff893eb104 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:31.581513 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6401472-5d07-44cb-b057-a3ff893eb104 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:31.582001 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6401472-5d07-44cb-b057-a3ff893eb104 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:31.582760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6401472-5d07-44cb-b057-a3ff893eb104 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:31.583199 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6401472-5d07-44cb-b057-a3ff893eb104 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:31.643141 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f6401472-5d07-44cb-b057-a3ff893eb104 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:31.651019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f6401472-5d07-44cb-b057-a3ff893eb104 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080698 Aug 04 04:57:31.651591 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 760/1524] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:31 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:32.380371 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-990d07c3-6552-4d76-bf93-d5dfeaa3f0ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:32.381028 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-990d07c3-6552-4d76-bf93-d5dfeaa3f0ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:32.387922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-990d07c3-6552-4d76-bf93-d5dfeaa3f0ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:32.388376 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-990d07c3-6552-4d76-bf93-d5dfeaa3f0ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:32.389169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-990d07c3-6552-4d76-bf93-d5dfeaa3f0ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:32.389605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-990d07c3-6552-4d76-bf93-d5dfeaa3f0ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:32.520658 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-990d07c3-6552-4d76-bf93-d5dfeaa3f0ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:32.528583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-990d07c3-6552-4d76-bf93-d5dfeaa3f0ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152168 Aug 04 04:57:32.529131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 765/1525] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:32 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:32.672703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2a175fe9-4a75-4a02-b203-9a442acbd253 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:32.673272 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2a175fe9-4a75-4a02-b203-9a442acbd253 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:32.679727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2a175fe9-4a75-4a02-b203-9a442acbd253 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:32.680177 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2a175fe9-4a75-4a02-b203-9a442acbd253 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:32.680940 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2a175fe9-4a75-4a02-b203-9a442acbd253 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:32.681378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2a175fe9-4a75-4a02-b203-9a442acbd253 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:32.742636 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2a175fe9-4a75-4a02-b203-9a442acbd253 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:32.751072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2a175fe9-4a75-4a02-b203-9a442acbd253 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082738 Aug 04 04:57:32.751634 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 761/1526] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:32 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:33.550145 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-19739524-20ae-4e50-9bbb-ad7060cc9354 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:33.550764 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-19739524-20ae-4e50-9bbb-ad7060cc9354 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:33.557404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-19739524-20ae-4e50-9bbb-ad7060cc9354 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:33.557919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-19739524-20ae-4e50-9bbb-ad7060cc9354 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:33.558689 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-19739524-20ae-4e50-9bbb-ad7060cc9354 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:33.559809 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-19739524-20ae-4e50-9bbb-ad7060cc9354 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:33.693005 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-19739524-20ae-4e50-9bbb-ad7060cc9354 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:33.701049 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-19739524-20ae-4e50-9bbb-ad7060cc9354 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.155050 Aug 04 04:57:33.701613 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 766/1527] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:33 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:33.772317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-90ff2bdf-e2e2-4a8b-b159-0adf1bb1cca0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:33.772956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-90ff2bdf-e2e2-4a8b-b159-0adf1bb1cca0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:33.779930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-90ff2bdf-e2e2-4a8b-b159-0adf1bb1cca0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:33.780371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-90ff2bdf-e2e2-4a8b-b159-0adf1bb1cca0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:33.781117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-90ff2bdf-e2e2-4a8b-b159-0adf1bb1cca0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:33.781562 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-90ff2bdf-e2e2-4a8b-b159-0adf1bb1cca0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:33.842486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-90ff2bdf-e2e2-4a8b-b159-0adf1bb1cca0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:33.850314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-90ff2bdf-e2e2-4a8b-b159-0adf1bb1cca0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081812 Aug 04 04:57:33.850873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 762/1528] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:33 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:34.723777 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c6e6185d-7907-4535-a74c-bd9e276c1b69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:34.724387 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c6e6185d-7907-4535-a74c-bd9e276c1b69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:34.730777 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6e6185d-7907-4535-a74c-bd9e276c1b69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:34.732043 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6e6185d-7907-4535-a74c-bd9e276c1b69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:34.732838 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6e6185d-7907-4535-a74c-bd9e276c1b69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:34.733266 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6e6185d-7907-4535-a74c-bd9e276c1b69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:34.863814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c6e6185d-7907-4535-a74c-bd9e276c1b69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:34.871343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-334e6e8f-a746-4d31-8f9d-b49351c0fb08 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:34.872711 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-334e6e8f-a746-4d31-8f9d-b49351c0fb08 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:34.872910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c6e6185d-7907-4535-a74c-bd9e276c1b69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152581 Aug 04 04:57:34.873480 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 767/1529] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:34 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:34.879373 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-334e6e8f-a746-4d31-8f9d-b49351c0fb08 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:34.879822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-334e6e8f-a746-4d31-8f9d-b49351c0fb08 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:34.880582 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-334e6e8f-a746-4d31-8f9d-b49351c0fb08 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:34.881031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-334e6e8f-a746-4d31-8f9d-b49351c0fb08 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:34.942222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-334e6e8f-a746-4d31-8f9d-b49351c0fb08 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:34.950620 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-334e6e8f-a746-4d31-8f9d-b49351c0fb08 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082373 Aug 04 04:57:34.951180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 763/1530] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:34 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:35.893782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-112f3cac-9de9-48b6-a317-c08d9162b62d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:35.894393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-112f3cac-9de9-48b6-a317-c08d9162b62d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:35.900825 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-112f3cac-9de9-48b6-a317-c08d9162b62d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:35.901268 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-112f3cac-9de9-48b6-a317-c08d9162b62d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:35.902041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-112f3cac-9de9-48b6-a317-c08d9162b62d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:35.902472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-112f3cac-9de9-48b6-a317-c08d9162b62d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:35.971507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-47f8a8e6-420a-457f-9ca2-29f528724793 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:35.972150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-47f8a8e6-420a-457f-9ca2-29f528724793 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:35.978847 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-47f8a8e6-420a-457f-9ca2-29f528724793 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:35.979361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-47f8a8e6-420a-457f-9ca2-29f528724793 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:35.980135 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-47f8a8e6-420a-457f-9ca2-29f528724793 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:35.980569 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-47f8a8e6-420a-457f-9ca2-29f528724793 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:36.050508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-47f8a8e6-420a-457f-9ca2-29f528724793 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:36.054185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-112f3cac-9de9-48b6-a317-c08d9162b62d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:36.058467 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-47f8a8e6-420a-457f-9ca2-29f528724793 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.090777 Aug 04 04:57:36.059066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 764/1531] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:35 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:36.062818 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-112f3cac-9de9-48b6-a317-c08d9162b62d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.172896 Aug 04 04:57:36.063368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 768/1532] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:35 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:37.080560 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-61cc43d0-e75e-4999-9faa-d69a6511e146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:37.081179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-61cc43d0-e75e-4999-9faa-d69a6511e146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:37.083126 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-320276e1-bbea-47d3-99c5-c2b904f16576 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:37.083740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-320276e1-bbea-47d3-99c5-c2b904f16576 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:37.087731 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-61cc43d0-e75e-4999-9faa-d69a6511e146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:37.088182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-61cc43d0-e75e-4999-9faa-d69a6511e146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:37.088952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-61cc43d0-e75e-4999-9faa-d69a6511e146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:37.089391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-61cc43d0-e75e-4999-9faa-d69a6511e146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:37.090144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-320276e1-bbea-47d3-99c5-c2b904f16576 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:37.090588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-320276e1-bbea-47d3-99c5-c2b904f16576 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:37.091988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-320276e1-bbea-47d3-99c5-c2b904f16576 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:37.092423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-320276e1-bbea-47d3-99c5-c2b904f16576 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:37.176668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-61cc43d0-e75e-4999-9faa-d69a6511e146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:37.184515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-61cc43d0-e75e-4999-9faa-d69a6511e146 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.107839 Aug 04 04:57:37.185981 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 765/1533] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:37 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:37.242913 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-320276e1-bbea-47d3-99c5-c2b904f16576 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:37.251869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-320276e1-bbea-47d3-99c5-c2b904f16576 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.172524 Aug 04 04:57:37.252427 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 769/1534] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:37 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:38.206131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-060511eb-2028-4bc1-9741-74fb7e92392e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:38.206676 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-060511eb-2028-4bc1-9741-74fb7e92392e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:38.213083 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-060511eb-2028-4bc1-9741-74fb7e92392e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:38.213534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-060511eb-2028-4bc1-9741-74fb7e92392e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:38.214321 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-060511eb-2028-4bc1-9741-74fb7e92392e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:38.214755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-060511eb-2028-4bc1-9741-74fb7e92392e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:38.274823 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-650a0272-87e8-4592-855e-6a454cc85e61 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:38.275440 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-650a0272-87e8-4592-855e-6a454cc85e61 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:38.282053 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-060511eb-2028-4bc1-9741-74fb7e92392e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:38.282281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-650a0272-87e8-4592-855e-6a454cc85e61 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:38.283543 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-650a0272-87e8-4592-855e-6a454cc85e61 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:38.284552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-650a0272-87e8-4592-855e-6a454cc85e61 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:38.285296 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-650a0272-87e8-4592-855e-6a454cc85e61 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:38.291299 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-060511eb-2028-4bc1-9741-74fb7e92392e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.089007 Aug 04 04:57:38.292067 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 766/1535] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:38 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:38.426270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-650a0272-87e8-4592-855e-6a454cc85e61 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:38.436302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-650a0272-87e8-4592-855e-6a454cc85e61 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.165700 Aug 04 04:57:38.436868 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 770/1536] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:38 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:38.560101 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:57:38.560412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 04:57:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:57:39.312771 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-204eb299-9cb0-4bf0-880c-4f386d702dcc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:39.313382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-204eb299-9cb0-4bf0-880c-4f386d702dcc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:39.319969 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-204eb299-9cb0-4bf0-880c-4f386d702dcc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:39.320419 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-204eb299-9cb0-4bf0-880c-4f386d702dcc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:39.321180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-204eb299-9cb0-4bf0-880c-4f386d702dcc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:39.321641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-204eb299-9cb0-4bf0-880c-4f386d702dcc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:39.382196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-204eb299-9cb0-4bf0-880c-4f386d702dcc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:39.390737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-204eb299-9cb0-4bf0-880c-4f386d702dcc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082429 Aug 04 04:57:39.391296 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 767/1537] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:39.457035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-058e2dcd-c149-46da-90eb-689c3594aa4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:39.457664 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-058e2dcd-c149-46da-90eb-689c3594aa4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:39.464122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-058e2dcd-c149-46da-90eb-689c3594aa4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:39.464562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-058e2dcd-c149-46da-90eb-689c3594aa4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:39.465309 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-058e2dcd-c149-46da-90eb-689c3594aa4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:39.465771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-058e2dcd-c149-46da-90eb-689c3594aa4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:39.594157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-058e2dcd-c149-46da-90eb-689c3594aa4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:39.602069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-058e2dcd-c149-46da-90eb-689c3594aa4f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148853 Aug 04 04:57:39.602635 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 771/1538] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:39 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:40.412144 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-072d9fa6-8cc3-453f-b22b-2f890ddd8316 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:40.413262 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-072d9fa6-8cc3-453f-b22b-2f890ddd8316 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:40.425924 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-072d9fa6-8cc3-453f-b22b-2f890ddd8316 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:40.426746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-072d9fa6-8cc3-453f-b22b-2f890ddd8316 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:40.428021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-072d9fa6-8cc3-453f-b22b-2f890ddd8316 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:40.428506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-072d9fa6-8cc3-453f-b22b-2f890ddd8316 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:40.445693 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:40.494803 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-072d9fa6-8cc3-453f-b22b-2f890ddd8316 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:40.504019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-072d9fa6-8cc3-453f-b22b-2f890ddd8316 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.096710 Aug 04 04:57:40.504578 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 768/1539] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:40 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:40.625288 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7a5c2366-6407-42c4-9661-009670f37715 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:40.625932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7a5c2366-6407-42c4-9661-009670f37715 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:40.632487 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7a5c2366-6407-42c4-9661-009670f37715 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:40.632937 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7a5c2366-6407-42c4-9661-009670f37715 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:40.633809 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7a5c2366-6407-42c4-9661-009670f37715 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:40.634247 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7a5c2366-6407-42c4-9661-009670f37715 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:40.762330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7a5c2366-6407-42c4-9661-009670f37715 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:40.770112 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7a5c2366-6407-42c4-9661-009670f37715 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149888 Aug 04 04:57:40.770668 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 772/1540] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:40 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:41.525690 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-63b08ec3-b627-485b-b3fd-d150cb212cfc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:41.526428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-63b08ec3-b627-485b-b3fd-d150cb212cfc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:41.533703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-63b08ec3-b627-485b-b3fd-d150cb212cfc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:41.534161 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-63b08ec3-b627-485b-b3fd-d150cb212cfc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:41.534932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-63b08ec3-b627-485b-b3fd-d150cb212cfc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:41.535374 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-63b08ec3-b627-485b-b3fd-d150cb212cfc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:41.597461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-63b08ec3-b627-485b-b3fd-d150cb212cfc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:41.605417 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-63b08ec3-b627-485b-b3fd-d150cb212cfc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083712 Aug 04 04:57:41.605998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 769/1541] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:41 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:41.790691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1c297188-d228-46e7-90e2-12a83a5fe499 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:41.791314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1c297188-d228-46e7-90e2-12a83a5fe499 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:41.798251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1c297188-d228-46e7-90e2-12a83a5fe499 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:41.798709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1c297188-d228-46e7-90e2-12a83a5fe499 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:41.799471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1c297188-d228-46e7-90e2-12a83a5fe499 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:41.799915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1c297188-d228-46e7-90e2-12a83a5fe499 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:41.931586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1c297188-d228-46e7-90e2-12a83a5fe499 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:41.940532 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1c297188-d228-46e7-90e2-12a83a5fe499 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.153685 Aug 04 04:57:41.941088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 773/1542] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:41 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:42.627454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-04cf42e0-74e9-41cb-b4ea-8b049dd3931b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:42.628178 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-04cf42e0-74e9-41cb-b4ea-8b049dd3931b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:42.634785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-04cf42e0-74e9-41cb-b4ea-8b049dd3931b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:42.635235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-04cf42e0-74e9-41cb-b4ea-8b049dd3931b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:42.635998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-04cf42e0-74e9-41cb-b4ea-8b049dd3931b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:42.636433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-04cf42e0-74e9-41cb-b4ea-8b049dd3931b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:42.696930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-04cf42e0-74e9-41cb-b4ea-8b049dd3931b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:42.705460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-04cf42e0-74e9-41cb-b4ea-8b049dd3931b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082486 Aug 04 04:57:42.706047 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 770/1543] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:42 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:42.961818 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a87a508d-0270-48e3-ace6-c6a5ab30d2ca tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:42.962514 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a87a508d-0270-48e3-ace6-c6a5ab30d2ca tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:42.969984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a87a508d-0270-48e3-ace6-c6a5ab30d2ca tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:42.970417 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a87a508d-0270-48e3-ace6-c6a5ab30d2ca tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:42.971209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a87a508d-0270-48e3-ace6-c6a5ab30d2ca tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:42.971643 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a87a508d-0270-48e3-ace6-c6a5ab30d2ca tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:43.100940 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a87a508d-0270-48e3-ace6-c6a5ab30d2ca tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:43.110007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a87a508d-0270-48e3-ace6-c6a5ab30d2ca tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152284 Aug 04 04:57:43.110565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 774/1544] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:42 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:43.725562 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fac4231c-aa51-4a1d-abdc-a87a170dd3ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:43.726172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fac4231c-aa51-4a1d-abdc-a87a170dd3ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:43.732657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fac4231c-aa51-4a1d-abdc-a87a170dd3ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:43.733101 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fac4231c-aa51-4a1d-abdc-a87a170dd3ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:43.733883 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fac4231c-aa51-4a1d-abdc-a87a170dd3ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:43.734317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fac4231c-aa51-4a1d-abdc-a87a170dd3ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:43.797762 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-fac4231c-aa51-4a1d-abdc-a87a170dd3ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:43.805670 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fac4231c-aa51-4a1d-abdc-a87a170dd3ac tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083927 Aug 04 04:57:43.806248 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 771/1545] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:43 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:44.130916 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-53663d00-e748-4dab-b3c2-0404a921ba93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:44.131585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-53663d00-e748-4dab-b3c2-0404a921ba93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:44.138186 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53663d00-e748-4dab-b3c2-0404a921ba93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:44.139130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53663d00-e748-4dab-b3c2-0404a921ba93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:44.139890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53663d00-e748-4dab-b3c2-0404a921ba93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:44.140325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53663d00-e748-4dab-b3c2-0404a921ba93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:44.266649 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-53663d00-e748-4dab-b3c2-0404a921ba93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:44.274559 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-53663d00-e748-4dab-b3c2-0404a921ba93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.147577 Aug 04 04:57:44.275114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 775/1546] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:44 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:44.827041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f5e2d89a-459f-4212-a46b-e43553fc1d97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:44.827650 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f5e2d89a-459f-4212-a46b-e43553fc1d97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:44.834128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f5e2d89a-459f-4212-a46b-e43553fc1d97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:44.834579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f5e2d89a-459f-4212-a46b-e43553fc1d97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:44.835338 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f5e2d89a-459f-4212-a46b-e43553fc1d97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:44.835778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f5e2d89a-459f-4212-a46b-e43553fc1d97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:44.896339 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f5e2d89a-459f-4212-a46b-e43553fc1d97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:44.904227 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f5e2d89a-459f-4212-a46b-e43553fc1d97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081222 Aug 04 04:57:44.904778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 772/1547] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:44 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:45.297169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-604067d1-8408-4a98-a5dd-6f2378324263 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:45.297853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-604067d1-8408-4a98-a5dd-6f2378324263 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:45.304321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-604067d1-8408-4a98-a5dd-6f2378324263 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:45.304802 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-604067d1-8408-4a98-a5dd-6f2378324263 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:45.305566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-604067d1-8408-4a98-a5dd-6f2378324263 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:45.306003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-604067d1-8408-4a98-a5dd-6f2378324263 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:45.436716 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-604067d1-8408-4a98-a5dd-6f2378324263 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:45.444624 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-604067d1-8408-4a98-a5dd-6f2378324263 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152268 Aug 04 04:57:45.445181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 776/1548] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:45 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:45.924302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f25334f5-327a-41d5-b664-8cee9517bdf0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:45.924916 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f25334f5-327a-41d5-b664-8cee9517bdf0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:45.931344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f25334f5-327a-41d5-b664-8cee9517bdf0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:45.931786 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f25334f5-327a-41d5-b664-8cee9517bdf0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:45.932540 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f25334f5-327a-41d5-b664-8cee9517bdf0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:45.932972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f25334f5-327a-41d5-b664-8cee9517bdf0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:45.995808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f25334f5-327a-41d5-b664-8cee9517bdf0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:46.004100 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f25334f5-327a-41d5-b664-8cee9517bdf0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083925 Aug 04 04:57:46.004653 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 773/1549] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:45 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:46.465700 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-53429b14-c7d5-483b-841c-73384e53b21e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:46.466320 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-53429b14-c7d5-483b-841c-73384e53b21e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:46.472993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53429b14-c7d5-483b-841c-73384e53b21e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:46.473444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53429b14-c7d5-483b-841c-73384e53b21e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:46.474239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53429b14-c7d5-483b-841c-73384e53b21e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:46.474707 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-53429b14-c7d5-483b-841c-73384e53b21e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:46.609273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-53429b14-c7d5-483b-841c-73384e53b21e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:46.617427 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-53429b14-c7d5-483b-841c-73384e53b21e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.155625 Aug 04 04:57:46.618083 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 777/1550] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:46 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:47.025810 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b2fc5f53-81cd-45d9-91ed-f36b101c0294 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:47.026333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b2fc5f53-81cd-45d9-91ed-f36b101c0294 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:47.032725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b2fc5f53-81cd-45d9-91ed-f36b101c0294 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:47.033168 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b2fc5f53-81cd-45d9-91ed-f36b101c0294 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:47.033946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b2fc5f53-81cd-45d9-91ed-f36b101c0294 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:47.034377 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b2fc5f53-81cd-45d9-91ed-f36b101c0294 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:47.099858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b2fc5f53-81cd-45d9-91ed-f36b101c0294 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:47.109027 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b2fc5f53-81cd-45d9-91ed-f36b101c0294 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.087177 Aug 04 04:57:47.109617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 774/1551] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:47 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:47.639082 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-398bb5e8-0252-4bbd-b4e0-ac6b0c3d6f4c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:47.639694 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-398bb5e8-0252-4bbd-b4e0-ac6b0c3d6f4c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:47.646152 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-398bb5e8-0252-4bbd-b4e0-ac6b0c3d6f4c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:47.646600 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-398bb5e8-0252-4bbd-b4e0-ac6b0c3d6f4c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:47.647356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-398bb5e8-0252-4bbd-b4e0-ac6b0c3d6f4c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:47.647794 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-398bb5e8-0252-4bbd-b4e0-ac6b0c3d6f4c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:47.774546 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-398bb5e8-0252-4bbd-b4e0-ac6b0c3d6f4c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:47.783184 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-398bb5e8-0252-4bbd-b4e0-ac6b0c3d6f4c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148092 Aug 04 04:57:47.783734 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 778/1552] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:47 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:48.129863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-30cc0587-ec89-46b1-a600-f9d10da59732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:48.130481 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-30cc0587-ec89-46b1-a600-f9d10da59732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:48.136947 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-30cc0587-ec89-46b1-a600-f9d10da59732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:48.137405 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-30cc0587-ec89-46b1-a600-f9d10da59732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:48.138198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-30cc0587-ec89-46b1-a600-f9d10da59732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:48.139282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-30cc0587-ec89-46b1-a600-f9d10da59732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:48.199102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-30cc0587-ec89-46b1-a600-f9d10da59732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:48.207649 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-30cc0587-ec89-46b1-a600-f9d10da59732 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081620 Aug 04 04:57:48.208210 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 775/1553] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:48 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:48.804748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0b698408-ad55-4574-8f56-05f30f58ea93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:48.805359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0b698408-ad55-4574-8f56-05f30f58ea93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:48.812639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b698408-ad55-4574-8f56-05f30f58ea93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:48.813081 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b698408-ad55-4574-8f56-05f30f58ea93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:48.813862 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b698408-ad55-4574-8f56-05f30f58ea93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:48.814288 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b698408-ad55-4574-8f56-05f30f58ea93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:48.947618 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0b698408-ad55-4574-8f56-05f30f58ea93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:48.956385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0b698408-ad55-4574-8f56-05f30f58ea93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.155455 Aug 04 04:57:48.956942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 779/1554] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:48 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:49.228766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1d16f0db-c7a7-49d1-8ee6-6e787c195344 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:49.229315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1d16f0db-c7a7-49d1-8ee6-6e787c195344 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:49.236577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d16f0db-c7a7-49d1-8ee6-6e787c195344 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:49.237029 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d16f0db-c7a7-49d1-8ee6-6e787c195344 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:49.237813 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d16f0db-c7a7-49d1-8ee6-6e787c195344 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:49.238255 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d16f0db-c7a7-49d1-8ee6-6e787c195344 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:49.300662 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1d16f0db-c7a7-49d1-8ee6-6e787c195344 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:49.308992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1d16f0db-c7a7-49d1-8ee6-6e787c195344 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084110 Aug 04 04:57:49.309618 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 776/1555] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:49 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:49.977283 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dff6dbd1-b09c-4fbe-8974-b77a446a2eef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:49.977922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dff6dbd1-b09c-4fbe-8974-b77a446a2eef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:49.984878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dff6dbd1-b09c-4fbe-8974-b77a446a2eef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:49.985319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dff6dbd1-b09c-4fbe-8974-b77a446a2eef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:49.986099 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dff6dbd1-b09c-4fbe-8974-b77a446a2eef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:49.986529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dff6dbd1-b09c-4fbe-8974-b77a446a2eef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:50.113029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-dff6dbd1-b09c-4fbe-8974-b77a446a2eef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:50.115272 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:50.122128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dff6dbd1-b09c-4fbe-8974-b77a446a2eef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148803 Aug 04 04:57:50.123491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 780/1556] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:49 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:50.330933 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1c0b28ac-d204-4487-8848-065859f7a4c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:50.331465 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1c0b28ac-d204-4487-8848-065859f7a4c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:50.337873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c0b28ac-d204-4487-8848-065859f7a4c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:50.338319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c0b28ac-d204-4487-8848-065859f7a4c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:50.339071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c0b28ac-d204-4487-8848-065859f7a4c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:50.339503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c0b28ac-d204-4487-8848-065859f7a4c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:50.402431 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1c0b28ac-d204-4487-8848-065859f7a4c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:50.410816 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1c0b28ac-d204-4487-8848-065859f7a4c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083882 Aug 04 04:57:50.411375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 777/1557] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:50 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:51.144721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-557db874-a670-460a-afeb-b51908d75b2a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:51.145366 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-557db874-a670-460a-afeb-b51908d75b2a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:51.151935 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-557db874-a670-460a-afeb-b51908d75b2a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:51.152384 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-557db874-a670-460a-afeb-b51908d75b2a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:51.153139 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-557db874-a670-460a-afeb-b51908d75b2a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:51.153599 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-557db874-a670-460a-afeb-b51908d75b2a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:51.281266 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-557db874-a670-460a-afeb-b51908d75b2a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:51.289092 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-557db874-a670-460a-afeb-b51908d75b2a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148449 Aug 04 04:57:51.289665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 781/1558] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:51 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:51.432331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8dc67d23-880c-4528-b21f-e95944ebd833 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:51.432867 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8dc67d23-880c-4528-b21f-e95944ebd833 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:51.439900 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8dc67d23-880c-4528-b21f-e95944ebd833 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:51.440340 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8dc67d23-880c-4528-b21f-e95944ebd833 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:51.441094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8dc67d23-880c-4528-b21f-e95944ebd833 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:51.441525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8dc67d23-880c-4528-b21f-e95944ebd833 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:51.502582 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8dc67d23-880c-4528-b21f-e95944ebd833 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:51.510566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8dc67d23-880c-4528-b21f-e95944ebd833 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082262 Aug 04 04:57:51.511121 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 778/1559] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:51 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:52.312169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-20701070-409c-4932-977a-d0dff1b96655 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:52.312790 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-20701070-409c-4932-977a-d0dff1b96655 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:52.319351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20701070-409c-4932-977a-d0dff1b96655 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:52.319833 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20701070-409c-4932-977a-d0dff1b96655 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:52.320596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20701070-409c-4932-977a-d0dff1b96655 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:52.321034 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20701070-409c-4932-977a-d0dff1b96655 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:52.455976 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-20701070-409c-4932-977a-d0dff1b96655 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:52.464130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-20701070-409c-4932-977a-d0dff1b96655 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.157010 Aug 04 04:57:52.464694 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 782/1560] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:52 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:52.533320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-866e7f64-766f-45dc-acf1-10185787ec87 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:52.533968 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-866e7f64-766f-45dc-acf1-10185787ec87 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:52.540582 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-866e7f64-766f-45dc-acf1-10185787ec87 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:52.541027 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-866e7f64-766f-45dc-acf1-10185787ec87 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:52.541807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-866e7f64-766f-45dc-acf1-10185787ec87 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:52.542238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-866e7f64-766f-45dc-acf1-10185787ec87 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:52.607694 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-866e7f64-766f-45dc-acf1-10185787ec87 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:52.615662 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-866e7f64-766f-45dc-acf1-10185787ec87 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.087147 Aug 04 04:57:52.616219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 779/1561] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:52 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:53.486619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b0797b8e-901a-4c7b-b853-815d5e67f174 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:53.487239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b0797b8e-901a-4c7b-b853-815d5e67f174 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:53.493395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0797b8e-901a-4c7b-b853-815d5e67f174 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:53.493880 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0797b8e-901a-4c7b-b853-815d5e67f174 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:53.494639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0797b8e-901a-4c7b-b853-815d5e67f174 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:53.495075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0797b8e-901a-4c7b-b853-815d5e67f174 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:53.622224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b0797b8e-901a-4c7b-b853-815d5e67f174 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:53.631217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b0797b8e-901a-4c7b-b853-815d5e67f174 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149043 Aug 04 04:57:53.631787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 783/1562] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:53 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:53.636006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2a695ff9-63a6-4f4b-b0b4-72367e8dd925 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:53.636616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2a695ff9-63a6-4f4b-b0b4-72367e8dd925 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:53.643818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2a695ff9-63a6-4f4b-b0b4-72367e8dd925 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:53.644263 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2a695ff9-63a6-4f4b-b0b4-72367e8dd925 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:53.645015 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2a695ff9-63a6-4f4b-b0b4-72367e8dd925 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:53.645471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2a695ff9-63a6-4f4b-b0b4-72367e8dd925 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:53.708907 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2a695ff9-63a6-4f4b-b0b4-72367e8dd925 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:53.717480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2a695ff9-63a6-4f4b-b0b4-72367e8dd925 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085206 Aug 04 04:57:53.718070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 780/1563] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:53 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:54.653320 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-735b34ae-b6e0-4a8f-9c4c-4bb56777028b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:54.654008 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-735b34ae-b6e0-4a8f-9c4c-4bb56777028b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:54.660831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-735b34ae-b6e0-4a8f-9c4c-4bb56777028b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:54.661277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-735b34ae-b6e0-4a8f-9c4c-4bb56777028b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:54.662077 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-735b34ae-b6e0-4a8f-9c4c-4bb56777028b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:54.662513 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-735b34ae-b6e0-4a8f-9c4c-4bb56777028b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:54.738666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a5afcd3b-740c-43f6-aa30-e44668b83e29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:54.739306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a5afcd3b-740c-43f6-aa30-e44668b83e29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:54.745573 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a5afcd3b-740c-43f6-aa30-e44668b83e29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:54.746017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a5afcd3b-740c-43f6-aa30-e44668b83e29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:54.746774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a5afcd3b-740c-43f6-aa30-e44668b83e29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:54.747211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a5afcd3b-740c-43f6-aa30-e44668b83e29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:54.808852 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-735b34ae-b6e0-4a8f-9c4c-4bb56777028b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:54.817637 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-735b34ae-b6e0-4a8f-9c4c-4bb56777028b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.168280 Aug 04 04:57:54.818676 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 784/1564] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:54 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:54.821587 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a5afcd3b-740c-43f6-aa30-e44668b83e29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:54.830298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a5afcd3b-740c-43f6-aa30-e44668b83e29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.095425 Aug 04 04:57:54.830845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 781/1565] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:54 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:55.767536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-819a3b3f-f715-4249-869a-32dda7881003 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:55.768036 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-819a3b3f-f715-4249-869a-32dda7881003 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:55.773725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=52 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:55.775870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-819a3b3f-f715-4249-869a-32dda7881003 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:55.776646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-819a3b3f-f715-4249-869a-32dda7881003 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:55.777442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-819a3b3f-f715-4249-869a-32dda7881003 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:55.777964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-819a3b3f-f715-4249-869a-32dda7881003 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:55.810935 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-72f7351c-248b-4985-a049-7758d4a1d353 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:55.811358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-72f7351c-248b-4985-a049-7758d4a1d353 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:55.815351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=56 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:55.815755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-819a3b3f-f715-4249-869a-32dda7881003 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Going to try to terminate instance {{(pid=134884) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:57:55.822977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72f7351c-248b-4985-a049-7758d4a1d353 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:55.823457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72f7351c-248b-4985-a049-7758d4a1d353 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:55.824189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72f7351c-248b-4985-a049-7758d4a1d353 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:55.824621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72f7351c-248b-4985-a049-7758d4a1d353 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:55.843206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-72f7351c-248b-4985-a049-7758d4a1d353 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] HTTP exception thrown: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-72f7351c-248b-4985-a049-7758d4a1d353 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Request method failure captured: Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: DELETE /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 HTTP/1.1 Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi601qv00E86gDF5SzueP9-B8uyKvLj0nc6Sro2hqNRnxqf2FFlVY_GJALo_D0NGRq_yIC65WvSXE_w16sIVtcZnCaKtgGOc7rRi-c_pAJDe7GccoFXaRba4f_54MB_ilclV0cxbNI5IM7M76SLtoy4xBpnigqD0YOU-aN8nNE7xHgrj4 Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 157a41f0f76c41cb8dfff71a14138534 Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-AttachVolumeTestJSON-1618805094 Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 04:57:55.845049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 04:57:55.846538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_157a41f0f76c41cb8dfff71a14138534", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:57:55.846538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-AttachVolumeTestJSON-1618805094 Aug 04 04:57:55.846538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 157a41f0f76c41cb8dfff71a14138534 Aug 04 04:57:55.846538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1618805094 Aug 04 04:57:55.846538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-AttachVolumeTestJSON-1618805094-project Aug 04 04:57:55.846538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 04:57:55.846538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 04:57:55.846538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 12f7b1c19d824ac7b8207bf001b79057 Aug 04 04:57:55.846538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-AttachVolumeTestJSON-1618805094-project Aug 04 04:57:55.846538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 04:57:55.846538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:57:55.846538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': 'b1b6588e-407b-44d5-ab86-395074db1c22'} Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:57:55.847358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:57:55.848695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 04:57:55.853825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-72f7351c-248b-4985-a049-7758d4a1d353 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Returning 404 to user: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:57:55.853825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-72f7351c-248b-4985-a049-7758d4a1d353 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 404 len: 111 microversion: 2.1 time: 0.040109 Aug 04 04:57:55.853825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 782/1566] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:57:55 2022] DELETE /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:57:55.853825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-841f52cb-9543-4d07-92a1-c40e69e68eea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:55.853825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-841f52cb-9543-4d07-92a1-c40e69e68eea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:55.858763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-841f52cb-9543-4d07-92a1-c40e69e68eea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:55.859552 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-841f52cb-9543-4d07-92a1-c40e69e68eea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:55.860537 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-841f52cb-9543-4d07-92a1-c40e69e68eea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:55.861142 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-841f52cb-9543-4d07-92a1-c40e69e68eea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:55.915894 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-819a3b3f-f715-4249-869a-32dda7881003 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "DELETE /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 204 len: 0 microversion: 2.1 time: 0.152316 Aug 04 04:57:55.916738 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 785/1567] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:57:55 2022] DELETE /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:55.922605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-301dc26a-bd76-4374-9c6a-3640a92a1f70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:55.923309 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-301dc26a-bd76-4374-9c6a-3640a92a1f70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:55.930147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-301dc26a-bd76-4374-9c6a-3640a92a1f70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:55.930594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-301dc26a-bd76-4374-9c6a-3640a92a1f70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:55.931399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-301dc26a-bd76-4374-9c6a-3640a92a1f70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:55.931869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-301dc26a-bd76-4374-9c6a-3640a92a1f70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:56.002894 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-301dc26a-bd76-4374-9c6a-3640a92a1f70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:56.011223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-301dc26a-bd76-4374-9c6a-3640a92a1f70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.093341 Aug 04 04:57:56.011795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 786/1568] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:55 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:56.017202 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-715d8ecd-c3f3-42af-8168-ef6acc806988 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:56.017915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-715d8ecd-c3f3-42af-8168-ef6acc806988 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: b1b6588e-407b-44d5-ab86-395074db1c22] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:56.023735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-715d8ecd-c3f3-42af-8168-ef6acc806988 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:56.024178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-715d8ecd-c3f3-42af-8168-ef6acc806988 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:56.024938 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-715d8ecd-c3f3-42af-8168-ef6acc806988 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:56.025371 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-715d8ecd-c3f3-42af-8168-ef6acc806988 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:56.026080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-841f52cb-9543-4d07-92a1-c40e69e68eea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:56.034856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-841f52cb-9543-4d07-92a1-c40e69e68eea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.186615 Aug 04 04:57:56.035424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 783/1569] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:55 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:56.039831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4f28b4a6-4162-4a9e-8066-44e7713cf4f8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:56.040240 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-715d8ecd-c3f3-42af-8168-ef6acc806988 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] HTTP exception thrown: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:57:56.040545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4f28b4a6-4162-4a9e-8066-44e7713cf4f8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-715d8ecd-c3f3-42af-8168-ef6acc806988 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Request method failure captured: Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 HTTP/1.1 Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601qv00E86gDF5SzueP9-B8uyKvLj0nc6Sro2hqNRnxqf2FFlVY_GJALo_D0NGRq_yIC65WvSXE_w16sIVtcZnCaKtgGOc7rRi-c_pAJDe7GccoFXaRba4f_54MB_ilclV0cxbNI5IM7M76SLtoy4xBpnigqD0YOU-aN8nNE7xHgrj4 Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 157a41f0f76c41cb8dfff71a14138534 Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeTestJSON-1618805094 Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:57:56.042038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:57:56.043476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_157a41f0f76c41cb8dfff71a14138534", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:57:56.043476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeTestJSON-1618805094 Aug 04 04:57:56.043476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 157a41f0f76c41cb8dfff71a14138534 Aug 04 04:57:56.043476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1618805094 Aug 04 04:57:56.043476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeTestJSON-1618805094-project Aug 04 04:57:56.043476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:57:56.043476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:57:56.043476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 12f7b1c19d824ac7b8207bf001b79057 Aug 04 04:57:56.043476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeTestJSON-1618805094-project Aug 04 04:57:56.043476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 04:57:56.043476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:57:56.043476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'b1b6588e-407b-44d5-ab86-395074db1c22'} Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:57:56.044217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. Aug 04 04:57:56.045590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:57:56.047635 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-715d8ecd-c3f3-42af-8168-ef6acc806988 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Returning 404 to user: Instance b1b6588e-407b-44d5-ab86-395074db1c22 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:57:56.047635 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-715d8ecd-c3f3-42af-8168-ef6acc806988 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22" status: 404 len: 111 microversion: 2.1 time: 0.030705 Aug 04 04:57:56.047635 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 787/1570] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:56 2022] GET /compute/v2.1/servers/b1b6588e-407b-44d5-ab86-395074db1c22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 04:57:56.050088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f28b4a6-4162-4a9e-8066-44e7713cf4f8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:56.050417 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b543b458-8ac9-4143-82d5-c2fe874c90d2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:56.050532 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f28b4a6-4162-4a9e-8066-44e7713cf4f8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:56.051160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b543b458-8ac9-4143-82d5-c2fe874c90d2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:56.051290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f28b4a6-4162-4a9e-8066-44e7713cf4f8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:56.051731 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4f28b4a6-4162-4a9e-8066-44e7713cf4f8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:56.057156 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b543b458-8ac9-4143-82d5-c2fe874c90d2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:56.057627 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b543b458-8ac9-4143-82d5-c2fe874c90d2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:56.058386 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b543b458-8ac9-4143-82d5-c2fe874c90d2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:56.058835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b543b458-8ac9-4143-82d5-c2fe874c90d2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:56.080215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4f28b4a6-4162-4a9e-8066-44e7713cf4f8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Going to try to terminate instance {{(pid=134883) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 04:57:56.115475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:57:56.160079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4f28b4a6-4162-4a9e-8066-44e7713cf4f8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 204 len: 0 microversion: 2.1 time: 0.123428 Aug 04 04:57:56.160667 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 784/1571] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 04:57:56 2022] DELETE /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 04:57:56.168998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-46209fde-1f46-4422-b63e-e4c1a042d622 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:56.170428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-46209fde-1f46-4422-b63e-e4c1a042d622 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:56.176666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-46209fde-1f46-4422-b63e-e4c1a042d622 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:56.177123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-46209fde-1f46-4422-b63e-e4c1a042d622 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:56.177951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-46209fde-1f46-4422-b63e-e4c1a042d622 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:56.178410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-46209fde-1f46-4422-b63e-e4c1a042d622 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:56.195899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b543b458-8ac9-4143-82d5-c2fe874c90d2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:56.205022 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b543b458-8ac9-4143-82d5-c2fe874c90d2 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 200 len: 1681 microversion: 2.1 time: 0.160077 Aug 04 04:57:56.205884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 788/1572] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:56 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:56.313852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-46209fde-1f46-4422-b63e-e4c1a042d622 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:56.321821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-46209fde-1f46-4422-b63e-e4c1a042d622 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.157009 Aug 04 04:57:56.322382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 785/1573] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:56 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:57.032883 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d7c76bba-9ab5-4823-83de-b125ef641d73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:57.033528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d7c76bba-9ab5-4823-83de-b125ef641d73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:57.040065 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7c76bba-9ab5-4823-83de-b125ef641d73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:57.040511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7c76bba-9ab5-4823-83de-b125ef641d73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:57.041287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7c76bba-9ab5-4823-83de-b125ef641d73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:57.041740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7c76bba-9ab5-4823-83de-b125ef641d73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:57.057454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-906a94c3-6794-4676-90a8-a1e523cc3d54 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:57.058197 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-906a94c3-6794-4676-90a8-a1e523cc3d54 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:57.065097 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-906a94c3-6794-4676-90a8-a1e523cc3d54 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:57.065572 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-906a94c3-6794-4676-90a8-a1e523cc3d54 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:57.066361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-906a94c3-6794-4676-90a8-a1e523cc3d54 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:57.066796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-906a94c3-6794-4676-90a8-a1e523cc3d54 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:57.114828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d7c76bba-9ab5-4823-83de-b125ef641d73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:57.123622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d7c76bba-9ab5-4823-83de-b125ef641d73 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.095111 Aug 04 04:57:57.124421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 789/1574] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:57 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:57.207960 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-906a94c3-6794-4676-90a8-a1e523cc3d54 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:57.216691 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-906a94c3-6794-4676-90a8-a1e523cc3d54 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.162803 Aug 04 04:57:57.217605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 786/1575] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:57 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:57:57.231390 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8a077d4e-5d22-411c-aa22-9f26aea64786 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:57.232526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8a077d4e-5d22-411c-aa22-9f26aea64786 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:57.239845 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a077d4e-5d22-411c-aa22-9f26aea64786 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:57.240375 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a077d4e-5d22-411c-aa22-9f26aea64786 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:57.241158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a077d4e-5d22-411c-aa22-9f26aea64786 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:57.241694 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a077d4e-5d22-411c-aa22-9f26aea64786 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:57.313374 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8a077d4e-5d22-411c-aa22-9f26aea64786 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49a7ce9a27734dc0a187d1b217206785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9124d19d48f44fe2a904a715e5db1223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:57.321271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8a077d4e-5d22-411c-aa22-9f26aea64786 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 200 len: 1614 microversion: 2.1 time: 0.094153 Aug 04 04:57:57.322077 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 790/1576] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:57 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:57.343397 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ebd0e50b-c307-4cc5-9663-c3d81774cd2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:57.344010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ebd0e50b-c307-4cc5-9663-c3d81774cd2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:57.351354 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ebd0e50b-c307-4cc5-9663-c3d81774cd2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:57.352080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ebd0e50b-c307-4cc5-9663-c3d81774cd2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:57.352849 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ebd0e50b-c307-4cc5-9663-c3d81774cd2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:57.353284 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ebd0e50b-c307-4cc5-9663-c3d81774cd2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:57.441694 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-27465cad-0a8a-4aaf-b74c-06ed383a2bf6 req-e47b158c-a61a-4fc4-9553-4bdc5b3c8756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c8e2da-dd45-499e-9704-5a6e5d507640", "name": "network-vif-deleted", "tag": "3399152a-466f-40e5-afee-45921e9ea5de"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 04:57:57.455144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-27465cad-0a8a-4aaf-b74c-06ed383a2bf6 req-e47b158c-a61a-4fc4-9553-4bdc5b3c8756 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:57.455795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-27465cad-0a8a-4aaf-b74c-06ed383a2bf6 req-e47b158c-a61a-4fc4-9553-4bdc5b3c8756 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:57.469477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-27465cad-0a8a-4aaf-b74c-06ed383a2bf6 req-e47b158c-a61a-4fc4-9553-4bdc5b3c8756 service nova] Creating event network-vif-deleted:3399152a-466f-40e5-afee-45921e9ea5de for instance 47c8e2da-dd45-499e-9704-5a6e5d507640 on hv-cinder-85127 Aug 04 04:57:57.474859 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-27465cad-0a8a-4aaf-b74c-06ed383a2bf6 req-e47b158c-a61a-4fc4-9553-4bdc5b3c8756 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040121 Aug 04 04:57:57.475866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 791/1577] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 04:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 04:57:57.520941 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ebd0e50b-c307-4cc5-9663-c3d81774cd2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:57.531237 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ebd0e50b-c307-4cc5-9663-c3d81774cd2b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.192134 Aug 04 04:57:57.531822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 787/1578] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:57 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:58.145610 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-180a5621-ae7d-4d65-970d-cf7950c45f23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:58.146346 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-180a5621-ae7d-4d65-970d-cf7950c45f23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:58.152564 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-180a5621-ae7d-4d65-970d-cf7950c45f23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.153013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-180a5621-ae7d-4d65-970d-cf7950c45f23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.154373 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-180a5621-ae7d-4d65-970d-cf7950c45f23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.155206 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-180a5621-ae7d-4d65-970d-cf7950c45f23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.219496 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-180a5621-ae7d-4d65-970d-cf7950c45f23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:58.227567 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-180a5621-ae7d-4d65-970d-cf7950c45f23 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086663 Aug 04 04:57:58.228132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 792/1579] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:58 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:58.239051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-188a2985-606a-4719-80ac-1163df6ed2d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:58.239957 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-188a2985-606a-4719-80ac-1163df6ed2d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:58.247389 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-188a2985-606a-4719-80ac-1163df6ed2d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.248087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-188a2985-606a-4719-80ac-1163df6ed2d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.248919 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-188a2985-606a-4719-80ac-1163df6ed2d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.249460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-188a2985-606a-4719-80ac-1163df6ed2d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.343923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-452956e3-f53f-4754-852b-fb21aba22d7a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:58.344681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-452956e3-f53f-4754-852b-fb21aba22d7a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:58.351883 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-452956e3-f53f-4754-852b-fb21aba22d7a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.352443 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-452956e3-f53f-4754-852b-fb21aba22d7a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.353291 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-452956e3-f53f-4754-852b-fb21aba22d7a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.353827 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-452956e3-f53f-4754-852b-fb21aba22d7a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.370246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-452956e3-f53f-4754-852b-fb21aba22d7a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] HTTP exception thrown: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-452956e3-f53f-4754-852b-fb21aba22d7a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Request method failure captured: Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 HTTP/1.1 Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601nPjLcmPV0vVg2FNKyAsUUje18RWIG_TxIfWC210jnaphASZrRhZyq9Y_SDchjVsQCYWSIYUoM5T9CtXKQ_J1Fh7Tjbxe-nlzSYrFMa_gd3dtSn8J6vs-YriYCapLoJ7GeQWUpW8try5lu_qo4lbCzvyB9WeIJv208TzJ5f7iZnds Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 04:57:58.372089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 04:57:58.374132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9124d19d48f44fe2a904a715e5db1223", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 04:57:58.374132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:57:58.374132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 04:57:58.374132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 04:57:58.374132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 04:57:58.374132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 04:57:58.374132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 04:57:58.374132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 49a7ce9a27734dc0a187d1b217206785 Aug 04 04:57:58.374132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 04:57:58.374132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 04:57:58.374132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 04:57:58.374132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '47c8e2da-dd45-499e-9704-5a6e5d507640'} Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 04:57:58.375073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 04:57:58.376352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 04:57:58.377757 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-452956e3-f53f-4754-852b-fb21aba22d7a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Returning 404 to user: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 04:57:58.377757 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-452956e3-f53f-4754-852b-fb21aba22d7a tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 404 len: 111 microversion: 2.1 time: 0.035181 Aug 04 04:57:58.377757 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 793/1580] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:58 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 04:57:58.383993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c9b56d08-6a73-44bf-90fc-f4aac21356b6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '.version_select at 0x7fc94200bc10>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:58.391561 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-188a2985-606a-4719-80ac-1163df6ed2d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:58.400251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-188a2985-606a-4719-80ac-1163df6ed2d1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.165271 Aug 04 04:57:58.400823 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 788/1581] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:58 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:58.417409 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c9b56d08-6a73-44bf-90fc-f4aac21356b6 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-94887190" status: 202 len: 0 microversion: 2.1 time: 0.037005 Aug 04 04:57:58.418050 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 794/1582] 10.222.0.47 () {58 vars in 1215 bytes} [Thu Aug 4 04:57:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-94887190 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 04:57:58.553162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-712e50b0-e074-4b43-bda3-3fc018075c04 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:58.553915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-712e50b0-e074-4b43-bda3-3fc018075c04 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:58.561963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-712e50b0-e074-4b43-bda3-3fc018075c04 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.562472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-712e50b0-e074-4b43-bda3-3fc018075c04 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.563317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-712e50b0-e074-4b43-bda3-3fc018075c04 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:58.563850 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-712e50b0-e074-4b43-bda3-3fc018075c04 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:58.708814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-712e50b0-e074-4b43-bda3-3fc018075c04 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:58.717489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-712e50b0-e074-4b43-bda3-3fc018075c04 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.168494 Aug 04 04:57:58.718022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 789/1583] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:58 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:59.250657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9699ed8f-a291-4a3b-9b84-2f7e22463843 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:59.251204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9699ed8f-a291-4a3b-9b84-2f7e22463843 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:59.258052 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9699ed8f-a291-4a3b-9b84-2f7e22463843 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:59.258506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9699ed8f-a291-4a3b-9b84-2f7e22463843 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:59.259265 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9699ed8f-a291-4a3b-9b84-2f7e22463843 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:59.259704 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9699ed8f-a291-4a3b-9b84-2f7e22463843 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:59.318981 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9699ed8f-a291-4a3b-9b84-2f7e22463843 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:59.326888 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9699ed8f-a291-4a3b-9b84-2f7e22463843 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081498 Aug 04 04:57:59.327470 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 795/1584] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:59 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:59.424504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-18d19641-de4e-4f78-8ebf-009601e7905b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:59.425111 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-18d19641-de4e-4f78-8ebf-009601e7905b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:59.431643 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-18d19641-de4e-4f78-8ebf-009601e7905b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:59.432090 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-18d19641-de4e-4f78-8ebf-009601e7905b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:59.432839 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-18d19641-de4e-4f78-8ebf-009601e7905b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:59.433357 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-18d19641-de4e-4f78-8ebf-009601e7905b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:59.567214 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-18d19641-de4e-4f78-8ebf-009601e7905b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:59.575078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-18d19641-de4e-4f78-8ebf-009601e7905b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154673 Aug 04 04:57:59.575748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 790/1585] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:59 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:57:59.739057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0e4c597a-d0ae-4a57-bdbf-cf0a741832b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:57:59.739670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0e4c597a-d0ae-4a57-bdbf-cf0a741832b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:57:59.745683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0e4c597a-d0ae-4a57-bdbf-cf0a741832b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:59.746131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0e4c597a-d0ae-4a57-bdbf-cf0a741832b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:59.746887 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0e4c597a-d0ae-4a57-bdbf-cf0a741832b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:57:59.748571 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0e4c597a-d0ae-4a57-bdbf-cf0a741832b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:57:59.878943 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0e4c597a-d0ae-4a57-bdbf-cf0a741832b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:57:59.886932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0e4c597a-d0ae-4a57-bdbf-cf0a741832b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151754 Aug 04 04:57:59.887534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 796/1586] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:57:59 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:00.348533 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c6070567-0eb6-4ca4-8506-43a4dcf34e6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:00.349107 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c6070567-0eb6-4ca4-8506-43a4dcf34e6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:00.355224 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c6070567-0eb6-4ca4-8506-43a4dcf34e6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:00.355677 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c6070567-0eb6-4ca4-8506-43a4dcf34e6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:00.356443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c6070567-0eb6-4ca4-8506-43a4dcf34e6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:00.357609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c6070567-0eb6-4ca4-8506-43a4dcf34e6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:00.416486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c6070567-0eb6-4ca4-8506-43a4dcf34e6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:00.425745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c6070567-0eb6-4ca4-8506-43a4dcf34e6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081061 Aug 04 04:58:00.426926 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 791/1587] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:00 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:00.596687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e4e07628-f532-4ddb-9406-1d8e4e797476 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:00.597310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e4e07628-f532-4ddb-9406-1d8e4e797476 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:00.604032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e4e07628-f532-4ddb-9406-1d8e4e797476 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:00.604427 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e4e07628-f532-4ddb-9406-1d8e4e797476 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:00.605195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e4e07628-f532-4ddb-9406-1d8e4e797476 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:00.605661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e4e07628-f532-4ddb-9406-1d8e4e797476 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:00.736307 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e4e07628-f532-4ddb-9406-1d8e4e797476 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:00.744097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e4e07628-f532-4ddb-9406-1d8e4e797476 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151301 Aug 04 04:58:00.744659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 797/1588] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:00 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:00.908016 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-78b30bd5-4430-494e-bfa6-bdc3e83bf0c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:00.908551 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-78b30bd5-4430-494e-bfa6-bdc3e83bf0c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:00.915018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78b30bd5-4430-494e-bfa6-bdc3e83bf0c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:00.915461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78b30bd5-4430-494e-bfa6-bdc3e83bf0c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:00.916215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78b30bd5-4430-494e-bfa6-bdc3e83bf0c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:00.916648 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78b30bd5-4430-494e-bfa6-bdc3e83bf0c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:01.044678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-78b30bd5-4430-494e-bfa6-bdc3e83bf0c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:01.052818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-78b30bd5-4430-494e-bfa6-bdc3e83bf0c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148769 Aug 04 04:58:01.053376 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 792/1589] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:00 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:01.446577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-aef30101-bcb1-440d-ba17-87e104189360 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:01.447197 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-aef30101-bcb1-440d-ba17-87e104189360 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:01.453851 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aef30101-bcb1-440d-ba17-87e104189360 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:01.454299 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aef30101-bcb1-440d-ba17-87e104189360 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:01.455057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aef30101-bcb1-440d-ba17-87e104189360 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:01.455494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aef30101-bcb1-440d-ba17-87e104189360 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:01.518249 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-aef30101-bcb1-440d-ba17-87e104189360 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:01.520565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:01.528036 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-aef30101-bcb1-440d-ba17-87e104189360 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085284 Aug 04 04:58:01.529256 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 798/1590] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:01 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:01.764940 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e660a290-ebc6-4816-9649-c5ede9522dba tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:01.765503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e660a290-ebc6-4816-9649-c5ede9522dba tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:01.771556 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e660a290-ebc6-4816-9649-c5ede9522dba tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:01.772005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e660a290-ebc6-4816-9649-c5ede9522dba tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:01.772780 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e660a290-ebc6-4816-9649-c5ede9522dba tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:01.773205 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e660a290-ebc6-4816-9649-c5ede9522dba tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:01.901935 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e660a290-ebc6-4816-9649-c5ede9522dba tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:01.910228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e660a290-ebc6-4816-9649-c5ede9522dba tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149299 Aug 04 04:58:01.910773 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 793/1591] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:01 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:02.074256 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7bc0c4c6-7737-4e13-9055-81c4290e19b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:02.074870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7bc0c4c6-7737-4e13-9055-81c4290e19b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:02.083394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7bc0c4c6-7737-4e13-9055-81c4290e19b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:02.083840 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7bc0c4c6-7737-4e13-9055-81c4290e19b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:02.084602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7bc0c4c6-7737-4e13-9055-81c4290e19b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:02.085035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7bc0c4c6-7737-4e13-9055-81c4290e19b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:02.211298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7bc0c4c6-7737-4e13-9055-81c4290e19b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:02.219804 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7bc0c4c6-7737-4e13-9055-81c4290e19b7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149434 Aug 04 04:58:02.220360 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 799/1592] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:02 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:02.550789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4aae7af5-7ddc-47fc-9774-36da1e7b303a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:02.551396 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4aae7af5-7ddc-47fc-9774-36da1e7b303a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:02.558192 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4aae7af5-7ddc-47fc-9774-36da1e7b303a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:02.558634 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4aae7af5-7ddc-47fc-9774-36da1e7b303a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:02.559382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4aae7af5-7ddc-47fc-9774-36da1e7b303a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:02.559869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4aae7af5-7ddc-47fc-9774-36da1e7b303a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:02.623878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4aae7af5-7ddc-47fc-9774-36da1e7b303a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:02.631922 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4aae7af5-7ddc-47fc-9774-36da1e7b303a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085196 Aug 04 04:58:02.632479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 794/1593] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:02 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:02.931760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f0f5bf94-53b9-4ecc-a5aa-c2d183e5b40b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:02.932381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f0f5bf94-53b9-4ecc-a5aa-c2d183e5b40b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:02.939126 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f0f5bf94-53b9-4ecc-a5aa-c2d183e5b40b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:02.939573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f0f5bf94-53b9-4ecc-a5aa-c2d183e5b40b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:02.940330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f0f5bf94-53b9-4ecc-a5aa-c2d183e5b40b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:02.940763 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f0f5bf94-53b9-4ecc-a5aa-c2d183e5b40b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:03.067876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f0f5bf94-53b9-4ecc-a5aa-c2d183e5b40b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:03.075795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f0f5bf94-53b9-4ecc-a5aa-c2d183e5b40b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.147875 Aug 04 04:58:03.076393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 800/1594] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:02 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:03.240969 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5c311330-07c6-4f3b-9f97-3f88692a881a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:03.241484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5c311330-07c6-4f3b-9f97-3f88692a881a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:03.247529 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c311330-07c6-4f3b-9f97-3f88692a881a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:03.247970 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c311330-07c6-4f3b-9f97-3f88692a881a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:03.248718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c311330-07c6-4f3b-9f97-3f88692a881a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:03.249730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c311330-07c6-4f3b-9f97-3f88692a881a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:03.379203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5c311330-07c6-4f3b-9f97-3f88692a881a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:03.387112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5c311330-07c6-4f3b-9f97-3f88692a881a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150069 Aug 04 04:58:03.387661 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 795/1595] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:03 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:03.653256 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f8f452cc-a6a6-4c51-88ea-ee2762b26954 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:03.653902 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f8f452cc-a6a6-4c51-88ea-ee2762b26954 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:03.660961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8f452cc-a6a6-4c51-88ea-ee2762b26954 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:03.661405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8f452cc-a6a6-4c51-88ea-ee2762b26954 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:03.662185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8f452cc-a6a6-4c51-88ea-ee2762b26954 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:03.662620 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8f452cc-a6a6-4c51-88ea-ee2762b26954 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:03.734168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f8f452cc-a6a6-4c51-88ea-ee2762b26954 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:03.742041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f8f452cc-a6a6-4c51-88ea-ee2762b26954 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.092675 Aug 04 04:58:03.742598 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 801/1596] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:03 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:04.098471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b279954d-5b62-4bc1-8f28-96cbf2d5b0d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:04.099001 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b279954d-5b62-4bc1-8f28-96cbf2d5b0d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:04.105491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b279954d-5b62-4bc1-8f28-96cbf2d5b0d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:04.105970 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b279954d-5b62-4bc1-8f28-96cbf2d5b0d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:04.106723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b279954d-5b62-4bc1-8f28-96cbf2d5b0d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:04.107156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b279954d-5b62-4bc1-8f28-96cbf2d5b0d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:04.235381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b279954d-5b62-4bc1-8f28-96cbf2d5b0d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:04.243236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b279954d-5b62-4bc1-8f28-96cbf2d5b0d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148750 Aug 04 04:58:04.243812 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 796/1597] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:04 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:04.408445 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7746f555-ab88-4daa-8ee4-0c38e5db96ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:04.408964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7746f555-ab88-4daa-8ee4-0c38e5db96ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:04.415108 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7746f555-ab88-4daa-8ee4-0c38e5db96ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:04.415559 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7746f555-ab88-4daa-8ee4-0c38e5db96ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:04.416341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7746f555-ab88-4daa-8ee4-0c38e5db96ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:04.416774 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7746f555-ab88-4daa-8ee4-0c38e5db96ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:04.547759 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7746f555-ab88-4daa-8ee4-0c38e5db96ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:04.555684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7746f555-ab88-4daa-8ee4-0c38e5db96ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151329 Aug 04 04:58:04.556243 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 802/1598] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:04 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:04.762613 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d79db140-bca7-4818-92b3-8c66240eed6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:04.763251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d79db140-bca7-4818-92b3-8c66240eed6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:04.770285 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d79db140-bca7-4818-92b3-8c66240eed6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:04.770734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d79db140-bca7-4818-92b3-8c66240eed6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:04.771487 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d79db140-bca7-4818-92b3-8c66240eed6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:04.771922 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d79db140-bca7-4818-92b3-8c66240eed6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:04.836095 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d79db140-bca7-4818-92b3-8c66240eed6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:04.844508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d79db140-bca7-4818-92b3-8c66240eed6a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085783 Aug 04 04:58:04.845070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 797/1599] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:04 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:05.264739 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-044b7c32-aa28-4a01-86c4-0599f0cc0d96 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:05.265413 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-044b7c32-aa28-4a01-86c4-0599f0cc0d96 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:05.271974 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-044b7c32-aa28-4a01-86c4-0599f0cc0d96 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:05.272420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-044b7c32-aa28-4a01-86c4-0599f0cc0d96 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:05.273181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-044b7c32-aa28-4a01-86c4-0599f0cc0d96 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:05.273640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-044b7c32-aa28-4a01-86c4-0599f0cc0d96 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:05.400800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-044b7c32-aa28-4a01-86c4-0599f0cc0d96 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:05.409751 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-044b7c32-aa28-4a01-86c4-0599f0cc0d96 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148978 Aug 04 04:58:05.410361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 803/1600] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:05 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:05.578786 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b1bf4634-40d4-4caa-b231-22709cea9caa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:05.579406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b1bf4634-40d4-4caa-b231-22709cea9caa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:05.585893 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b1bf4634-40d4-4caa-b231-22709cea9caa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:05.586350 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b1bf4634-40d4-4caa-b231-22709cea9caa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:05.587111 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b1bf4634-40d4-4caa-b231-22709cea9caa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:05.587550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b1bf4634-40d4-4caa-b231-22709cea9caa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:05.714692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b1bf4634-40d4-4caa-b231-22709cea9caa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:05.723069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b1bf4634-40d4-4caa-b231-22709cea9caa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148746 Aug 04 04:58:05.723629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 798/1601] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:05 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:05.864702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7c02c2dd-1375-48a6-83a1-5b6ab5e0d529 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:05.865256 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7c02c2dd-1375-48a6-83a1-5b6ab5e0d529 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:05.871318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c02c2dd-1375-48a6-83a1-5b6ab5e0d529 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:05.871769 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c02c2dd-1375-48a6-83a1-5b6ab5e0d529 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:05.872524 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c02c2dd-1375-48a6-83a1-5b6ab5e0d529 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:05.872959 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c02c2dd-1375-48a6-83a1-5b6ab5e0d529 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:05.937011 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7c02c2dd-1375-48a6-83a1-5b6ab5e0d529 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:05.944965 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7c02c2dd-1375-48a6-83a1-5b6ab5e0d529 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084223 Aug 04 04:58:05.945551 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 804/1602] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:05 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:06.431907 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e19563af-52e5-4faf-8329-ba17517bcdc0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:06.432468 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e19563af-52e5-4faf-8329-ba17517bcdc0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:06.438878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e19563af-52e5-4faf-8329-ba17517bcdc0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:06.439323 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e19563af-52e5-4faf-8329-ba17517bcdc0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:06.440075 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e19563af-52e5-4faf-8329-ba17517bcdc0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:06.440506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e19563af-52e5-4faf-8329-ba17517bcdc0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:06.572306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e19563af-52e5-4faf-8329-ba17517bcdc0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:06.580326 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e19563af-52e5-4faf-8329-ba17517bcdc0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152518 Aug 04 04:58:06.580920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 799/1603] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:06 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:06.744581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2e89b58d-4273-45a7-ae99-5443bd077e40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:06.745127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2e89b58d-4273-45a7-ae99-5443bd077e40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:06.751837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e89b58d-4273-45a7-ae99-5443bd077e40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:06.752290 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e89b58d-4273-45a7-ae99-5443bd077e40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:06.753060 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e89b58d-4273-45a7-ae99-5443bd077e40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:06.753503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e89b58d-4273-45a7-ae99-5443bd077e40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:06.882863 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2e89b58d-4273-45a7-ae99-5443bd077e40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:06.891583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2e89b58d-4273-45a7-ae99-5443bd077e40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151092 Aug 04 04:58:06.892144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 805/1604] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:06 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:06.965927 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-223c75c3-4af1-4a63-a14e-a41dba0af779 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:06.966545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-223c75c3-4af1-4a63-a14e-a41dba0af779 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:06.973201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-223c75c3-4af1-4a63-a14e-a41dba0af779 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:06.973715 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-223c75c3-4af1-4a63-a14e-a41dba0af779 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:06.974479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-223c75c3-4af1-4a63-a14e-a41dba0af779 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:06.974918 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-223c75c3-4af1-4a63-a14e-a41dba0af779 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:07.038354 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-223c75c3-4af1-4a63-a14e-a41dba0af779 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:07.040623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:07.047781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-223c75c3-4af1-4a63-a14e-a41dba0af779 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085711 Aug 04 04:58:07.048339 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 800/1605] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:06 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:07.601699 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bccceb61-d140-4dff-9d0b-da771c4fdb66 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:07.602314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bccceb61-d140-4dff-9d0b-da771c4fdb66 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:07.608932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bccceb61-d140-4dff-9d0b-da771c4fdb66 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:07.609380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bccceb61-d140-4dff-9d0b-da771c4fdb66 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:07.610160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bccceb61-d140-4dff-9d0b-da771c4fdb66 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:07.610593 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bccceb61-d140-4dff-9d0b-da771c4fdb66 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:07.738355 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bccceb61-d140-4dff-9d0b-da771c4fdb66 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:07.746222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bccceb61-d140-4dff-9d0b-da771c4fdb66 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148448 Aug 04 04:58:07.746794 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 806/1606] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:07 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:07.913134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-df6a1b93-b910-4d6e-9cd6-8ddeee2ddd5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:07.913770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-df6a1b93-b910-4d6e-9cd6-8ddeee2ddd5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:07.921764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-df6a1b93-b910-4d6e-9cd6-8ddeee2ddd5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:07.922228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-df6a1b93-b910-4d6e-9cd6-8ddeee2ddd5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:07.922977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-df6a1b93-b910-4d6e-9cd6-8ddeee2ddd5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:07.923410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-df6a1b93-b910-4d6e-9cd6-8ddeee2ddd5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:08.051191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-df6a1b93-b910-4d6e-9cd6-8ddeee2ddd5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:08.059098 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-df6a1b93-b910-4d6e-9cd6-8ddeee2ddd5d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149760 Aug 04 04:58:08.059654 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 801/1607] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:07 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:08.068339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-983f5203-45b2-4784-ae44-ed360eb3da78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:08.069031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-983f5203-45b2-4784-ae44-ed360eb3da78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:08.075548 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-983f5203-45b2-4784-ae44-ed360eb3da78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:08.075998 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-983f5203-45b2-4784-ae44-ed360eb3da78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:08.076754 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-983f5203-45b2-4784-ae44-ed360eb3da78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:08.078090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-983f5203-45b2-4784-ae44-ed360eb3da78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:08.142385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-983f5203-45b2-4784-ae44-ed360eb3da78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:08.150314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-983f5203-45b2-4784-ae44-ed360eb3da78 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085732 Aug 04 04:58:08.150878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 807/1608] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:08.767934 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-13bce1fb-17e9-48aa-87c2-dbc95018af09 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:08.768464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-13bce1fb-17e9-48aa-87c2-dbc95018af09 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:08.774486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13bce1fb-17e9-48aa-87c2-dbc95018af09 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:08.774941 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13bce1fb-17e9-48aa-87c2-dbc95018af09 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:08.775699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13bce1fb-17e9-48aa-87c2-dbc95018af09 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:08.776132 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13bce1fb-17e9-48aa-87c2-dbc95018af09 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:08.903288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-13bce1fb-17e9-48aa-87c2-dbc95018af09 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:08.911725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-13bce1fb-17e9-48aa-87c2-dbc95018af09 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148359 Aug 04 04:58:08.912283 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 802/1609] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:08 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:09.081842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b0094ed7-da7d-49fe-a70b-7eac23c76559 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:09.082461 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b0094ed7-da7d-49fe-a70b-7eac23c76559 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:09.088928 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0094ed7-da7d-49fe-a70b-7eac23c76559 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:09.089378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0094ed7-da7d-49fe-a70b-7eac23c76559 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:09.090178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0094ed7-da7d-49fe-a70b-7eac23c76559 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:09.090615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0094ed7-da7d-49fe-a70b-7eac23c76559 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:09.171354 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f1cb8a2b-902b-4aa1-a3ba-6661e5d53660 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:09.172244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f1cb8a2b-902b-4aa1-a3ba-6661e5d53660 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:09.179013 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1cb8a2b-902b-4aa1-a3ba-6661e5d53660 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:09.179467 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1cb8a2b-902b-4aa1-a3ba-6661e5d53660 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:09.180240 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1cb8a2b-902b-4aa1-a3ba-6661e5d53660 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:09.180680 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f1cb8a2b-902b-4aa1-a3ba-6661e5d53660 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:09.218596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b0094ed7-da7d-49fe-a70b-7eac23c76559 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:09.226773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b0094ed7-da7d-49fe-a70b-7eac23c76559 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148848 Aug 04 04:58:09.227426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 808/1610] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:09 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:09.248248 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f1cb8a2b-902b-4aa1-a3ba-6661e5d53660 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:09.256929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f1cb8a2b-902b-4aa1-a3ba-6661e5d53660 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.089712 Aug 04 04:58:09.257484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 803/1611] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:09 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:09.933173 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f525459a-ba8a-4ace-a39f-475641f51583 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:09.933813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f525459a-ba8a-4ace-a39f-475641f51583 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:09.939907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f525459a-ba8a-4ace-a39f-475641f51583 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:09.940350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f525459a-ba8a-4ace-a39f-475641f51583 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:09.941098 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f525459a-ba8a-4ace-a39f-475641f51583 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:09.941530 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f525459a-ba8a-4ace-a39f-475641f51583 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:10.069916 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f525459a-ba8a-4ace-a39f-475641f51583 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:10.078349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f525459a-ba8a-4ace-a39f-475641f51583 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148980 Aug 04 04:58:10.078896 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 809/1612] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:09 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:10.248159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-24c7fdf9-c11b-44c1-ba16-496aaf8600ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:10.249397 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-24c7fdf9-c11b-44c1-ba16-496aaf8600ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:10.255923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24c7fdf9-c11b-44c1-ba16-496aaf8600ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:10.256370 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24c7fdf9-c11b-44c1-ba16-496aaf8600ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:10.257125 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24c7fdf9-c11b-44c1-ba16-496aaf8600ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:10.257566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24c7fdf9-c11b-44c1-ba16-496aaf8600ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:10.277796 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-42739beb-2672-4468-bd83-ade3766eed29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:10.278612 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-42739beb-2672-4468-bd83-ade3766eed29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:10.285144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-42739beb-2672-4468-bd83-ade3766eed29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:10.285633 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-42739beb-2672-4468-bd83-ade3766eed29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:10.286462 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-42739beb-2672-4468-bd83-ade3766eed29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:10.286898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-42739beb-2672-4468-bd83-ade3766eed29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:10.357989 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-42739beb-2672-4468-bd83-ade3766eed29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:10.366039 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-42739beb-2672-4468-bd83-ade3766eed29 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.092314 Aug 04 04:58:10.366606 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 810/1613] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:10.412792 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-24c7fdf9-c11b-44c1-ba16-496aaf8600ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:10.420777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-24c7fdf9-c11b-44c1-ba16-496aaf8600ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.176475 Aug 04 04:58:10.421337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 804/1614] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:10 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:11.099466 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-475f5bb3-158d-4719-92a9-e3f10c439a56 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:11.100100 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-475f5bb3-158d-4719-92a9-e3f10c439a56 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:11.106072 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-475f5bb3-158d-4719-92a9-e3f10c439a56 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:11.106530 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-475f5bb3-158d-4719-92a9-e3f10c439a56 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:11.107262 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-475f5bb3-158d-4719-92a9-e3f10c439a56 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:11.107696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-475f5bb3-158d-4719-92a9-e3f10c439a56 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:11.234210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-475f5bb3-158d-4719-92a9-e3f10c439a56 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:11.241996 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-475f5bb3-158d-4719-92a9-e3f10c439a56 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.146372 Aug 04 04:58:11.242560 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 811/1615] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:11 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:11.387375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7cb8a748-754c-4eaa-83c7-a0f85e632712 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:11.387914 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7cb8a748-754c-4eaa-83c7-a0f85e632712 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:11.394481 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7cb8a748-754c-4eaa-83c7-a0f85e632712 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:11.394929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7cb8a748-754c-4eaa-83c7-a0f85e632712 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:11.395686 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7cb8a748-754c-4eaa-83c7-a0f85e632712 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:11.396123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7cb8a748-754c-4eaa-83c7-a0f85e632712 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:11.443881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-63db02dc-c81b-483c-b77a-e4cde05674a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:11.444596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-63db02dc-c81b-483c-b77a-e4cde05674a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:11.451176 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-63db02dc-c81b-483c-b77a-e4cde05674a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:11.451621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-63db02dc-c81b-483c-b77a-e4cde05674a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:11.452572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-63db02dc-c81b-483c-b77a-e4cde05674a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:11.453003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-63db02dc-c81b-483c-b77a-e4cde05674a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:11.457715 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7cb8a748-754c-4eaa-83c7-a0f85e632712 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:11.465811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7cb8a748-754c-4eaa-83c7-a0f85e632712 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082413 Aug 04 04:58:11.466373 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 805/1616] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:11 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:11.582712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-63db02dc-c81b-483c-b77a-e4cde05674a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:11.590614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-63db02dc-c81b-483c-b77a-e4cde05674a3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150588 Aug 04 04:58:11.591168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 812/1617] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:11 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:12.263436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-37c7cf70-d801-414b-94c2-3f1ffadb2783 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:12.263968 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-37c7cf70-d801-414b-94c2-3f1ffadb2783 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:12.270639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37c7cf70-d801-414b-94c2-3f1ffadb2783 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:12.271083 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37c7cf70-d801-414b-94c2-3f1ffadb2783 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:12.271833 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37c7cf70-d801-414b-94c2-3f1ffadb2783 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:12.272265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37c7cf70-d801-414b-94c2-3f1ffadb2783 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:12.403349 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-37c7cf70-d801-414b-94c2-3f1ffadb2783 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:12.413906 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-37c7cf70-d801-414b-94c2-3f1ffadb2783 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154186 Aug 04 04:58:12.414849 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 806/1618] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:12 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:12.487828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a17495e0-6eeb-4047-bf16-7a26d9862466 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:12.488563 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a17495e0-6eeb-4047-bf16-7a26d9862466 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:12.495177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a17495e0-6eeb-4047-bf16-7a26d9862466 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:12.495628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a17495e0-6eeb-4047-bf16-7a26d9862466 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:12.496405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a17495e0-6eeb-4047-bf16-7a26d9862466 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:12.496845 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a17495e0-6eeb-4047-bf16-7a26d9862466 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:12.567709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a17495e0-6eeb-4047-bf16-7a26d9862466 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:12.575707 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a17495e0-6eeb-4047-bf16-7a26d9862466 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.092449 Aug 04 04:58:12.576267 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 813/1619] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:12 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:12.612422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9f41273b-7c9a-4ec1-a32a-52cd19ae2a4a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:12.613026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9f41273b-7c9a-4ec1-a32a-52cd19ae2a4a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:12.619399 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f41273b-7c9a-4ec1-a32a-52cd19ae2a4a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:12.619844 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f41273b-7c9a-4ec1-a32a-52cd19ae2a4a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:12.620607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f41273b-7c9a-4ec1-a32a-52cd19ae2a4a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:12.621042 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9f41273b-7c9a-4ec1-a32a-52cd19ae2a4a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:12.758922 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9f41273b-7c9a-4ec1-a32a-52cd19ae2a4a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:12.768014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9f41273b-7c9a-4ec1-a32a-52cd19ae2a4a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.159953 Aug 04 04:58:12.768662 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 807/1620] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:13.440913 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bcf689d8-9b82-4b6d-ad0e-f0e8473147c6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:13.441537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bcf689d8-9b82-4b6d-ad0e-f0e8473147c6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:13.447820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bcf689d8-9b82-4b6d-ad0e-f0e8473147c6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:13.448279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bcf689d8-9b82-4b6d-ad0e-f0e8473147c6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:13.449392 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bcf689d8-9b82-4b6d-ad0e-f0e8473147c6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:13.449603 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bcf689d8-9b82-4b6d-ad0e-f0e8473147c6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:13.583752 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bcf689d8-9b82-4b6d-ad0e-f0e8473147c6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:13.591956 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bcf689d8-9b82-4b6d-ad0e-f0e8473147c6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.155691 Aug 04 04:58:13.593343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 814/1621] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:13 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:13.597318 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-af07966c-3916-4e50-8047-cf289916d2cd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:13.597958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-af07966c-3916-4e50-8047-cf289916d2cd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:13.603870 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-af07966c-3916-4e50-8047-cf289916d2cd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:13.604314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-af07966c-3916-4e50-8047-cf289916d2cd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:13.605069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-af07966c-3916-4e50-8047-cf289916d2cd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:13.605499 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-af07966c-3916-4e50-8047-cf289916d2cd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:13.670226 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-af07966c-3916-4e50-8047-cf289916d2cd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:13.679021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-af07966c-3916-4e50-8047-cf289916d2cd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086729 Aug 04 04:58:13.679576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 808/1622] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:13 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:13.789620 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7c1c3426-8155-44dd-a873-6a1d8de5c2de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:13.791208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7c1c3426-8155-44dd-a873-6a1d8de5c2de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:13.798332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c1c3426-8155-44dd-a873-6a1d8de5c2de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:13.798777 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c1c3426-8155-44dd-a873-6a1d8de5c2de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:13.799535 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c1c3426-8155-44dd-a873-6a1d8de5c2de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:13.799966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c1c3426-8155-44dd-a873-6a1d8de5c2de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:13.814727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:13.929144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7c1c3426-8155-44dd-a873-6a1d8de5c2de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:13.937432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7c1c3426-8155-44dd-a873-6a1d8de5c2de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151766 Aug 04 04:58:13.938023 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 815/1623] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:13 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:14.613401 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b0ca20bc-e3fa-4a02-9b63-606b2c695f14 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:14.614059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b0ca20bc-e3fa-4a02-9b63-606b2c695f14 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:14.620663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b0ca20bc-e3fa-4a02-9b63-606b2c695f14 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:14.621116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b0ca20bc-e3fa-4a02-9b63-606b2c695f14 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:14.621899 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b0ca20bc-e3fa-4a02-9b63-606b2c695f14 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:14.622328 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b0ca20bc-e3fa-4a02-9b63-606b2c695f14 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:14.700441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b0a1b148-a082-4a63-b277-4a3fd6ffc015 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:14.700912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b0a1b148-a082-4a63-b277-4a3fd6ffc015 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:14.707990 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0a1b148-a082-4a63-b277-4a3fd6ffc015 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:14.708448 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0a1b148-a082-4a63-b277-4a3fd6ffc015 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:14.709219 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0a1b148-a082-4a63-b277-4a3fd6ffc015 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:14.709690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0a1b148-a082-4a63-b277-4a3fd6ffc015 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:14.767436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b0ca20bc-e3fa-4a02-9b63-606b2c695f14 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:14.775436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b0ca20bc-e3fa-4a02-9b63-606b2c695f14 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.165856 Aug 04 04:58:14.776005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 809/1624] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:14 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:14.785518 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b0a1b148-a082-4a63-b277-4a3fd6ffc015 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:14.793411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b0a1b148-a082-4a63-b277-4a3fd6ffc015 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.097036 Aug 04 04:58:14.794001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 816/1625] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:14 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:14.958539 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c8c9e6ce-892e-4ef8-82bb-4964889878ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:14.959183 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c8c9e6ce-892e-4ef8-82bb-4964889878ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:14.965189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8c9e6ce-892e-4ef8-82bb-4964889878ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:14.965666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8c9e6ce-892e-4ef8-82bb-4964889878ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:14.966427 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8c9e6ce-892e-4ef8-82bb-4964889878ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:14.966856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c8c9e6ce-892e-4ef8-82bb-4964889878ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:15.093890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c8c9e6ce-892e-4ef8-82bb-4964889878ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:15.101732 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c8c9e6ce-892e-4ef8-82bb-4964889878ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.146974 Aug 04 04:58:15.102291 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 810/1626] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:14 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:15.797344 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e8706702-2e78-4573-953b-9229627d0ab4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:15.798490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e8706702-2e78-4573-953b-9229627d0ab4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:15.808212 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e8706702-2e78-4573-953b-9229627d0ab4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:15.808669 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e8706702-2e78-4573-953b-9229627d0ab4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:15.809461 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e8706702-2e78-4573-953b-9229627d0ab4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:15.809919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e8706702-2e78-4573-953b-9229627d0ab4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:15.815380 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4bea6c0c-d96a-4797-8ab2-9c03bee37ba4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:15.816091 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4bea6c0c-d96a-4797-8ab2-9c03bee37ba4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:15.822890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4bea6c0c-d96a-4797-8ab2-9c03bee37ba4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:15.823342 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4bea6c0c-d96a-4797-8ab2-9c03bee37ba4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:15.824117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4bea6c0c-d96a-4797-8ab2-9c03bee37ba4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:15.824528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4bea6c0c-d96a-4797-8ab2-9c03bee37ba4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:15.918777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4bea6c0c-d96a-4797-8ab2-9c03bee37ba4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:15.928875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4bea6c0c-d96a-4797-8ab2-9c03bee37ba4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.117836 Aug 04 04:58:15.929456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 811/1627] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:15 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:15.996807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e8706702-2e78-4573-953b-9229627d0ab4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:16.008167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e8706702-2e78-4573-953b-9229627d0ab4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.215386 Aug 04 04:58:16.008767 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 817/1628] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:15 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:16.123534 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a741e921-0bd3-420d-9569-6efcf74d1830 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:16.124580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a741e921-0bd3-420d-9569-6efcf74d1830 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:16.132260 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a741e921-0bd3-420d-9569-6efcf74d1830 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:16.132712 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a741e921-0bd3-420d-9569-6efcf74d1830 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:16.133840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a741e921-0bd3-420d-9569-6efcf74d1830 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:16.134282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a741e921-0bd3-420d-9569-6efcf74d1830 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:16.275473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a741e921-0bd3-420d-9569-6efcf74d1830 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:16.283604 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a741e921-0bd3-420d-9569-6efcf74d1830 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.163986 Aug 04 04:58:16.284170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 812/1629] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:16.955532 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4d55ebdf-0ff7-43b2-bbdf-efe61b3559bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:16.956211 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4d55ebdf-0ff7-43b2-bbdf-efe61b3559bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:16.962663 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4d55ebdf-0ff7-43b2-bbdf-efe61b3559bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:16.963115 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4d55ebdf-0ff7-43b2-bbdf-efe61b3559bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:16.963877 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4d55ebdf-0ff7-43b2-bbdf-efe61b3559bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:16.964506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4d55ebdf-0ff7-43b2-bbdf-efe61b3559bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:17.026938 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4d55ebdf-0ff7-43b2-bbdf-efe61b3559bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:17.032240 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2e7bf2ec-4419-4b9a-99a2-f3a03a5065a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:17.032854 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2e7bf2ec-4419-4b9a-99a2-f3a03a5065a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:17.035625 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4d55ebdf-0ff7-43b2-bbdf-efe61b3559bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084810 Aug 04 04:58:17.036444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 818/1630] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:16 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:17.040181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2e7bf2ec-4419-4b9a-99a2-f3a03a5065a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:17.040629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2e7bf2ec-4419-4b9a-99a2-f3a03a5065a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:17.041391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2e7bf2ec-4419-4b9a-99a2-f3a03a5065a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:17.041848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2e7bf2ec-4419-4b9a-99a2-f3a03a5065a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:17.171437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2e7bf2ec-4419-4b9a-99a2-f3a03a5065a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:17.179719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2e7bf2ec-4419-4b9a-99a2-f3a03a5065a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152067 Aug 04 04:58:17.180276 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 813/1631] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:17 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:17.308561 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cb7ec424-4435-43eb-90f6-f612bd9f5ebb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:17.309172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cb7ec424-4435-43eb-90f6-f612bd9f5ebb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:17.316825 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb7ec424-4435-43eb-90f6-f612bd9f5ebb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:17.317307 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb7ec424-4435-43eb-90f6-f612bd9f5ebb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:17.318141 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb7ec424-4435-43eb-90f6-f612bd9f5ebb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:17.318576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cb7ec424-4435-43eb-90f6-f612bd9f5ebb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:17.449302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-cb7ec424-4435-43eb-90f6-f612bd9f5ebb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:17.457981 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cb7ec424-4435-43eb-90f6-f612bd9f5ebb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153328 Aug 04 04:58:17.458542 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 819/1632] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:17 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:18.056495 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9c13d8ae-012a-4a75-b04c-c93e89ba4ba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:18.057112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9c13d8ae-012a-4a75-b04c-c93e89ba4ba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:18.064335 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c13d8ae-012a-4a75-b04c-c93e89ba4ba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:18.064783 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c13d8ae-012a-4a75-b04c-c93e89ba4ba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:18.065531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c13d8ae-012a-4a75-b04c-c93e89ba4ba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:18.065992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c13d8ae-012a-4a75-b04c-c93e89ba4ba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:18.126516 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9c13d8ae-012a-4a75-b04c-c93e89ba4ba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:18.134425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9c13d8ae-012a-4a75-b04c-c93e89ba4ba2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081746 Aug 04 04:58:18.134981 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 814/1633] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:18 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:18.201288 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1fbb05c2-ca29-4051-945b-3fc91886043a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:18.202621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1fbb05c2-ca29-4051-945b-3fc91886043a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:18.209121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1fbb05c2-ca29-4051-945b-3fc91886043a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:18.209599 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1fbb05c2-ca29-4051-945b-3fc91886043a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:18.210370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1fbb05c2-ca29-4051-945b-3fc91886043a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:18.210810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1fbb05c2-ca29-4051-945b-3fc91886043a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:18.341319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1fbb05c2-ca29-4051-945b-3fc91886043a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:18.349312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1fbb05c2-ca29-4051-945b-3fc91886043a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151913 Aug 04 04:58:18.349899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 820/1634] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:18 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:18.479078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e3d1c9ac-966a-45df-a91c-b8bdc40e472c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:18.479696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e3d1c9ac-966a-45df-a91c-b8bdc40e472c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:18.486384 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e3d1c9ac-966a-45df-a91c-b8bdc40e472c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:18.486861 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e3d1c9ac-966a-45df-a91c-b8bdc40e472c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:18.487643 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e3d1c9ac-966a-45df-a91c-b8bdc40e472c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:18.488074 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e3d1c9ac-966a-45df-a91c-b8bdc40e472c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:18.616099 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e3d1c9ac-966a-45df-a91c-b8bdc40e472c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:18.624750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e3d1c9ac-966a-45df-a91c-b8bdc40e472c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148837 Aug 04 04:58:18.625308 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 815/1635] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:18 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:19.156478 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ac68bc39-357d-42d8-84b0-477492b86c9a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:19.157095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ac68bc39-357d-42d8-84b0-477492b86c9a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:19.163150 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac68bc39-357d-42d8-84b0-477492b86c9a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:19.163606 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac68bc39-357d-42d8-84b0-477492b86c9a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:19.164372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac68bc39-357d-42d8-84b0-477492b86c9a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:19.164815 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac68bc39-357d-42d8-84b0-477492b86c9a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:19.228323 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ac68bc39-357d-42d8-84b0-477492b86c9a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:19.236342 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ac68bc39-357d-42d8-84b0-477492b86c9a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084360 Aug 04 04:58:19.236906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 821/1636] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:19 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:19.370175 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-838a4cc7-b9a0-48dc-883c-74057a82dafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:19.370788 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-838a4cc7-b9a0-48dc-883c-74057a82dafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:19.378160 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-838a4cc7-b9a0-48dc-883c-74057a82dafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:19.378620 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-838a4cc7-b9a0-48dc-883c-74057a82dafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:19.379390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-838a4cc7-b9a0-48dc-883c-74057a82dafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:19.379835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-838a4cc7-b9a0-48dc-883c-74057a82dafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:19.512843 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-838a4cc7-b9a0-48dc-883c-74057a82dafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:19.521321 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-838a4cc7-b9a0-48dc-883c-74057a82dafc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154980 Aug 04 04:58:19.521989 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 816/1637] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:19 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:19.645465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fd2488e9-5143-4458-aa37-21457f92d750 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:19.646109 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fd2488e9-5143-4458-aa37-21457f92d750 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:19.652084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fd2488e9-5143-4458-aa37-21457f92d750 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:19.652528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fd2488e9-5143-4458-aa37-21457f92d750 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:19.653275 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fd2488e9-5143-4458-aa37-21457f92d750 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:19.653734 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fd2488e9-5143-4458-aa37-21457f92d750 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:19.781182 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fd2488e9-5143-4458-aa37-21457f92d750 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:19.789203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fd2488e9-5143-4458-aa37-21457f92d750 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.147604 Aug 04 04:58:19.789803 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 822/1638] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:20.257004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9c41e8d4-4972-43ac-85a1-307636f81018 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:20.257637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9c41e8d4-4972-43ac-85a1-307636f81018 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:20.263753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c41e8d4-4972-43ac-85a1-307636f81018 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:20.264201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c41e8d4-4972-43ac-85a1-307636f81018 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:20.265743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c41e8d4-4972-43ac-85a1-307636f81018 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:20.266181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9c41e8d4-4972-43ac-85a1-307636f81018 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:20.281406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:20.330830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9c41e8d4-4972-43ac-85a1-307636f81018 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:20.338726 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9c41e8d4-4972-43ac-85a1-307636f81018 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085549 Aug 04 04:58:20.339278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 817/1639] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:20 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:20.542071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6d04d1ba-bb3a-485b-b526-f1515f5f9d6f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:20.542659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6d04d1ba-bb3a-485b-b526-f1515f5f9d6f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:20.550073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d04d1ba-bb3a-485b-b526-f1515f5f9d6f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:20.550515 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d04d1ba-bb3a-485b-b526-f1515f5f9d6f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:20.551273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d04d1ba-bb3a-485b-b526-f1515f5f9d6f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:20.551708 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d04d1ba-bb3a-485b-b526-f1515f5f9d6f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:20.680203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6d04d1ba-bb3a-485b-b526-f1515f5f9d6f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:20.689160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6d04d1ba-bb3a-485b-b526-f1515f5f9d6f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151146 Aug 04 04:58:20.689752 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 823/1640] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:20 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:20.810863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8dc74231-7c9c-4f12-a9b3-955740640d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:20.812133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8dc74231-7c9c-4f12-a9b3-955740640d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:20.818404 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8dc74231-7c9c-4f12-a9b3-955740640d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:20.818850 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8dc74231-7c9c-4f12-a9b3-955740640d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:20.819606 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8dc74231-7c9c-4f12-a9b3-955740640d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:20.820043 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8dc74231-7c9c-4f12-a9b3-955740640d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:20.947333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8dc74231-7c9c-4f12-a9b3-955740640d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:20.955552 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8dc74231-7c9c-4f12-a9b3-955740640d29 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148605 Aug 04 04:58:20.956116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 818/1641] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:21.360736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-73048f35-bf81-49f3-8990-809737c71088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:21.361342 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-73048f35-bf81-49f3-8990-809737c71088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:21.367308 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-73048f35-bf81-49f3-8990-809737c71088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:21.367750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-73048f35-bf81-49f3-8990-809737c71088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:21.368497 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-73048f35-bf81-49f3-8990-809737c71088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:21.368929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-73048f35-bf81-49f3-8990-809737c71088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:21.431812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-73048f35-bf81-49f3-8990-809737c71088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:21.439691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-73048f35-bf81-49f3-8990-809737c71088 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083349 Aug 04 04:58:21.440246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 824/1642] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:21 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:21.710734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0455d28d-e359-4e50-bd55-7a0a57ddd477 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:21.711266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0455d28d-e359-4e50-bd55-7a0a57ddd477 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:21.717246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0455d28d-e359-4e50-bd55-7a0a57ddd477 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:21.718097 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0455d28d-e359-4e50-bd55-7a0a57ddd477 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:21.718849 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0455d28d-e359-4e50-bd55-7a0a57ddd477 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:21.719282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0455d28d-e359-4e50-bd55-7a0a57ddd477 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:21.976452 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0b590b16-7320-4e09-aa72-54e2fb4f47e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:21.977087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0b590b16-7320-4e09-aa72-54e2fb4f47e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:21.984438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b590b16-7320-4e09-aa72-54e2fb4f47e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:21.984887 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b590b16-7320-4e09-aa72-54e2fb4f47e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:21.985694 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b590b16-7320-4e09-aa72-54e2fb4f47e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:21.986123 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b590b16-7320-4e09-aa72-54e2fb4f47e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:22.160927 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0455d28d-e359-4e50-bd55-7a0a57ddd477 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:22.167528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0b590b16-7320-4e09-aa72-54e2fb4f47e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:22.168851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0455d28d-e359-4e50-bd55-7a0a57ddd477 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.461961 Aug 04 04:58:22.169412 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 819/1643] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:21 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:22.176903 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0b590b16-7320-4e09-aa72-54e2fb4f47e9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.204397 Aug 04 04:58:22.177464 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 825/1644] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:21 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:22.460272 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b62026ac-6680-4ba3-986e-ce6e86f64c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:22.460878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b62026ac-6680-4ba3-986e-ce6e86f64c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:22.466989 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b62026ac-6680-4ba3-986e-ce6e86f64c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:22.467437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b62026ac-6680-4ba3-986e-ce6e86f64c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:22.468911 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b62026ac-6680-4ba3-986e-ce6e86f64c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:22.469345 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b62026ac-6680-4ba3-986e-ce6e86f64c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:22.531067 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b62026ac-6680-4ba3-986e-ce6e86f64c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:22.539033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b62026ac-6680-4ba3-986e-ce6e86f64c4f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082715 Aug 04 04:58:22.539633 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 820/1645] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:22 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:23.191342 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-280face6-12df-4e6b-adbe-d99266a1be07 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:23.191986 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-280face6-12df-4e6b-adbe-d99266a1be07 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:23.198055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ef0e4bbb-518f-488a-8e4d-57d8e7bc24b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:23.198511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-280face6-12df-4e6b-adbe-d99266a1be07 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:23.198628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ef0e4bbb-518f-488a-8e4d-57d8e7bc24b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:23.198740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-280face6-12df-4e6b-adbe-d99266a1be07 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:23.199407 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-280face6-12df-4e6b-adbe-d99266a1be07 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:23.199839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-280face6-12df-4e6b-adbe-d99266a1be07 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:23.205717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ef0e4bbb-518f-488a-8e4d-57d8e7bc24b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:23.206173 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ef0e4bbb-518f-488a-8e4d-57d8e7bc24b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:23.206939 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ef0e4bbb-518f-488a-8e4d-57d8e7bc24b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:23.207378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ef0e4bbb-518f-488a-8e4d-57d8e7bc24b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:23.393432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-280face6-12df-4e6b-adbe-d99266a1be07 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:23.397442 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ef0e4bbb-518f-488a-8e4d-57d8e7bc24b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:23.401583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-280face6-12df-4e6b-adbe-d99266a1be07 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.214073 Aug 04 04:58:23.402179 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 826/1646] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:23 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:23.406438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ef0e4bbb-518f-488a-8e4d-57d8e7bc24b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.212005 Aug 04 04:58:23.406996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 821/1647] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:23 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:23.560362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-afbcbc23-391d-46b5-817a-a4e97d67a750 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:23.561005 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-afbcbc23-391d-46b5-817a-a4e97d67a750 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:23.567095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-afbcbc23-391d-46b5-817a-a4e97d67a750 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:23.567538 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-afbcbc23-391d-46b5-817a-a4e97d67a750 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:23.568288 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-afbcbc23-391d-46b5-817a-a4e97d67a750 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:23.568717 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-afbcbc23-391d-46b5-817a-a4e97d67a750 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:23.630621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-afbcbc23-391d-46b5-817a-a4e97d67a750 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:23.638466 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-afbcbc23-391d-46b5-817a-a4e97d67a750 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082034 Aug 04 04:58:23.639040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 827/1648] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:23 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:24.424687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f625b68d-d1b4-4085-baa4-8fa42cce4dfa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:24.425315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f625b68d-d1b4-4085-baa4-8fa42cce4dfa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:24.429951 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fe62b71a-979e-464d-94ea-195b238d2163 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:24.430588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fe62b71a-979e-464d-94ea-195b238d2163 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:24.431780 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f625b68d-d1b4-4085-baa4-8fa42cce4dfa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.432488 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f625b68d-d1b4-4085-baa4-8fa42cce4dfa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.433272 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f625b68d-d1b4-4085-baa4-8fa42cce4dfa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.433871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f625b68d-d1b4-4085-baa4-8fa42cce4dfa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.437910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fe62b71a-979e-464d-94ea-195b238d2163 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.438364 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fe62b71a-979e-464d-94ea-195b238d2163 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.439133 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fe62b71a-979e-464d-94ea-195b238d2163 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.439565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fe62b71a-979e-464d-94ea-195b238d2163 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.633499 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f625b68d-d1b4-4085-baa4-8fa42cce4dfa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:24.636748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fe62b71a-979e-464d-94ea-195b238d2163 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:24.642285 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f625b68d-d1b4-4085-baa4-8fa42cce4dfa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.222405 Aug 04 04:58:24.643050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 822/1649] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:24 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:24.644553 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fe62b71a-979e-464d-94ea-195b238d2163 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.218362 Aug 04 04:58:24.645106 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 828/1650] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:24 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:24.659233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e90383e1-6a99-421f-827c-c10edea3dc1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:24.659875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e90383e1-6a99-421f-827c-c10edea3dc1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:24.665884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e90383e1-6a99-421f-827c-c10edea3dc1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.666332 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e90383e1-6a99-421f-827c-c10edea3dc1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.667089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e90383e1-6a99-421f-827c-c10edea3dc1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:24.667527 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e90383e1-6a99-421f-827c-c10edea3dc1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:24.728579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e90383e1-6a99-421f-827c-c10edea3dc1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:24.737414 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e90383e1-6a99-421f-827c-c10edea3dc1e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082415 Aug 04 04:58:24.738007 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 823/1651] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:24 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:25.664021 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3959bc36-6e31-4bde-b708-ea74a990f7f8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:25.664621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ff69832e-50a0-4e1c-9541-28d2186be748 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:25.665005 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3959bc36-6e31-4bde-b708-ea74a990f7f8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:25.665122 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ff69832e-50a0-4e1c-9541-28d2186be748 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:25.672020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3959bc36-6e31-4bde-b708-ea74a990f7f8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:25.672468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3959bc36-6e31-4bde-b708-ea74a990f7f8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:25.672743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff69832e-50a0-4e1c-9541-28d2186be748 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:25.673195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff69832e-50a0-4e1c-9541-28d2186be748 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:25.673315 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3959bc36-6e31-4bde-b708-ea74a990f7f8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:25.673673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3959bc36-6e31-4bde-b708-ea74a990f7f8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:25.673982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff69832e-50a0-4e1c-9541-28d2186be748 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:25.674418 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff69832e-50a0-4e1c-9541-28d2186be748 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:25.868308 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3959bc36-6e31-4bde-b708-ea74a990f7f8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:25.871266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ff69832e-50a0-4e1c-9541-28d2186be748 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:25.876409 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3959bc36-6e31-4bde-b708-ea74a990f7f8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.216264 Aug 04 04:58:25.877066 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 829/1652] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:25 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:25.879670 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ff69832e-50a0-4e1c-9541-28d2186be748 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.219273 Aug 04 04:58:25.880389 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 824/1653] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:25 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:25.889626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-59b68d53-cdcb-411f-bd71-2b2441363a5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:25.889626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-59b68d53-cdcb-411f-bd71-2b2441363a5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:25.889626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:25.889626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-59b68d53-cdcb-411f-bd71-2b2441363a5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:25.890145 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-59b68d53-cdcb-411f-bd71-2b2441363a5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:25.890756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-59b68d53-cdcb-411f-bd71-2b2441363a5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:25.891193 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-59b68d53-cdcb-411f-bd71-2b2441363a5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:25.953522 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-59b68d53-cdcb-411f-bd71-2b2441363a5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:25.961329 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-59b68d53-cdcb-411f-bd71-2b2441363a5b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083239 Aug 04 04:58:25.961920 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 830/1654] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:25 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:26.900012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5e6dc21f-f1c4-412d-935e-581d69071260 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:26.900655 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5e6dc21f-f1c4-412d-935e-581d69071260 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:26.901115 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-32251057-043d-4302-90c3-872fd2fe1aa8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:26.901760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-32251057-043d-4302-90c3-872fd2fe1aa8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:26.903047 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:26.908518 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-32251057-043d-4302-90c3-872fd2fe1aa8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:26.908967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-32251057-043d-4302-90c3-872fd2fe1aa8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:26.909256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5e6dc21f-f1c4-412d-935e-581d69071260 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:26.909739 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5e6dc21f-f1c4-412d-935e-581d69071260 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:26.909877 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-32251057-043d-4302-90c3-872fd2fe1aa8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:26.910214 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-32251057-043d-4302-90c3-872fd2fe1aa8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:26.910511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5e6dc21f-f1c4-412d-935e-581d69071260 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:26.910947 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5e6dc21f-f1c4-412d-935e-581d69071260 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:27.107494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-32251057-043d-4302-90c3-872fd2fe1aa8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:27.112846 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5e6dc21f-f1c4-412d-935e-581d69071260 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:27.116739 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-32251057-043d-4302-90c3-872fd2fe1aa8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.219413 Aug 04 04:58:27.129756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 831/1655] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:26 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:27.129756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b3eb1345-2bdd-44f9-96e8-06a609f7e95c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:27.129756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b3eb1345-2bdd-44f9-96e8-06a609f7e95c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:27.129756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b3eb1345-2bdd-44f9-96e8-06a609f7e95c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:27.130221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b3eb1345-2bdd-44f9-96e8-06a609f7e95c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:27.130221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b3eb1345-2bdd-44f9-96e8-06a609f7e95c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:27.130221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b3eb1345-2bdd-44f9-96e8-06a609f7e95c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:27.134877 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:27.139800 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5e6dc21f-f1c4-412d-935e-581d69071260 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.238518 Aug 04 04:58:27.139800 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 825/1656] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:26 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:27.193259 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b3eb1345-2bdd-44f9-96e8-06a609f7e95c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:27.201936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b3eb1345-2bdd-44f9-96e8-06a609f7e95c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083537 Aug 04 04:58:27.203172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 832/1657] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:27 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:28.140031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c7700f7b-d031-4bdb-9b54-ef7238983fad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:28.140755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c7700f7b-d031-4bdb-9b54-ef7238983fad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:28.147137 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7700f7b-d031-4bdb-9b54-ef7238983fad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:28.147589 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7700f7b-d031-4bdb-9b54-ef7238983fad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:28.148350 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7700f7b-d031-4bdb-9b54-ef7238983fad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:28.148786 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7700f7b-d031-4bdb-9b54-ef7238983fad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:28.155670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-252f14d8-2169-4696-a58c-abc8dadbee42 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:28.156400 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-252f14d8-2169-4696-a58c-abc8dadbee42 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:28.162841 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-252f14d8-2169-4696-a58c-abc8dadbee42 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:28.163287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-252f14d8-2169-4696-a58c-abc8dadbee42 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:28.164055 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-252f14d8-2169-4696-a58c-abc8dadbee42 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:28.164485 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-252f14d8-2169-4696-a58c-abc8dadbee42 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:28.340494 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c7700f7b-d031-4bdb-9b54-ef7238983fad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:28.348874 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c7700f7b-d031-4bdb-9b54-ef7238983fad tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.213567 Aug 04 04:58:28.349449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 826/1658] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:28 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:28.351923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-252f14d8-2169-4696-a58c-abc8dadbee42 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:28.353856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0e4ede53-20b0-44c9-9938-3706be4185b1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:28.354464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0e4ede53-20b0-44c9-9938-3706be4185b1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:28.360964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e4ede53-20b0-44c9-9938-3706be4185b1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:28.361377 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-252f14d8-2169-4696-a58c-abc8dadbee42 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.209844 Aug 04 04:58:28.361502 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e4ede53-20b0-44c9-9938-3706be4185b1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:28.362126 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 833/1659] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:28 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:28.362265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e4ede53-20b0-44c9-9938-3706be4185b1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:28.362636 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0e4ede53-20b0-44c9-9938-3706be4185b1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:28.427294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0e4ede53-20b0-44c9-9938-3706be4185b1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:28.435301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0e4ede53-20b0-44c9-9938-3706be4185b1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084851 Aug 04 04:58:28.435864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 827/1660] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:28 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:29.370229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-645238f6-7c46-44fe-8b90-e87055598aaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:29.370891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-645238f6-7c46-44fe-8b90-e87055598aaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:29.378319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-645238f6-7c46-44fe-8b90-e87055598aaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:29.378771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-645238f6-7c46-44fe-8b90-e87055598aaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:29.379666 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-645238f6-7c46-44fe-8b90-e87055598aaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:29.380111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-645238f6-7c46-44fe-8b90-e87055598aaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:29.382946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0c7ef51f-d7b4-44c7-ab2e-d77e0540681e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:29.383565 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0c7ef51f-d7b4-44c7-ab2e-d77e0540681e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:29.390838 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c7ef51f-d7b4-44c7-ab2e-d77e0540681e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:29.391290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c7ef51f-d7b4-44c7-ab2e-d77e0540681e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:29.392056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c7ef51f-d7b4-44c7-ab2e-d77e0540681e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:29.392495 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c7ef51f-d7b4-44c7-ab2e-d77e0540681e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:29.579680 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-645238f6-7c46-44fe-8b90-e87055598aaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:29.584150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0c7ef51f-d7b4-44c7-ab2e-d77e0540681e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:29.587738 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-645238f6-7c46-44fe-8b90-e87055598aaf tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.221363 Aug 04 04:58:29.588310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 834/1661] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:29 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:29.592088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0c7ef51f-d7b4-44c7-ab2e-d77e0540681e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.212976 Aug 04 04:58:29.605567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 828/1662] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:29 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:29.605758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9f411c25-f5dd-4e8e-9f8c-8a64ec5c7ee6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:29.605758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9f411c25-f5dd-4e8e-9f8c-8a64ec5c7ee6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:29.605758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f411c25-f5dd-4e8e-9f8c-8a64ec5c7ee6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:29.605758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f411c25-f5dd-4e8e-9f8c-8a64ec5c7ee6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:29.606207 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f411c25-f5dd-4e8e-9f8c-8a64ec5c7ee6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:29.606207 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f411c25-f5dd-4e8e-9f8c-8a64ec5c7ee6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:29.664609 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9f411c25-f5dd-4e8e-9f8c-8a64ec5c7ee6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:29.673532 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9f411c25-f5dd-4e8e-9f8c-8a64ec5c7ee6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084272 Aug 04 04:58:29.674117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 835/1663] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:29 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:30.610365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-672ba660-276b-4890-9027-d588c9ae23ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:30.610966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-672ba660-276b-4890-9027-d588c9ae23ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:30.614751 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-211f6337-0e7f-4c42-a80a-c898ee885cfb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:30.615365 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-211f6337-0e7f-4c42-a80a-c898ee885cfb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:30.617533 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-672ba660-276b-4890-9027-d588c9ae23ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:30.618012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-672ba660-276b-4890-9027-d588c9ae23ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:30.618788 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-672ba660-276b-4890-9027-d588c9ae23ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:30.619228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-672ba660-276b-4890-9027-d588c9ae23ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:30.622377 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-211f6337-0e7f-4c42-a80a-c898ee885cfb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:30.622864 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-211f6337-0e7f-4c42-a80a-c898ee885cfb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:30.623668 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-211f6337-0e7f-4c42-a80a-c898ee885cfb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:30.624908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-211f6337-0e7f-4c42-a80a-c898ee885cfb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:30.817432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-672ba660-276b-4890-9027-d588c9ae23ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:30.821405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-211f6337-0e7f-4c42-a80a-c898ee885cfb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:30.825413 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-672ba660-276b-4890-9027-d588c9ae23ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.219875 Aug 04 04:58:30.826012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 829/1664] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:30 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:30.830474 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-211f6337-0e7f-4c42-a80a-c898ee885cfb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.219446 Aug 04 04:58:30.831209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 836/1665] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:30 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:30.831348 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2dc49852-127c-44fe-bf1b-da358e9cad2d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:30.831951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2dc49852-127c-44fe-bf1b-da358e9cad2d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:30.837927 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2dc49852-127c-44fe-bf1b-da358e9cad2d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:30.838384 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2dc49852-127c-44fe-bf1b-da358e9cad2d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:30.839215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2dc49852-127c-44fe-bf1b-da358e9cad2d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:30.839657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2dc49852-127c-44fe-bf1b-da358e9cad2d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:30.904343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2dc49852-127c-44fe-bf1b-da358e9cad2d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:30.912288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2dc49852-127c-44fe-bf1b-da358e9cad2d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085340 Aug 04 04:58:30.912852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 830/1666] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:30 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:31.848363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-27541a5a-9a8f-4440-bf09-7ea5d59280e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:31.849014 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-27541a5a-9a8f-4440-bf09-7ea5d59280e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:31.851321 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a8ae6d97-c253-4c32-be7d-988d7c5baaef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:31.851944 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a8ae6d97-c253-4c32-be7d-988d7c5baaef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:31.855684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27541a5a-9a8f-4440-bf09-7ea5d59280e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:31.856139 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27541a5a-9a8f-4440-bf09-7ea5d59280e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:31.856912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27541a5a-9a8f-4440-bf09-7ea5d59280e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:31.857351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-27541a5a-9a8f-4440-bf09-7ea5d59280e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:31.858451 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a8ae6d97-c253-4c32-be7d-988d7c5baaef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:31.859428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a8ae6d97-c253-4c32-be7d-988d7c5baaef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:31.860387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a8ae6d97-c253-4c32-be7d-988d7c5baaef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:31.860824 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a8ae6d97-c253-4c32-be7d-988d7c5baaef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:32.051102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-27541a5a-9a8f-4440-bf09-7ea5d59280e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:32.055145 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a8ae6d97-c253-4c32-be7d-988d7c5baaef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:32.059288 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-27541a5a-9a8f-4440-bf09-7ea5d59280e0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215119 Aug 04 04:58:32.059863 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 837/1667] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:31 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:32.063969 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a8ae6d97-c253-4c32-be7d-988d7c5baaef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.216403 Aug 04 04:58:32.064461 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c81a6c4e-701d-45a0-ab32-43ddfa71263c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:32.064880 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 831/1668] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:31 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:32.071203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c81a6c4e-701d-45a0-ab32-43ddfa71263c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:32.078187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c81a6c4e-701d-45a0-ab32-43ddfa71263c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:32.078444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c81a6c4e-701d-45a0-ab32-43ddfa71263c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:32.079243 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c81a6c4e-701d-45a0-ab32-43ddfa71263c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:32.079701 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c81a6c4e-701d-45a0-ab32-43ddfa71263c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:32.140189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c81a6c4e-701d-45a0-ab32-43ddfa71263c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:32.148145 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c81a6c4e-701d-45a0-ab32-43ddfa71263c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.087336 Aug 04 04:58:32.148708 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 838/1669] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:32 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:33.080889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d81d3fd6-5d83-4d45-9eb8-16a6f5fe9c5c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:33.081481 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d81d3fd6-5d83-4d45-9eb8-16a6f5fe9c5c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:33.085748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f8dfbf94-04a1-447b-958d-62c3a690e632 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:33.086448 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f8dfbf94-04a1-447b-958d-62c3a690e632 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:33.087978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d81d3fd6-5d83-4d45-9eb8-16a6f5fe9c5c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:33.088428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d81d3fd6-5d83-4d45-9eb8-16a6f5fe9c5c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:33.089193 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d81d3fd6-5d83-4d45-9eb8-16a6f5fe9c5c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:33.089658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d81d3fd6-5d83-4d45-9eb8-16a6f5fe9c5c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:33.092229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8dfbf94-04a1-447b-958d-62c3a690e632 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:33.092745 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8dfbf94-04a1-447b-958d-62c3a690e632 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:33.093704 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8dfbf94-04a1-447b-958d-62c3a690e632 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:33.094139 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8dfbf94-04a1-447b-958d-62c3a690e632 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:33.281937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d81d3fd6-5d83-4d45-9eb8-16a6f5fe9c5c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:33.287571 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f8dfbf94-04a1-447b-958d-62c3a690e632 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:33.291479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d81d3fd6-5d83-4d45-9eb8-16a6f5fe9c5c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.214998 Aug 04 04:58:33.292057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 832/1670] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:33 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:33.295652 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f8dfbf94-04a1-447b-958d-62c3a690e632 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.214321 Aug 04 04:58:33.296860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 839/1671] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:33 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:33.301699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2698bddd-e6a1-4943-9425-b4e2127ec194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:33.302388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2698bddd-e6a1-4943-9425-b4e2127ec194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:33.308385 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2698bddd-e6a1-4943-9425-b4e2127ec194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:33.308845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2698bddd-e6a1-4943-9425-b4e2127ec194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:33.309680 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2698bddd-e6a1-4943-9425-b4e2127ec194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:33.310120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2698bddd-e6a1-4943-9425-b4e2127ec194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:33.371997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2698bddd-e6a1-4943-9425-b4e2127ec194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:33.380558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2698bddd-e6a1-4943-9425-b4e2127ec194 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.087555 Aug 04 04:58:33.381118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 833/1672] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:33 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:34.314435 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d4793061-ba4a-4d4a-9713-d7cabf05f3d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:34.315054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d4793061-ba4a-4d4a-9713-d7cabf05f3d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:34.316967 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7309f4b6-9899-4514-8a55-709177a0bea4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:34.317606 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7309f4b6-9899-4514-8a55-709177a0bea4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:34.321572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d4793061-ba4a-4d4a-9713-d7cabf05f3d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:34.322040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d4793061-ba4a-4d4a-9713-d7cabf05f3d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:34.322804 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d4793061-ba4a-4d4a-9713-d7cabf05f3d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:34.323234 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d4793061-ba4a-4d4a-9713-d7cabf05f3d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:34.324041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7309f4b6-9899-4514-8a55-709177a0bea4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:34.324488 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7309f4b6-9899-4514-8a55-709177a0bea4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:34.325238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7309f4b6-9899-4514-8a55-709177a0bea4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:34.325732 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7309f4b6-9899-4514-8a55-709177a0bea4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:34.330037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:34.522614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d4793061-ba4a-4d4a-9713-d7cabf05f3d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:34.526532 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7309f4b6-9899-4514-8a55-709177a0bea4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:34.531469 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d4793061-ba4a-4d4a-9713-d7cabf05f3d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.222042 Aug 04 04:58:34.532041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 840/1673] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:34 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:34.535919 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7309f4b6-9899-4514-8a55-709177a0bea4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.223330 Aug 04 04:58:34.536616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 834/1674] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:34 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:34.537617 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2f676f16-ab91-4e02-b06a-a1349e3101de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:34.538234 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2f676f16-ab91-4e02-b06a-a1349e3101de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:34.544341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f676f16-ab91-4e02-b06a-a1349e3101de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:34.544796 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f676f16-ab91-4e02-b06a-a1349e3101de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:34.545562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f676f16-ab91-4e02-b06a-a1349e3101de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:34.546015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f676f16-ab91-4e02-b06a-a1349e3101de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:34.611295 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2f676f16-ab91-4e02-b06a-a1349e3101de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:34.619258 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2f676f16-ab91-4e02-b06a-a1349e3101de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086272 Aug 04 04:58:34.619817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 841/1675] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:34 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:35.552708 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ac8e9c1f-6569-4432-8a07-403ebba4b0e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:35.553270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ac8e9c1f-6569-4432-8a07-403ebba4b0e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:35.558452 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e959d83e-a1db-4c70-99be-83e7534581e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:35.559172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e959d83e-a1db-4c70-99be-83e7534581e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:35.559891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ac8e9c1f-6569-4432-8a07-403ebba4b0e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:35.560351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ac8e9c1f-6569-4432-8a07-403ebba4b0e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:35.561127 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ac8e9c1f-6569-4432-8a07-403ebba4b0e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:35.562292 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ac8e9c1f-6569-4432-8a07-403ebba4b0e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:35.566450 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e959d83e-a1db-4c70-99be-83e7534581e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:35.566897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e959d83e-a1db-4c70-99be-83e7534581e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:35.567658 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e959d83e-a1db-4c70-99be-83e7534581e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:35.568093 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e959d83e-a1db-4c70-99be-83e7534581e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:35.760696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ac8e9c1f-6569-4432-8a07-403ebba4b0e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:35.763855 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e959d83e-a1db-4c70-99be-83e7534581e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:35.769807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ac8e9c1f-6569-4432-8a07-403ebba4b0e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.221023 Aug 04 04:58:35.770387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 835/1676] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:35 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:35.772433 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e959d83e-a1db-4c70-99be-83e7534581e7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.217746 Aug 04 04:58:35.773168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 842/1677] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:35 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:35.774987 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d4014c57-1f77-4b34-80ce-af9e4db3efb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:35.775591 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d4014c57-1f77-4b34-80ce-af9e4db3efb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:35.782636 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d4014c57-1f77-4b34-80ce-af9e4db3efb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:35.783094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d4014c57-1f77-4b34-80ce-af9e4db3efb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:35.783859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d4014c57-1f77-4b34-80ce-af9e4db3efb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:35.784297 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d4014c57-1f77-4b34-80ce-af9e4db3efb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:35.845567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d4014c57-1f77-4b34-80ce-af9e4db3efb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:35.853353 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d4014c57-1f77-4b34-80ce-af9e4db3efb0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082041 Aug 04 04:58:35.853953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 836/1678] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:35 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:36.792494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b336e2c8-af32-4e16-9456-7ceff08922a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:36.793104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b336e2c8-af32-4e16-9456-7ceff08922a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:36.793227 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-99958c3c-25d1-42f1-bd17-7e7cc200fd6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:36.793862 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-99958c3c-25d1-42f1-bd17-7e7cc200fd6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:36.799899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b336e2c8-af32-4e16-9456-7ceff08922a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:36.800344 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b336e2c8-af32-4e16-9456-7ceff08922a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:36.800506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99958c3c-25d1-42f1-bd17-7e7cc200fd6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:36.800952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99958c3c-25d1-42f1-bd17-7e7cc200fd6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:36.801102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b336e2c8-af32-4e16-9456-7ceff08922a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:36.801532 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b336e2c8-af32-4e16-9456-7ceff08922a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:36.801753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99958c3c-25d1-42f1-bd17-7e7cc200fd6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:36.802172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-99958c3c-25d1-42f1-bd17-7e7cc200fd6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:36.999034 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b336e2c8-af32-4e16-9456-7ceff08922a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:37.002103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-99958c3c-25d1-42f1-bd17-7e7cc200fd6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:37.007380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b336e2c8-af32-4e16-9456-7ceff08922a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.219221 Aug 04 04:58:37.007947 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 843/1679] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:36 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:37.010361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-99958c3c-25d1-42f1-bd17-7e7cc200fd6c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.220854 Aug 04 04:58:37.011044 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 837/1680] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:36 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:37.012437 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-15374873-9f6d-48e7-b939-1077bd54816c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:37.013083 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-15374873-9f6d-48e7-b939-1077bd54816c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:37.019068 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-15374873-9f6d-48e7-b939-1077bd54816c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:37.019525 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-15374873-9f6d-48e7-b939-1077bd54816c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:37.020292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-15374873-9f6d-48e7-b939-1077bd54816c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:37.020734 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-15374873-9f6d-48e7-b939-1077bd54816c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:37.082241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-15374873-9f6d-48e7-b939-1077bd54816c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:37.090260 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-15374873-9f6d-48e7-b939-1077bd54816c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081360 Aug 04 04:58:37.090819 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 844/1681] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:37 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:38.028355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f7049771-42a0-4351-aca7-f83bfc7abc9f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:38.028974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f7049771-42a0-4351-aca7-f83bfc7abc9f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:38.031202 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cc9b18ae-ef95-4b30-8bfb-5077382a6f34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:38.031851 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cc9b18ae-ef95-4b30-8bfb-5077382a6f34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:38.035950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7049771-42a0-4351-aca7-f83bfc7abc9f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:38.036404 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7049771-42a0-4351-aca7-f83bfc7abc9f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:38.037182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7049771-42a0-4351-aca7-f83bfc7abc9f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:38.037653 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7049771-42a0-4351-aca7-f83bfc7abc9f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:38.038317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cc9b18ae-ef95-4b30-8bfb-5077382a6f34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:38.038761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cc9b18ae-ef95-4b30-8bfb-5077382a6f34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:38.039522 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cc9b18ae-ef95-4b30-8bfb-5077382a6f34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:38.039960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cc9b18ae-ef95-4b30-8bfb-5077382a6f34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:38.232247 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f7049771-42a0-4351-aca7-f83bfc7abc9f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:38.235453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-cc9b18ae-ef95-4b30-8bfb-5077382a6f34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:38.240394 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f7049771-42a0-4351-aca7-f83bfc7abc9f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.216028 Aug 04 04:58:38.240968 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 838/1682] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:38 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:38.243593 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cc9b18ae-ef95-4b30-8bfb-5077382a6f34 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.216341 Aug 04 04:58:38.244376 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 845/1683] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:38 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:38.245684 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f00f9d50-5c82-46a7-9ce6-7f52eb79230e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:38.246295 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f00f9d50-5c82-46a7-9ce6-7f52eb79230e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:38.252252 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f00f9d50-5c82-46a7-9ce6-7f52eb79230e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:38.252704 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f00f9d50-5c82-46a7-9ce6-7f52eb79230e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:38.253478 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f00f9d50-5c82-46a7-9ce6-7f52eb79230e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:38.254246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f00f9d50-5c82-46a7-9ce6-7f52eb79230e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:38.319415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f00f9d50-5c82-46a7-9ce6-7f52eb79230e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:38.328285 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f00f9d50-5c82-46a7-9ce6-7f52eb79230e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086198 Aug 04 04:58:38.328856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 839/1684] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:38 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:39.264881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0ec9a2fb-d826-4735-b7fe-7fe3500e43c4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:39.265645 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0ec9a2fb-d826-4735-b7fe-7fe3500e43c4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:39.267174 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-34ff9bb1-2dcd-413c-806e-b621df715efb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:39.267795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-34ff9bb1-2dcd-413c-806e-b621df715efb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:39.272219 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ec9a2fb-d826-4735-b7fe-7fe3500e43c4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:39.272649 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ec9a2fb-d826-4735-b7fe-7fe3500e43c4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:39.273406 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ec9a2fb-d826-4735-b7fe-7fe3500e43c4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:39.273868 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ec9a2fb-d826-4735-b7fe-7fe3500e43c4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:39.274198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-34ff9bb1-2dcd-413c-806e-b621df715efb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:39.274653 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-34ff9bb1-2dcd-413c-806e-b621df715efb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:39.275418 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-34ff9bb1-2dcd-413c-806e-b621df715efb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:39.275890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-34ff9bb1-2dcd-413c-806e-b621df715efb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:39.469000 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-34ff9bb1-2dcd-413c-806e-b621df715efb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:39.471877 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0ec9a2fb-d826-4735-b7fe-7fe3500e43c4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:39.477061 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-34ff9bb1-2dcd-413c-806e-b621df715efb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215128 Aug 04 04:58:39.491300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 840/1685] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:39 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:39.491513 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0ec9a2fb-d826-4735-b7fe-7fe3500e43c4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.219619 Aug 04 04:58:39.491513 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 846/1686] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:39 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:39.491701 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-295a64fd-d8cc-479c-9aaf-915905912240 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:39.491701 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-295a64fd-d8cc-479c-9aaf-915905912240 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:39.491701 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-295a64fd-d8cc-479c-9aaf-915905912240 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:39.491701 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-295a64fd-d8cc-479c-9aaf-915905912240 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:39.492067 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-295a64fd-d8cc-479c-9aaf-915905912240 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:39.492067 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-295a64fd-d8cc-479c-9aaf-915905912240 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:39.552678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-295a64fd-d8cc-479c-9aaf-915905912240 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:39.560547 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-295a64fd-d8cc-479c-9aaf-915905912240 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081982 Aug 04 04:58:39.561740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 841/1687] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:40.499176 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5b6d5e1e-6cb4-4208-82a2-4c303ebae310 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:40.500586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5b6d5e1e-6cb4-4208-82a2-4c303ebae310 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:40.502268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-28e62b0b-07b1-48f0-b987-d3b5c3b43d24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:40.502894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-28e62b0b-07b1-48f0-b987-d3b5c3b43d24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:40.507725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5b6d5e1e-6cb4-4208-82a2-4c303ebae310 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:40.508181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5b6d5e1e-6cb4-4208-82a2-4c303ebae310 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:40.508957 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5b6d5e1e-6cb4-4208-82a2-4c303ebae310 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:40.509423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5b6d5e1e-6cb4-4208-82a2-4c303ebae310 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:40.509642 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-28e62b0b-07b1-48f0-b987-d3b5c3b43d24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:40.510061 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-28e62b0b-07b1-48f0-b987-d3b5c3b43d24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:40.510840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-28e62b0b-07b1-48f0-b987-d3b5c3b43d24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:40.511304 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-28e62b0b-07b1-48f0-b987-d3b5c3b43d24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:40.704068 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5b6d5e1e-6cb4-4208-82a2-4c303ebae310 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:40.710337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-28e62b0b-07b1-48f0-b987-d3b5c3b43d24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:40.712420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5b6d5e1e-6cb4-4208-82a2-4c303ebae310 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.217880 Aug 04 04:58:40.712997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 847/1688] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:40 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:40.718087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-35891eb3-09ee-4122-8f7e-984b79745535 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:40.719048 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-35891eb3-09ee-4122-8f7e-984b79745535 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:40.719286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-28e62b0b-07b1-48f0-b987-d3b5c3b43d24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.221401 Aug 04 04:58:40.720090 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 842/1689] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:40 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:40.724919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-35891eb3-09ee-4122-8f7e-984b79745535 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:40.725373 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-35891eb3-09ee-4122-8f7e-984b79745535 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:40.726175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-35891eb3-09ee-4122-8f7e-984b79745535 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:40.726615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-35891eb3-09ee-4122-8f7e-984b79745535 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:40.789614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-35891eb3-09ee-4122-8f7e-984b79745535 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:40.791754 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:40.799725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-35891eb3-09ee-4122-8f7e-984b79745535 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085765 Aug 04 04:58:40.800294 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 848/1690] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:40 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:41.735063 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-80997803-8a1d-4cf2-aa5b-d8b3105c8b5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:41.735700 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-80997803-8a1d-4cf2-aa5b-d8b3105c8b5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:41.739544 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6e53f9a2-4c06-45e5-ad7d-2b5bcc21801e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:41.740157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6e53f9a2-4c06-45e5-ad7d-2b5bcc21801e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:41.742187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80997803-8a1d-4cf2-aa5b-d8b3105c8b5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:41.742635 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80997803-8a1d-4cf2-aa5b-d8b3105c8b5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:41.743399 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80997803-8a1d-4cf2-aa5b-d8b3105c8b5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:41.743835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80997803-8a1d-4cf2-aa5b-d8b3105c8b5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:41.746606 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e53f9a2-4c06-45e5-ad7d-2b5bcc21801e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:41.747048 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e53f9a2-4c06-45e5-ad7d-2b5bcc21801e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:41.747799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e53f9a2-4c06-45e5-ad7d-2b5bcc21801e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:41.748234 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e53f9a2-4c06-45e5-ad7d-2b5bcc21801e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:41.938627 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-80997803-8a1d-4cf2-aa5b-d8b3105c8b5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:41.942353 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6e53f9a2-4c06-45e5-ad7d-2b5bcc21801e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:41.946757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-80997803-8a1d-4cf2-aa5b-d8b3105c8b5b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.216250 Aug 04 04:58:41.947334 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 843/1691] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:41 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:41.950306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6e53f9a2-4c06-45e5-ad7d-2b5bcc21801e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.214482 Aug 04 04:58:41.951029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 849/1692] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:41 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:41.951814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b19c1d98-b33e-4ae0-85d8-4edbd4056f36 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:41.952424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b19c1d98-b33e-4ae0-85d8-4edbd4056f36 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:41.958338 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b19c1d98-b33e-4ae0-85d8-4edbd4056f36 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:41.958799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b19c1d98-b33e-4ae0-85d8-4edbd4056f36 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:41.959564 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b19c1d98-b33e-4ae0-85d8-4edbd4056f36 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:41.960006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b19c1d98-b33e-4ae0-85d8-4edbd4056f36 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:42.021010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b19c1d98-b33e-4ae0-85d8-4edbd4056f36 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:42.028965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b19c1d98-b33e-4ae0-85d8-4edbd4056f36 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080691 Aug 04 04:58:42.029525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 844/1693] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:41 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:42.968040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-72fc71ec-711f-405b-99cc-c916d5244e3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:42.968636 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-72fc71ec-711f-405b-99cc-c916d5244e3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:42.971808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-41901540-ac22-42f3-ade7-8273648ea176 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:42.972325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-41901540-ac22-42f3-ade7-8273648ea176 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:42.975994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72fc71ec-711f-405b-99cc-c916d5244e3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:42.976441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72fc71ec-711f-405b-99cc-c916d5244e3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:42.977203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72fc71ec-711f-405b-99cc-c916d5244e3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:42.977674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72fc71ec-711f-405b-99cc-c916d5244e3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:42.979695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-41901540-ac22-42f3-ade7-8273648ea176 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:42.980153 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-41901540-ac22-42f3-ade7-8273648ea176 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:42.980926 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-41901540-ac22-42f3-ade7-8273648ea176 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:42.981397 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-41901540-ac22-42f3-ade7-8273648ea176 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:43.173749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-72fc71ec-711f-405b-99cc-c916d5244e3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:43.176608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-41901540-ac22-42f3-ade7-8273648ea176 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:43.181989 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-72fc71ec-711f-405b-99cc-c916d5244e3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.217814 Aug 04 04:58:43.182640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 850/1694] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:42 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:43.184429 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-41901540-ac22-42f3-ade7-8273648ea176 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.216527 Aug 04 04:58:43.187790 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ef79ffd8-5290-47ca-8f25-8ad6eb41ed6d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:43.188397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ef79ffd8-5290-47ca-8f25-8ad6eb41ed6d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:43.191565 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 845/1695] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:42 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:43.194127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef79ffd8-5290-47ca-8f25-8ad6eb41ed6d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:43.194574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef79ffd8-5290-47ca-8f25-8ad6eb41ed6d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:43.195330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef79ffd8-5290-47ca-8f25-8ad6eb41ed6d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:43.195768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef79ffd8-5290-47ca-8f25-8ad6eb41ed6d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:43.259223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ef79ffd8-5290-47ca-8f25-8ad6eb41ed6d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:43.268176 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ef79ffd8-5290-47ca-8f25-8ad6eb41ed6d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084597 Aug 04 04:58:43.268736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 851/1696] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:43 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:44.205203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-94c7d7c2-662b-47b5-ae12-4e943c21d6b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:44.205754 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-94c7d7c2-662b-47b5-ae12-4e943c21d6b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:44.205942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c368edf2-475a-4427-8c51-930e8e911def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:44.206564 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c368edf2-475a-4427-8c51-930e8e911def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:44.212407 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-94c7d7c2-662b-47b5-ae12-4e943c21d6b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:44.212854 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-94c7d7c2-662b-47b5-ae12-4e943c21d6b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:44.213046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c368edf2-475a-4427-8c51-930e8e911def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:44.213502 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c368edf2-475a-4427-8c51-930e8e911def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:44.213660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-94c7d7c2-662b-47b5-ae12-4e943c21d6b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:44.214180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-94c7d7c2-662b-47b5-ae12-4e943c21d6b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:44.214313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c368edf2-475a-4427-8c51-930e8e911def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:44.214722 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c368edf2-475a-4427-8c51-930e8e911def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:44.411540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c368edf2-475a-4427-8c51-930e8e911def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:44.416588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-94c7d7c2-662b-47b5-ae12-4e943c21d6b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:44.419693 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c368edf2-475a-4427-8c51-930e8e911def tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.218237 Aug 04 04:58:44.420488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 852/1697] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:44 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:44.424920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-94c7d7c2-662b-47b5-ae12-4e943c21d6b1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.224264 Aug 04 04:58:44.431450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 846/1698] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:44 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:44.432856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-18af733e-9b4b-4ac4-8036-f40bab28f770 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:44.433482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-18af733e-9b4b-4ac4-8036-f40bab28f770 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:44.440405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18af733e-9b4b-4ac4-8036-f40bab28f770 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:44.440853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18af733e-9b4b-4ac4-8036-f40bab28f770 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:44.441702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18af733e-9b4b-4ac4-8036-f40bab28f770 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:44.442149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18af733e-9b4b-4ac4-8036-f40bab28f770 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:44.502601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-18af733e-9b4b-4ac4-8036-f40bab28f770 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:44.510957 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-18af733e-9b4b-4ac4-8036-f40bab28f770 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.088156 Aug 04 04:58:44.511656 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 853/1699] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:44 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:45.441167 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d896de38-099a-449a-b43d-0d6470d7ecfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:45.441814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d896de38-099a-449a-b43d-0d6470d7ecfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:45.446242 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7936c69b-81dd-41b6-a24a-deb4b35d40c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:45.446887 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7936c69b-81dd-41b6-a24a-deb4b35d40c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:45.448333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d896de38-099a-449a-b43d-0d6470d7ecfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:45.448793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d896de38-099a-449a-b43d-0d6470d7ecfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:45.449597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d896de38-099a-449a-b43d-0d6470d7ecfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:45.450041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d896de38-099a-449a-b43d-0d6470d7ecfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:45.453213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7936c69b-81dd-41b6-a24a-deb4b35d40c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:45.453853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7936c69b-81dd-41b6-a24a-deb4b35d40c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:45.454625 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7936c69b-81dd-41b6-a24a-deb4b35d40c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:45.455056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7936c69b-81dd-41b6-a24a-deb4b35d40c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:45.642072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d896de38-099a-449a-b43d-0d6470d7ecfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:45.645270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7936c69b-81dd-41b6-a24a-deb4b35d40c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:45.650245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d896de38-099a-449a-b43d-0d6470d7ecfe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.213798 Aug 04 04:58:45.653603 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 847/1700] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:45 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:45.653781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7936c69b-81dd-41b6-a24a-deb4b35d40c1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.210847 Aug 04 04:58:45.654402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 854/1701] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:45 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:45.657780 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-45781299-9749-45c0-9567-756f830cba4e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:45.658463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-45781299-9749-45c0-9567-756f830cba4e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:45.664495 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-45781299-9749-45c0-9567-756f830cba4e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:45.664945 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-45781299-9749-45c0-9567-756f830cba4e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:45.665739 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-45781299-9749-45c0-9567-756f830cba4e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:45.666170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-45781299-9749-45c0-9567-756f830cba4e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:45.726006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-45781299-9749-45c0-9567-756f830cba4e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:45.733712 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-45781299-9749-45c0-9567-756f830cba4e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081849 Aug 04 04:58:45.734269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 848/1702] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:45 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:46.671340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-77a2e792-51b5-4116-a4ad-b683fc3326bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:46.672194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-77a2e792-51b5-4116-a4ad-b683fc3326bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:46.676001 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c183c6c5-4c7f-42aa-85b9-74b55e8bf114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:46.676630 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c183c6c5-4c7f-42aa-85b9-74b55e8bf114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:46.679575 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77a2e792-51b5-4116-a4ad-b683fc3326bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:46.680025 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77a2e792-51b5-4116-a4ad-b683fc3326bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:46.680829 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77a2e792-51b5-4116-a4ad-b683fc3326bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:46.681264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77a2e792-51b5-4116-a4ad-b683fc3326bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:46.683283 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c183c6c5-4c7f-42aa-85b9-74b55e8bf114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:46.683734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c183c6c5-4c7f-42aa-85b9-74b55e8bf114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:46.684522 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c183c6c5-4c7f-42aa-85b9-74b55e8bf114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:46.684955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c183c6c5-4c7f-42aa-85b9-74b55e8bf114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:46.882087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-77a2e792-51b5-4116-a4ad-b683fc3326bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:46.885996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c183c6c5-4c7f-42aa-85b9-74b55e8bf114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:46.890267 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-77a2e792-51b5-4116-a4ad-b683fc3326bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.222906 Aug 04 04:58:46.891341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 855/1703] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:46 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:46.894827 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c183c6c5-4c7f-42aa-85b9-74b55e8bf114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.224015 Aug 04 04:58:46.895556 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 849/1704] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:46 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:46.895793 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9707f80b-f80f-49a9-8e8b-c311142b1488 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:46.896403 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9707f80b-f80f-49a9-8e8b-c311142b1488 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:46.902261 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9707f80b-f80f-49a9-8e8b-c311142b1488 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:46.902709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9707f80b-f80f-49a9-8e8b-c311142b1488 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:46.903469 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9707f80b-f80f-49a9-8e8b-c311142b1488 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:46.903908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9707f80b-f80f-49a9-8e8b-c311142b1488 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:46.963706 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9707f80b-f80f-49a9-8e8b-c311142b1488 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:46.972527 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9707f80b-f80f-49a9-8e8b-c311142b1488 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080199 Aug 04 04:58:46.973085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 856/1705] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:46 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:47.912426 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cd6914a7-268b-4773-be40-ee47499aacd5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:47.913037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cd6914a7-268b-4773-be40-ee47499aacd5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:47.916242 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6cc12ed2-ed7d-4f23-bd05-4da4d486e684 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:47.916862 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6cc12ed2-ed7d-4f23-bd05-4da4d486e684 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:47.919547 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd6914a7-268b-4773-be40-ee47499aacd5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:47.919996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd6914a7-268b-4773-be40-ee47499aacd5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:47.920752 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd6914a7-268b-4773-be40-ee47499aacd5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:47.921185 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd6914a7-268b-4773-be40-ee47499aacd5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:47.923839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6cc12ed2-ed7d-4f23-bd05-4da4d486e684 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:47.924284 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6cc12ed2-ed7d-4f23-bd05-4da4d486e684 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:47.925050 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6cc12ed2-ed7d-4f23-bd05-4da4d486e684 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:47.925487 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6cc12ed2-ed7d-4f23-bd05-4da4d486e684 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:48.119521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-cd6914a7-268b-4773-be40-ee47499aacd5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:48.121811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:48.123415 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6cc12ed2-ed7d-4f23-bd05-4da4d486e684 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:48.129154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cd6914a7-268b-4773-be40-ee47499aacd5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.220540 Aug 04 04:58:48.129851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 850/1706] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:47 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:48.131543 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6cc12ed2-ed7d-4f23-bd05-4da4d486e684 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.219073 Aug 04 04:58:48.132266 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 857/1707] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:47 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:48.134491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e456e7fd-4334-41e7-8d47-a928c31d03ea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:48.135170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e456e7fd-4334-41e7-8d47-a928c31d03ea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:48.141130 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e456e7fd-4334-41e7-8d47-a928c31d03ea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:48.141726 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e456e7fd-4334-41e7-8d47-a928c31d03ea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:48.142507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e456e7fd-4334-41e7-8d47-a928c31d03ea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:48.143029 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e456e7fd-4334-41e7-8d47-a928c31d03ea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:48.203525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e456e7fd-4334-41e7-8d47-a928c31d03ea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:48.211671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e456e7fd-4334-41e7-8d47-a928c31d03ea tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080791 Aug 04 04:58:48.212234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 851/1708] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:48 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:49.151502 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1720b0ef-d17f-4cbd-9111-4b77bea0448f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:49.152146 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-25b339f7-aab7-4795-8c31-f1ab6da3decc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:49.152540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1720b0ef-d17f-4cbd-9111-4b77bea0448f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:49.152652 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-25b339f7-aab7-4795-8c31-f1ab6da3decc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:49.159237 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1720b0ef-d17f-4cbd-9111-4b77bea0448f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:49.159439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25b339f7-aab7-4795-8c31-f1ab6da3decc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:49.159690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1720b0ef-d17f-4cbd-9111-4b77bea0448f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:49.159811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25b339f7-aab7-4795-8c31-f1ab6da3decc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:49.160467 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25b339f7-aab7-4795-8c31-f1ab6da3decc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:49.160588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1720b0ef-d17f-4cbd-9111-4b77bea0448f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:49.160902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25b339f7-aab7-4795-8c31-f1ab6da3decc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:49.161011 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1720b0ef-d17f-4cbd-9111-4b77bea0448f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:49.357826 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-25b339f7-aab7-4795-8c31-f1ab6da3decc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:49.361411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1720b0ef-d17f-4cbd-9111-4b77bea0448f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:49.367248 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-25b339f7-aab7-4795-8c31-f1ab6da3decc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.219054 Aug 04 04:58:49.367821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 852/1709] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:49 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:49.370085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1720b0ef-d17f-4cbd-9111-4b77bea0448f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.222430 Aug 04 04:58:49.370797 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 858/1710] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:49 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:49.372649 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1e31b0eb-eb03-4bbd-b759-7d47c26c1510 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:49.373375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1e31b0eb-eb03-4bbd-b759-7d47c26c1510 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:49.380080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1e31b0eb-eb03-4bbd-b759-7d47c26c1510 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:49.380536 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1e31b0eb-eb03-4bbd-b759-7d47c26c1510 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:49.381311 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1e31b0eb-eb03-4bbd-b759-7d47c26c1510 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:49.381781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1e31b0eb-eb03-4bbd-b759-7d47c26c1510 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:49.444344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1e31b0eb-eb03-4bbd-b759-7d47c26c1510 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:49.452243 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1e31b0eb-eb03-4bbd-b759-7d47c26c1510 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083406 Aug 04 04:58:49.452815 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 853/1711] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:49 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:50.389179 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b0d7b670-9ede-42d3-b85f-4e85ba8aab59 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:50.389823 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b0d7b670-9ede-42d3-b85f-4e85ba8aab59 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:50.390485 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-31b05b80-d1b6-483f-856c-7582848a1a5b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:50.392098 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-31b05b80-d1b6-483f-856c-7582848a1a5b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:50.397116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0d7b670-9ede-42d3-b85f-4e85ba8aab59 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:50.397589 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0d7b670-9ede-42d3-b85f-4e85ba8aab59 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:50.398341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31b05b80-d1b6-483f-856c-7582848a1a5b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:50.398472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0d7b670-9ede-42d3-b85f-4e85ba8aab59 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:50.398785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b0d7b670-9ede-42d3-b85f-4e85ba8aab59 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:50.398918 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31b05b80-d1b6-483f-856c-7582848a1a5b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:50.399551 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31b05b80-d1b6-483f-856c-7582848a1a5b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:50.399992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31b05b80-d1b6-483f-856c-7582848a1a5b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:50.594482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b0d7b670-9ede-42d3-b85f-4e85ba8aab59 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:50.598021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-31b05b80-d1b6-483f-856c-7582848a1a5b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:50.602674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b0d7b670-9ede-42d3-b85f-4e85ba8aab59 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.217336 Aug 04 04:58:50.613736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 859/1712] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:50 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:50.613938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-31b05b80-d1b6-483f-856c-7582848a1a5b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.219110 Aug 04 04:58:50.613938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 854/1713] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:50 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:50.614170 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e8ef8746-6f6f-4bce-8798-44e96cd88c81 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:50.614170 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e8ef8746-6f6f-4bce-8798-44e96cd88c81 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:50.615490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e8ef8746-6f6f-4bce-8798-44e96cd88c81 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:50.615939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e8ef8746-6f6f-4bce-8798-44e96cd88c81 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:50.616701 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e8ef8746-6f6f-4bce-8798-44e96cd88c81 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:50.617137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e8ef8746-6f6f-4bce-8798-44e96cd88c81 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:50.678021 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e8ef8746-6f6f-4bce-8798-44e96cd88c81 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:50.685874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e8ef8746-6f6f-4bce-8798-44e96cd88c81 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081634 Aug 04 04:58:50.686438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 860/1714] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:50 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:51.625817 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bf19e9a0-52c2-4aeb-95dd-f5128ad26899 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:51.626410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-bf19e9a0-52c2-4aeb-95dd-f5128ad26899 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:51.626591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5eded0bb-f46b-4ebc-8f32-26b2b67c9659 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:51.627211 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5eded0bb-f46b-4ebc-8f32-26b2b67c9659 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:51.633194 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bf19e9a0-52c2-4aeb-95dd-f5128ad26899 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:51.633673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bf19e9a0-52c2-4aeb-95dd-f5128ad26899 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:51.633969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5eded0bb-f46b-4ebc-8f32-26b2b67c9659 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:51.634423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5eded0bb-f46b-4ebc-8f32-26b2b67c9659 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:51.634537 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bf19e9a0-52c2-4aeb-95dd-f5128ad26899 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:51.634880 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bf19e9a0-52c2-4aeb-95dd-f5128ad26899 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:51.635186 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5eded0bb-f46b-4ebc-8f32-26b2b67c9659 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:51.635660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5eded0bb-f46b-4ebc-8f32-26b2b67c9659 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:51.829677 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-bf19e9a0-52c2-4aeb-95dd-f5128ad26899 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:51.832714 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5eded0bb-f46b-4ebc-8f32-26b2b67c9659 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:51.837704 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-bf19e9a0-52c2-4aeb-95dd-f5128ad26899 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215755 Aug 04 04:58:51.838395 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 855/1715] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:51 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:51.841687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5eded0bb-f46b-4ebc-8f32-26b2b67c9659 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.219185 Aug 04 04:58:51.843045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-56e766cc-4d64-4868-bf7c-e8098c5d71e2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:51.849288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-56e766cc-4d64-4868-bf7c-e8098c5d71e2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:51.849782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 861/1716] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:51 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:51.850877 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56e766cc-4d64-4868-bf7c-e8098c5d71e2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:51.851414 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56e766cc-4d64-4868-bf7c-e8098c5d71e2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:51.852267 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56e766cc-4d64-4868-bf7c-e8098c5d71e2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:51.852717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56e766cc-4d64-4868-bf7c-e8098c5d71e2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:51.913682 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-56e766cc-4d64-4868-bf7c-e8098c5d71e2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:51.921848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-56e766cc-4d64-4868-bf7c-e8098c5d71e2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082144 Aug 04 04:58:51.922978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 856/1717] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:51 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:52.860151 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7c067223-3249-4ed6-bf4a-8dce75f319ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:52.860776 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7c067223-3249-4ed6-bf4a-8dce75f319ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:52.864816 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5c9fe157-7766-4955-8c09-6ca98978d150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:52.865439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5c9fe157-7766-4955-8c09-6ca98978d150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:52.867345 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c067223-3249-4ed6-bf4a-8dce75f319ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:52.867800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c067223-3249-4ed6-bf4a-8dce75f319ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:52.868568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c067223-3249-4ed6-bf4a-8dce75f319ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:52.869012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c067223-3249-4ed6-bf4a-8dce75f319ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:52.872061 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c9fe157-7766-4955-8c09-6ca98978d150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:52.872511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c9fe157-7766-4955-8c09-6ca98978d150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:52.873276 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c9fe157-7766-4955-8c09-6ca98978d150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:52.873743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c9fe157-7766-4955-8c09-6ca98978d150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:53.065073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7c067223-3249-4ed6-bf4a-8dce75f319ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:53.068392 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5c9fe157-7766-4955-8c09-6ca98978d150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:53.073128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7c067223-3249-4ed6-bf4a-8dce75f319ea tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.217378 Aug 04 04:58:53.073716 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 862/1718] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:52 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:53.078134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5c9fe157-7766-4955-8c09-6ca98978d150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.215760 Aug 04 04:58:53.078134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 857/1719] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:52 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:53.078438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2e86d9b4-6ac7-46a4-861b-2f63dc749dc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:53.079032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2e86d9b4-6ac7-46a4-861b-2f63dc749dc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:53.085054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e86d9b4-6ac7-46a4-861b-2f63dc749dc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:53.085583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e86d9b4-6ac7-46a4-861b-2f63dc749dc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:53.086775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e86d9b4-6ac7-46a4-861b-2f63dc749dc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:53.087509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2e86d9b4-6ac7-46a4-861b-2f63dc749dc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:53.153255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2e86d9b4-6ac7-46a4-861b-2f63dc749dc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:53.161273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2e86d9b4-6ac7-46a4-861b-2f63dc749dc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086515 Aug 04 04:58:53.162022 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 863/1720] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:53 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:54.095899 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ca74a8e4-d53e-4a63-ad8f-1206f20b93b4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:54.096449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ca74a8e4-d53e-4a63-ad8f-1206f20b93b4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:54.102688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5fe3c617-7e9e-4c25-b107-5d3f46ff0beb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:54.103135 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca74a8e4-d53e-4a63-ad8f-1206f20b93b4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:54.103302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5fe3c617-7e9e-4c25-b107-5d3f46ff0beb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:54.103428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca74a8e4-d53e-4a63-ad8f-1206f20b93b4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:54.104189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca74a8e4-d53e-4a63-ad8f-1206f20b93b4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:54.104628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca74a8e4-d53e-4a63-ad8f-1206f20b93b4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:54.109601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5fe3c617-7e9e-4c25-b107-5d3f46ff0beb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:54.110759 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5fe3c617-7e9e-4c25-b107-5d3f46ff0beb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:54.111517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5fe3c617-7e9e-4c25-b107-5d3f46ff0beb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:54.111946 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5fe3c617-7e9e-4c25-b107-5d3f46ff0beb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:54.535113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5fe3c617-7e9e-4c25-b107-5d3f46ff0beb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:54.538087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ca74a8e4-d53e-4a63-ad8f-1206f20b93b4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:54.543171 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5fe3c617-7e9e-4c25-b107-5d3f46ff0beb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.444252 Aug 04 04:58:54.543751 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 864/1721] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:54 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:54.546018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ca74a8e4-d53e-4a63-ad8f-1206f20b93b4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.454553 Aug 04 04:58:54.547396 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 858/1722] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:54 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:54.549025 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4a4967b4-5116-4adc-b584-bd981c8ff48b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:54.549662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4a4967b4-5116-4adc-b584-bd981c8ff48b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:54.555469 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4a4967b4-5116-4adc-b584-bd981c8ff48b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:54.555918 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4a4967b4-5116-4adc-b584-bd981c8ff48b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:54.556675 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4a4967b4-5116-4adc-b584-bd981c8ff48b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:54.557114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4a4967b4-5116-4adc-b584-bd981c8ff48b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:54.572197 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:54.617003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4a4967b4-5116-4adc-b584-bd981c8ff48b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:54.624717 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4a4967b4-5116-4adc-b584-bd981c8ff48b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080037 Aug 04 04:58:54.625946 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 865/1723] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:54 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:55.565498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6aa8510d-8313-4947-87d8-31b4f395b542 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:55.566140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6aa8510d-8313-4947-87d8-31b4f395b542 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:55.567544 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8e60cac1-a4bb-4b2e-8511-5c1fff3840fd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:55.568165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8e60cac1-a4bb-4b2e-8511-5c1fff3840fd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:55.572845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6aa8510d-8313-4947-87d8-31b4f395b542 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:55.573302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6aa8510d-8313-4947-87d8-31b4f395b542 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:55.574096 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6aa8510d-8313-4947-87d8-31b4f395b542 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:55.574535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6aa8510d-8313-4947-87d8-31b4f395b542 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:55.575141 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8e60cac1-a4bb-4b2e-8511-5c1fff3840fd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:55.575598 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8e60cac1-a4bb-4b2e-8511-5c1fff3840fd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:55.576380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8e60cac1-a4bb-4b2e-8511-5c1fff3840fd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:55.576911 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8e60cac1-a4bb-4b2e-8511-5c1fff3840fd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:55.766419 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6aa8510d-8313-4947-87d8-31b4f395b542 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:55.773046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8e60cac1-a4bb-4b2e-8511-5c1fff3840fd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:55.774382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6aa8510d-8313-4947-87d8-31b4f395b542 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.212781 Aug 04 04:58:55.774993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 859/1724] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:55 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:55.779480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-76181ad6-6690-412b-8aed-9d0c403cb476 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:55.780089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-76181ad6-6690-412b-8aed-9d0c403cb476 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:55.781947 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8e60cac1-a4bb-4b2e-8511-5c1fff3840fd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.217569 Aug 04 04:58:55.782581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 866/1725] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:55 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:55.786943 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-76181ad6-6690-412b-8aed-9d0c403cb476 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:55.787394 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-76181ad6-6690-412b-8aed-9d0c403cb476 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:55.788268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-76181ad6-6690-412b-8aed-9d0c403cb476 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:55.788738 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-76181ad6-6690-412b-8aed-9d0c403cb476 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:55.853794 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-76181ad6-6690-412b-8aed-9d0c403cb476 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:55.862459 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-76181ad6-6690-412b-8aed-9d0c403cb476 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086524 Aug 04 04:58:55.863015 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 860/1726] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:55 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:56.795604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a4e109f7-cbc5-4f3f-ba95-be12a39d0caa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:56.796215 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a4e109f7-cbc5-4f3f-ba95-be12a39d0caa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:56.799380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=74 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:56.803535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d5be69b5-0720-4fab-acd6-f99ffd711370 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:56.804154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d5be69b5-0720-4fab-acd6-f99ffd711370 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:56.805105 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4e109f7-cbc5-4f3f-ba95-be12a39d0caa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:56.805584 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4e109f7-cbc5-4f3f-ba95-be12a39d0caa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:56.806344 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4e109f7-cbc5-4f3f-ba95-be12a39d0caa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:56.806775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4e109f7-cbc5-4f3f-ba95-be12a39d0caa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:56.810651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5be69b5-0720-4fab-acd6-f99ffd711370 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:56.811102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5be69b5-0720-4fab-acd6-f99ffd711370 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:56.811872 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5be69b5-0720-4fab-acd6-f99ffd711370 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:56.812314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5be69b5-0720-4fab-acd6-f99ffd711370 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:57.001037 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a4e109f7-cbc5-4f3f-ba95-be12a39d0caa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:57.004968 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d5be69b5-0720-4fab-acd6-f99ffd711370 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:57.008970 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a4e109f7-cbc5-4f3f-ba95-be12a39d0caa tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.217209 Aug 04 04:58:57.009537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 867/1727] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:56 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:57.014011 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-84722b14-38c8-4679-9d8d-78b25598b204 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:57.014574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-84722b14-38c8-4679-9d8d-78b25598b204 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:57.017759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d5be69b5-0720-4fab-acd6-f99ffd711370 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.217941 Aug 04 04:58:57.018350 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 861/1728] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:56 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:57.021238 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84722b14-38c8-4679-9d8d-78b25598b204 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:57.021781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84722b14-38c8-4679-9d8d-78b25598b204 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:57.022593 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84722b14-38c8-4679-9d8d-78b25598b204 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:57.023087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84722b14-38c8-4679-9d8d-78b25598b204 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:57.083569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-84722b14-38c8-4679-9d8d-78b25598b204 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:57.091420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-84722b14-38c8-4679-9d8d-78b25598b204 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080927 Aug 04 04:58:57.091973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 868/1729] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:57 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:58.031767 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b5f831d7-d413-4d12-b9b1-53f2a837f115 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:58.032374 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b5f831d7-d413-4d12-b9b1-53f2a837f115 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:58.034760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=74 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:58:58.039764 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-08e361e6-6761-495d-9d6b-7aa183161220 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:58.040385 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b5f831d7-d413-4d12-b9b1-53f2a837f115 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:58.040528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-08e361e6-6761-495d-9d6b-7aa183161220 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:58.040813 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b5f831d7-d413-4d12-b9b1-53f2a837f115 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:58.041607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b5f831d7-d413-4d12-b9b1-53f2a837f115 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:58.042048 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b5f831d7-d413-4d12-b9b1-53f2a837f115 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:58.046468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-08e361e6-6761-495d-9d6b-7aa183161220 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:58.047919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-08e361e6-6761-495d-9d6b-7aa183161220 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:58.048684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-08e361e6-6761-495d-9d6b-7aa183161220 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:58.049116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-08e361e6-6761-495d-9d6b-7aa183161220 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:58.241033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b5f831d7-d413-4d12-b9b1-53f2a837f115 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:58.243799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-08e361e6-6761-495d-9d6b-7aa183161220 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:58.249222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b5f831d7-d413-4d12-b9b1-53f2a837f115 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.221974 Aug 04 04:58:58.249838 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 862/1730] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:58 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:58.251826 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-08e361e6-6761-495d-9d6b-7aa183161220 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215976 Aug 04 04:58:58.252577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 869/1731] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:58 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:58.254672 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2c58a194-57f5-47d8-a533-f60c2d686205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:58.255275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2c58a194-57f5-47d8-a533-f60c2d686205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:58.261179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2c58a194-57f5-47d8-a533-f60c2d686205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:58.261655 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2c58a194-57f5-47d8-a533-f60c2d686205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:58.262407 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2c58a194-57f5-47d8-a533-f60c2d686205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:58.262836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2c58a194-57f5-47d8-a533-f60c2d686205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:58.323873 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2c58a194-57f5-47d8-a533-f60c2d686205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:58.332656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2c58a194-57f5-47d8-a533-f60c2d686205 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081678 Aug 04 04:58:58.333217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 863/1732] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:58 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:59.270582 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f51fe9e0-6429-4d8a-b2aa-0ff28ec27572 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:59.271201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f51fe9e0-6429-4d8a-b2aa-0ff28ec27572 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:59.273179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-49f6d85f-eb33-4f17-ad04-dd15d3308c0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:59.273951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-49f6d85f-eb33-4f17-ad04-dd15d3308c0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:59.278390 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f51fe9e0-6429-4d8a-b2aa-0ff28ec27572 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:59.278934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f51fe9e0-6429-4d8a-b2aa-0ff28ec27572 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:59.279586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f51fe9e0-6429-4d8a-b2aa-0ff28ec27572 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:59.280046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f51fe9e0-6429-4d8a-b2aa-0ff28ec27572 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:59.280378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49f6d85f-eb33-4f17-ad04-dd15d3308c0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:59.280830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49f6d85f-eb33-4f17-ad04-dd15d3308c0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:59.281823 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49f6d85f-eb33-4f17-ad04-dd15d3308c0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:59.282246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49f6d85f-eb33-4f17-ad04-dd15d3308c0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:59.474164 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f51fe9e0-6429-4d8a-b2aa-0ff28ec27572 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:59.478320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-49f6d85f-eb33-4f17-ad04-dd15d3308c0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:59.487506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f51fe9e0-6429-4d8a-b2aa-0ff28ec27572 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.220708 Aug 04 04:58:59.488441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 870/1733] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:59 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:59.491372 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-49f6d85f-eb33-4f17-ad04-dd15d3308c0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.222180 Aug 04 04:58:59.492433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 864/1734] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:59 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:58:59.494650 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1bdb6a70-f3d9-4f82-a06c-054ddd5e935a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:58:59.495250 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1bdb6a70-f3d9-4f82-a06c-054ddd5e935a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:58:59.502410 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1bdb6a70-f3d9-4f82-a06c-054ddd5e935a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:59.503229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1bdb6a70-f3d9-4f82-a06c-054ddd5e935a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:59.504175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1bdb6a70-f3d9-4f82-a06c-054ddd5e935a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:58:59.504766 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1bdb6a70-f3d9-4f82-a06c-054ddd5e935a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:58:59.566795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1bdb6a70-f3d9-4f82-a06c-054ddd5e935a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:58:59.574583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1bdb6a70-f3d9-4f82-a06c-054ddd5e935a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084901 Aug 04 04:58:59.575269 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 871/1735] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:58:59 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:58:59.786086 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:58:59.786374 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 04:58:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:59:00.513381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8881be77-8787-4772-8e47-288b8369736c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:00.514241 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8881be77-8787-4772-8e47-288b8369736c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:00.515158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9c3fe43d-a912-45d4-b610-4590b075f2e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:00.515960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9c3fe43d-a912-45d4-b610-4590b075f2e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:00.521890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8881be77-8787-4772-8e47-288b8369736c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:00.522339 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8881be77-8787-4772-8e47-288b8369736c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:00.522655 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9c3fe43d-a912-45d4-b610-4590b075f2e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:00.523095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9c3fe43d-a912-45d4-b610-4590b075f2e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:00.523210 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8881be77-8787-4772-8e47-288b8369736c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:00.523584 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8881be77-8787-4772-8e47-288b8369736c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:00.523881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9c3fe43d-a912-45d4-b610-4590b075f2e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:00.524309 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9c3fe43d-a912-45d4-b610-4590b075f2e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:00.720324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8881be77-8787-4772-8e47-288b8369736c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:00.724861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9c3fe43d-a912-45d4-b610-4590b075f2e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:00.728616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8881be77-8787-4772-8e47-288b8369736c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.219170 Aug 04 04:59:00.729198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 865/1736] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:00 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:00.732991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9c3fe43d-a912-45d4-b610-4590b075f2e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.221591 Aug 04 04:59:00.737811 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 872/1737] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:00 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:00.737976 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0c039758-c969-4d78-8645-87478e0d13d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:00.737976 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0c039758-c969-4d78-8645-87478e0d13d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:00.740704 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c039758-c969-4d78-8645-87478e0d13d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:00.741158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c039758-c969-4d78-8645-87478e0d13d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:00.741949 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c039758-c969-4d78-8645-87478e0d13d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:00.742386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c039758-c969-4d78-8645-87478e0d13d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:00.802985 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0c039758-c969-4d78-8645-87478e0d13d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:00.810749 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0c039758-c969-4d78-8645-87478e0d13d9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080524 Aug 04 04:59:00.811308 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 866/1738] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:00 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:01.751611 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-29bac7b4-6762-46d0-b7df-77e8a53ebd1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:01.752219 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-29bac7b4-6762-46d0-b7df-77e8a53ebd1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:01.754060 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-31206ffa-565b-441a-8650-727ec2b2b3ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:01.754674 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-31206ffa-565b-441a-8650-727ec2b2b3ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:01.758874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29bac7b4-6762-46d0-b7df-77e8a53ebd1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:01.759258 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29bac7b4-6762-46d0-b7df-77e8a53ebd1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:01.760027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29bac7b4-6762-46d0-b7df-77e8a53ebd1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:01.760462 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29bac7b4-6762-46d0-b7df-77e8a53ebd1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:01.761008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31206ffa-565b-441a-8650-727ec2b2b3ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:01.761453 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31206ffa-565b-441a-8650-727ec2b2b3ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:01.762270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31206ffa-565b-441a-8650-727ec2b2b3ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:01.762705 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31206ffa-565b-441a-8650-727ec2b2b3ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:01.777583 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:01.949236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-29bac7b4-6762-46d0-b7df-77e8a53ebd1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:01.956350 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-31206ffa-565b-441a-8650-727ec2b2b3ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:01.957883 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-29bac7b4-6762-46d0-b7df-77e8a53ebd1b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.210675 Aug 04 04:59:01.958457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 873/1739] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:01 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:01.962961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5638fa8d-2d80-40a1-bf10-696b3502936d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:01.963572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5638fa8d-2d80-40a1-bf10-696b3502936d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:01.964289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-31206ffa-565b-441a-8650-727ec2b2b3ea tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.214483 Aug 04 04:59:01.965028 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 867/1740] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:01 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:01.970112 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5638fa8d-2d80-40a1-bf10-696b3502936d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:01.970926 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5638fa8d-2d80-40a1-bf10-696b3502936d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:01.971696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5638fa8d-2d80-40a1-bf10-696b3502936d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:01.972137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5638fa8d-2d80-40a1-bf10-696b3502936d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:02.035356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5638fa8d-2d80-40a1-bf10-696b3502936d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:02.043210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5638fa8d-2d80-40a1-bf10-696b3502936d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083815 Aug 04 04:59:02.043766 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 874/1741] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:01 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:02.979364 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-486becc0-92e6-4aca-8d18-4f57e777c83e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:02.979974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-486becc0-92e6-4aca-8d18-4f57e777c83e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:02.985835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bdba3f3e-2eb2-4041-b21d-b4eb672ccf93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:02.987120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-486becc0-92e6-4aca-8d18-4f57e777c83e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:02.987352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bdba3f3e-2eb2-4041-b21d-b4eb672ccf93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:02.987550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-486becc0-92e6-4aca-8d18-4f57e777c83e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:02.988314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-486becc0-92e6-4aca-8d18-4f57e777c83e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:02.988750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-486becc0-92e6-4aca-8d18-4f57e777c83e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:02.993811 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bdba3f3e-2eb2-4041-b21d-b4eb672ccf93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:02.994264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bdba3f3e-2eb2-4041-b21d-b4eb672ccf93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:02.995032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bdba3f3e-2eb2-4041-b21d-b4eb672ccf93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:02.995473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bdba3f3e-2eb2-4041-b21d-b4eb672ccf93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:03.190074 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-486becc0-92e6-4aca-8d18-4f57e777c83e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:03.193095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bdba3f3e-2eb2-4041-b21d-b4eb672ccf93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:03.198132 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-486becc0-92e6-4aca-8d18-4f57e777c83e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.222550 Aug 04 04:59:03.198709 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 868/1742] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:02 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:03.200886 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bdba3f3e-2eb2-4041-b21d-b4eb672ccf93 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.218817 Aug 04 04:59:03.201619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 875/1743] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:02 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:03.203143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0ef76d1d-d205-4413-af11-553293d84716 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:03.203749 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0ef76d1d-d205-4413-af11-553293d84716 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:03.209754 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ef76d1d-d205-4413-af11-553293d84716 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:03.210204 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ef76d1d-d205-4413-af11-553293d84716 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:03.210965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ef76d1d-d205-4413-af11-553293d84716 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:03.211479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ef76d1d-d205-4413-af11-553293d84716 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:03.274956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0ef76d1d-d205-4413-af11-553293d84716 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:03.284027 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0ef76d1d-d205-4413-af11-553293d84716 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083753 Aug 04 04:59:03.284653 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 869/1744] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:03 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:04.221344 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8d6815fa-36c5-4a0e-a146-79455a042e0d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:04.222111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8d6815fa-36c5-4a0e-a146-79455a042e0d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:04.222570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5cef9be1-4de0-4dff-84ab-3b589f02e5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:04.223256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5cef9be1-4de0-4dff-84ab-3b589f02e5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:04.228624 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d6815fa-36c5-4a0e-a146-79455a042e0d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:04.229091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d6815fa-36c5-4a0e-a146-79455a042e0d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:04.229879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5cef9be1-4de0-4dff-84ab-3b589f02e5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:04.230023 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d6815fa-36c5-4a0e-a146-79455a042e0d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:04.230345 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5cef9be1-4de0-4dff-84ab-3b589f02e5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:04.230453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d6815fa-36c5-4a0e-a146-79455a042e0d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:04.231109 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5cef9be1-4de0-4dff-84ab-3b589f02e5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:04.231551 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5cef9be1-4de0-4dff-84ab-3b589f02e5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:04.425764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5cef9be1-4de0-4dff-84ab-3b589f02e5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:04.429975 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8d6815fa-36c5-4a0e-a146-79455a042e0d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:04.433814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5cef9be1-4de0-4dff-84ab-3b589f02e5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.215646 Aug 04 04:59:04.434387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 870/1745] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:04 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:04.437932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8d6815fa-36c5-4a0e-a146-79455a042e0d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.221172 Aug 04 04:59:04.438786 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e9ac31e7-23e1-44ca-bac4-4a8bfaf6b2df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:04.439975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e9ac31e7-23e1-44ca-bac4-4a8bfaf6b2df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:04.442798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 876/1746] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:04 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:04.449492 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e9ac31e7-23e1-44ca-bac4-4a8bfaf6b2df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:04.450010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e9ac31e7-23e1-44ca-bac4-4a8bfaf6b2df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:04.450790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e9ac31e7-23e1-44ca-bac4-4a8bfaf6b2df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:04.451232 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e9ac31e7-23e1-44ca-bac4-4a8bfaf6b2df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:04.512736 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e9ac31e7-23e1-44ca-bac4-4a8bfaf6b2df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:04.522128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e9ac31e7-23e1-44ca-bac4-4a8bfaf6b2df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086784 Aug 04 04:59:04.522713 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 871/1747] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:04 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:05.456779 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-57b93634-2031-49e4-b9b2-095fcd7c00ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:05.457421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-57b93634-2031-49e4-b9b2-095fcd7c00ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:05.463459 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1c362cd1-f475-40bf-847d-5dd4446f8a28 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:05.464067 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1c362cd1-f475-40bf-847d-5dd4446f8a28 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:05.464306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-57b93634-2031-49e4-b9b2-095fcd7c00ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:05.464760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-57b93634-2031-49e4-b9b2-095fcd7c00ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:05.465635 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-57b93634-2031-49e4-b9b2-095fcd7c00ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:05.466075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-57b93634-2031-49e4-b9b2-095fcd7c00ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:05.470436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c362cd1-f475-40bf-847d-5dd4446f8a28 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:05.471165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c362cd1-f475-40bf-847d-5dd4446f8a28 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:05.471937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c362cd1-f475-40bf-847d-5dd4446f8a28 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:05.472372 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c362cd1-f475-40bf-847d-5dd4446f8a28 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:05.665057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-57b93634-2031-49e4-b9b2-095fcd7c00ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:05.667895 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1c362cd1-f475-40bf-847d-5dd4446f8a28 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:05.673398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-57b93634-2031-49e4-b9b2-095fcd7c00ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.221144 Aug 04 04:59:05.674498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 877/1748] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:05 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:05.676880 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1c362cd1-f475-40bf-847d-5dd4446f8a28 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.217182 Aug 04 04:59:05.677628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 872/1749] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:05 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:05.679261 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3d0cf355-c180-4136-b4fd-7e240722e72a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:05.679878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3d0cf355-c180-4136-b4fd-7e240722e72a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:05.685597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3d0cf355-c180-4136-b4fd-7e240722e72a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:05.686058 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3d0cf355-c180-4136-b4fd-7e240722e72a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:05.686825 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3d0cf355-c180-4136-b4fd-7e240722e72a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:05.687267 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3d0cf355-c180-4136-b4fd-7e240722e72a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:05.747781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3d0cf355-c180-4136-b4fd-7e240722e72a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:05.756562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3d0cf355-c180-4136-b4fd-7e240722e72a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080903 Aug 04 04:59:05.757128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 878/1750] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:05 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:06.696208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bca3b8d8-8b94-4a0a-9505-8ee65d78ca85 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:06.696821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-bca3b8d8-8b94-4a0a-9505-8ee65d78ca85 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:06.698603 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-81086a2b-7c04-4a78-aa00-f9f62f64727a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:06.699227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-81086a2b-7c04-4a78-aa00-f9f62f64727a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:06.704528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bca3b8d8-8b94-4a0a-9505-8ee65d78ca85 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:06.705601 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bca3b8d8-8b94-4a0a-9505-8ee65d78ca85 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:06.706487 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-81086a2b-7c04-4a78-aa00-f9f62f64727a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:06.706633 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bca3b8d8-8b94-4a0a-9505-8ee65d78ca85 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:06.706941 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-81086a2b-7c04-4a78-aa00-f9f62f64727a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:06.707068 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bca3b8d8-8b94-4a0a-9505-8ee65d78ca85 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:06.707719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-81086a2b-7c04-4a78-aa00-f9f62f64727a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:06.708157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-81086a2b-7c04-4a78-aa00-f9f62f64727a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:06.904678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-bca3b8d8-8b94-4a0a-9505-8ee65d78ca85 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:06.908762 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-81086a2b-7c04-4a78-aa00-f9f62f64727a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:06.914052 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-bca3b8d8-8b94-4a0a-9505-8ee65d78ca85 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.221660 Aug 04 04:59:06.914769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 873/1751] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:06 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:06.917406 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-81086a2b-7c04-4a78-aa00-f9f62f64727a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.222783 Aug 04 04:59:06.918173 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 879/1752] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:06 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:06.919091 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cc015813-8a55-40d1-9513-e36b1f894ed3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:06.919691 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cc015813-8a55-40d1-9513-e36b1f894ed3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:06.925871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cc015813-8a55-40d1-9513-e36b1f894ed3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:06.926319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cc015813-8a55-40d1-9513-e36b1f894ed3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:06.927075 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cc015813-8a55-40d1-9513-e36b1f894ed3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:06.927508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cc015813-8a55-40d1-9513-e36b1f894ed3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:06.987471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-cc015813-8a55-40d1-9513-e36b1f894ed3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:06.995260 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cc015813-8a55-40d1-9513-e36b1f894ed3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.079704 Aug 04 04:59:06.995817 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 874/1753] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:06 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:07.937570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-21e8b1f0-dc4d-4403-b186-c1eab18576e4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:07.938110 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-194f76d1-9cb5-4274-b19b-0e18d4b3346f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:07.938486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-21e8b1f0-dc4d-4403-b186-c1eab18576e4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:07.938723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-194f76d1-9cb5-4274-b19b-0e18d4b3346f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:07.944817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21e8b1f0-dc4d-4403-b186-c1eab18576e4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:07.945264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21e8b1f0-dc4d-4403-b186-c1eab18576e4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:07.945392 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-194f76d1-9cb5-4274-b19b-0e18d4b3346f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:07.945799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-194f76d1-9cb5-4274-b19b-0e18d4b3346f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:07.946069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21e8b1f0-dc4d-4403-b186-c1eab18576e4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:07.946506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21e8b1f0-dc4d-4403-b186-c1eab18576e4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:07.946624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-194f76d1-9cb5-4274-b19b-0e18d4b3346f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:07.946978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-194f76d1-9cb5-4274-b19b-0e18d4b3346f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:08.145164 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-21e8b1f0-dc4d-4403-b186-c1eab18576e4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:08.148627 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-194f76d1-9cb5-4274-b19b-0e18d4b3346f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:08.153331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-21e8b1f0-dc4d-4403-b186-c1eab18576e4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.219593 Aug 04 04:59:08.153950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 880/1754] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:07 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:08.156763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-194f76d1-9cb5-4274-b19b-0e18d4b3346f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.222320 Aug 04 04:59:08.161636 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 875/1755] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:07 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:08.161803 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b4b126dc-5a6f-41f9-856d-6a53ca4f2c5d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:08.161803 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b4b126dc-5a6f-41f9-856d-6a53ca4f2c5d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:08.165845 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b4b126dc-5a6f-41f9-856d-6a53ca4f2c5d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:08.166258 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b4b126dc-5a6f-41f9-856d-6a53ca4f2c5d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:08.167030 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b4b126dc-5a6f-41f9-856d-6a53ca4f2c5d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:08.167474 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b4b126dc-5a6f-41f9-856d-6a53ca4f2c5d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:08.231366 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b4b126dc-5a6f-41f9-856d-6a53ca4f2c5d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:08.240084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b4b126dc-5a6f-41f9-856d-6a53ca4f2c5d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085182 Aug 04 04:59:08.240649 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 881/1756] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:09.176067 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c50fe972-112b-4d7b-80ca-7eff8a9324e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:09.176675 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c50fe972-112b-4d7b-80ca-7eff8a9324e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:09.178889 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c0c25c4e-9277-43e3-8dae-3391741ee98f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:09.179509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c0c25c4e-9277-43e3-8dae-3391741ee98f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:09.186907 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c50fe972-112b-4d7b-80ca-7eff8a9324e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:09.187363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c50fe972-112b-4d7b-80ca-7eff8a9324e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:09.187492 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c0c25c4e-9277-43e3-8dae-3391741ee98f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:09.187820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c0c25c4e-9277-43e3-8dae-3391741ee98f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:09.188154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c50fe972-112b-4d7b-80ca-7eff8a9324e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:09.188599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c50fe972-112b-4d7b-80ca-7eff8a9324e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:09.189192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c0c25c4e-9277-43e3-8dae-3391741ee98f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:09.190326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c0c25c4e-9277-43e3-8dae-3391741ee98f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:09.194772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:09.384230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c50fe972-112b-4d7b-80ca-7eff8a9324e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:09.392818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c50fe972-112b-4d7b-80ca-7eff8a9324e2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.221057 Aug 04 04:59:09.393001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c0c25c4e-9277-43e3-8dae-3391741ee98f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:09.393671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 876/1757] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:09 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:09.397988 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e3053581-9f33-4154-bd05-1df9fa17652c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:09.398597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e3053581-9f33-4154-bd05-1df9fa17652c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:09.401158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c0c25c4e-9277-43e3-8dae-3391741ee98f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.226372 Aug 04 04:59:09.401904 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 882/1758] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:09 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:09.404677 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e3053581-9f33-4154-bd05-1df9fa17652c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:09.405135 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e3053581-9f33-4154-bd05-1df9fa17652c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:09.405931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e3053581-9f33-4154-bd05-1df9fa17652c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:09.406379 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e3053581-9f33-4154-bd05-1df9fa17652c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:09.468238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e3053581-9f33-4154-bd05-1df9fa17652c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:09.476324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e3053581-9f33-4154-bd05-1df9fa17652c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081958 Aug 04 04:59:09.476888 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 877/1759] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:09 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:10.414685 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a91012c8-24ab-4bea-ac68-6eb3ec37ccec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:10.415300 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a91012c8-24ab-4bea-ac68-6eb3ec37ccec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:10.422270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ad592600-a5db-402d-81d1-d58bbfecb048 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:10.422773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a91012c8-24ab-4bea-ac68-6eb3ec37ccec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:10.422900 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ad592600-a5db-402d-81d1-d58bbfecb048 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:10.423009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a91012c8-24ab-4bea-ac68-6eb3ec37ccec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:10.423754 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a91012c8-24ab-4bea-ac68-6eb3ec37ccec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:10.424394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a91012c8-24ab-4bea-ac68-6eb3ec37ccec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:10.429680 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad592600-a5db-402d-81d1-d58bbfecb048 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:10.430130 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad592600-a5db-402d-81d1-d58bbfecb048 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:10.430895 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad592600-a5db-402d-81d1-d58bbfecb048 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:10.431330 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ad592600-a5db-402d-81d1-d58bbfecb048 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:10.622649 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a91012c8-24ab-4bea-ac68-6eb3ec37ccec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:10.625375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ad592600-a5db-402d-81d1-d58bbfecb048 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:10.630897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a91012c8-24ab-4bea-ac68-6eb3ec37ccec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.220035 Aug 04 04:59:10.631708 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 883/1760] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:10 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:10.633271 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ad592600-a5db-402d-81d1-d58bbfecb048 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.214993 Aug 04 04:59:10.640910 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 878/1761] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:10 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:10.641081 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9bf60634-affc-4457-ba86-6fe006848ade tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:10.641081 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9bf60634-affc-4457-ba86-6fe006848ade tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:10.642624 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9bf60634-affc-4457-ba86-6fe006848ade tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:10.643077 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9bf60634-affc-4457-ba86-6fe006848ade tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:10.643982 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9bf60634-affc-4457-ba86-6fe006848ade tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:10.644424 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9bf60634-affc-4457-ba86-6fe006848ade tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:10.707968 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9bf60634-affc-4457-ba86-6fe006848ade tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:10.715874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9bf60634-affc-4457-ba86-6fe006848ade tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083388 Aug 04 04:59:10.716433 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 884/1762] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:11.651399 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1d303e20-af82-48ac-9d7e-86a824f9abf0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:11.652002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1d303e20-af82-48ac-9d7e-86a824f9abf0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:11.654248 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8b221ef4-ee61-4485-ab65-685a64edb39f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:11.654875 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8b221ef4-ee61-4485-ab65-685a64edb39f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:11.659297 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d303e20-af82-48ac-9d7e-86a824f9abf0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:11.659931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d303e20-af82-48ac-9d7e-86a824f9abf0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:11.660698 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d303e20-af82-48ac-9d7e-86a824f9abf0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:11.661132 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1d303e20-af82-48ac-9d7e-86a824f9abf0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:11.662524 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b221ef4-ee61-4485-ab65-685a64edb39f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:11.662981 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b221ef4-ee61-4485-ab65-685a64edb39f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:11.663746 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b221ef4-ee61-4485-ab65-685a64edb39f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:11.664183 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b221ef4-ee61-4485-ab65-685a64edb39f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:11.859043 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1d303e20-af82-48ac-9d7e-86a824f9abf0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:11.863066 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8b221ef4-ee61-4485-ab65-685a64edb39f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:11.867102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1d303e20-af82-48ac-9d7e-86a824f9abf0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.219488 Aug 04 04:59:11.867676 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 879/1763] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:11 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:11.870925 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8b221ef4-ee61-4485-ab65-685a64edb39f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.220587 Aug 04 04:59:11.871645 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 885/1764] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:11 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:11.872042 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6f74e9f0-76c5-4370-8e14-09f61aeaa8de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:11.872646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6f74e9f0-76c5-4370-8e14-09f61aeaa8de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:11.879460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f74e9f0-76c5-4370-8e14-09f61aeaa8de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:11.879914 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f74e9f0-76c5-4370-8e14-09f61aeaa8de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:11.880679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f74e9f0-76c5-4370-8e14-09f61aeaa8de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:11.881185 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f74e9f0-76c5-4370-8e14-09f61aeaa8de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:11.942189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6f74e9f0-76c5-4370-8e14-09f61aeaa8de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:11.950059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6f74e9f0-76c5-4370-8e14-09f61aeaa8de tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081451 Aug 04 04:59:11.950619 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 880/1765] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:11 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:12.888417 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4896e301-e2d8-40f6-9217-e7a50a2cd4bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:12.888940 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4896e301-e2d8-40f6-9217-e7a50a2cd4bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:12.891484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-709f1649-a1c4-4f13-ba88-fdcdd6fc8a8d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:12.892201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-709f1649-a1c4-4f13-ba88-fdcdd6fc8a8d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:12.895988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4896e301-e2d8-40f6-9217-e7a50a2cd4bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:12.896441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4896e301-e2d8-40f6-9217-e7a50a2cd4bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:12.897204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4896e301-e2d8-40f6-9217-e7a50a2cd4bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:12.897659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4896e301-e2d8-40f6-9217-e7a50a2cd4bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:12.899507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-709f1649-a1c4-4f13-ba88-fdcdd6fc8a8d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:12.899832 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-709f1649-a1c4-4f13-ba88-fdcdd6fc8a8d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:12.900608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-709f1649-a1c4-4f13-ba88-fdcdd6fc8a8d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:12.901048 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-709f1649-a1c4-4f13-ba88-fdcdd6fc8a8d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:13.097462 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4896e301-e2d8-40f6-9217-e7a50a2cd4bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:13.100512 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-709f1649-a1c4-4f13-ba88-fdcdd6fc8a8d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:13.105400 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4896e301-e2d8-40f6-9217-e7a50a2cd4bd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.220886 Aug 04 04:59:13.105998 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 886/1766] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:12 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:13.108578 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-709f1649-a1c4-4f13-ba88-fdcdd6fc8a8d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.221045 Aug 04 04:59:13.109290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 881/1767] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:13.110365 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-503b1a7e-9016-4b59-aa00-aafb0620b17f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:13.110974 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-503b1a7e-9016-4b59-aa00-aafb0620b17f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:13.117144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-503b1a7e-9016-4b59-aa00-aafb0620b17f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:13.117613 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-503b1a7e-9016-4b59-aa00-aafb0620b17f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:13.118370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-503b1a7e-9016-4b59-aa00-aafb0620b17f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:13.118801 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-503b1a7e-9016-4b59-aa00-aafb0620b17f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:13.180395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-503b1a7e-9016-4b59-aa00-aafb0620b17f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:13.188251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-503b1a7e-9016-4b59-aa00-aafb0620b17f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081318 Aug 04 04:59:13.188818 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 887/1768] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:13 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:14.127059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8ee52ca7-1df7-45e7-bdba-85bcd3e8618a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:14.127824 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8ee52ca7-1df7-45e7-bdba-85bcd3e8618a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:14.128920 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f022ab0d-bdc8-40d1-8956-60f2180272d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:14.129561 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f022ab0d-bdc8-40d1-8956-60f2180272d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:14.134390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8ee52ca7-1df7-45e7-bdba-85bcd3e8618a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:14.134920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8ee52ca7-1df7-45e7-bdba-85bcd3e8618a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:14.135721 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8ee52ca7-1df7-45e7-bdba-85bcd3e8618a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:14.136024 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f022ab0d-bdc8-40d1-8956-60f2180272d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:14.136159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8ee52ca7-1df7-45e7-bdba-85bcd3e8618a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:14.136472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f022ab0d-bdc8-40d1-8956-60f2180272d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:14.137229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f022ab0d-bdc8-40d1-8956-60f2180272d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:14.137687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f022ab0d-bdc8-40d1-8956-60f2180272d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:14.333911 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8ee52ca7-1df7-45e7-bdba-85bcd3e8618a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:14.338723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f022ab0d-bdc8-40d1-8956-60f2180272d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:14.342881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8ee52ca7-1df7-45e7-bdba-85bcd3e8618a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.219818 Aug 04 04:59:14.343466 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 882/1769] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:14 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:14.347216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f022ab0d-bdc8-40d1-8956-60f2180272d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.222233 Aug 04 04:59:14.347957 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 888/1770] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:14 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:14.348080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1235b634-e7df-4e71-974a-d94a0c98d881 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:14.348701 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1235b634-e7df-4e71-974a-d94a0c98d881 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:14.355306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1235b634-e7df-4e71-974a-d94a0c98d881 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:14.355850 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1235b634-e7df-4e71-974a-d94a0c98d881 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:14.356696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1235b634-e7df-4e71-974a-d94a0c98d881 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:14.357148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1235b634-e7df-4e71-974a-d94a0c98d881 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:14.426233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1235b634-e7df-4e71-974a-d94a0c98d881 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:14.434200 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1235b634-e7df-4e71-974a-d94a0c98d881 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.089801 Aug 04 04:59:14.434755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 883/1771] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:14 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:15.363398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3241b18c-8f9f-41a7-a8f1-b1cd0728b48d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:15.364018 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3241b18c-8f9f-41a7-a8f1-b1cd0728b48d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:15.368029 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9aaaecda-e5ac-42e4-b33c-8f26dfea5607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:15.368635 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9aaaecda-e5ac-42e4-b33c-8f26dfea5607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:15.370587 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3241b18c-8f9f-41a7-a8f1-b1cd0728b48d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:15.371041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3241b18c-8f9f-41a7-a8f1-b1cd0728b48d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:15.371830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3241b18c-8f9f-41a7-a8f1-b1cd0728b48d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:15.372270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3241b18c-8f9f-41a7-a8f1-b1cd0728b48d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:15.375094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9aaaecda-e5ac-42e4-b33c-8f26dfea5607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:15.375559 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9aaaecda-e5ac-42e4-b33c-8f26dfea5607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:15.376320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9aaaecda-e5ac-42e4-b33c-8f26dfea5607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:15.376807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9aaaecda-e5ac-42e4-b33c-8f26dfea5607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:15.379478 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:15.568889 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3241b18c-8f9f-41a7-a8f1-b1cd0728b48d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:15.571821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9aaaecda-e5ac-42e4-b33c-8f26dfea5607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:15.576964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3241b18c-8f9f-41a7-a8f1-b1cd0728b48d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.217555 Aug 04 04:59:15.577560 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 889/1772] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:15 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:15.579755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9aaaecda-e5ac-42e4-b33c-8f26dfea5607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215517 Aug 04 04:59:15.581213 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 884/1773] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:15 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:15.582691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f1d17c16-08b5-4db4-89ef-2badf93053e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:15.583319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f1d17c16-08b5-4db4-89ef-2badf93053e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:15.589141 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1d17c16-08b5-4db4-89ef-2badf93053e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:15.589622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1d17c16-08b5-4db4-89ef-2badf93053e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:15.590383 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1d17c16-08b5-4db4-89ef-2badf93053e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:15.590819 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1d17c16-08b5-4db4-89ef-2badf93053e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:15.654249 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f1d17c16-08b5-4db4-89ef-2badf93053e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:15.662896 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f1d17c16-08b5-4db4-89ef-2badf93053e9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084391 Aug 04 04:59:15.663458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 890/1774] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:15 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:16.600377 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a7f2e226-be8e-4ced-8951-7184edde2e47 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:16.600927 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a7f2e226-be8e-4ced-8951-7184edde2e47 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:16.602449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-043ec4e3-bfa7-4876-a215-d5dd743584d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:16.603069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-043ec4e3-bfa7-4876-a215-d5dd743584d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:16.608055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a7f2e226-be8e-4ced-8951-7184edde2e47 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:16.608733 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a7f2e226-be8e-4ced-8951-7184edde2e47 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.609498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a7f2e226-be8e-4ced-8951-7184edde2e47 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:16.609634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-043ec4e3-bfa7-4876-a215-d5dd743584d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:16.609967 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a7f2e226-be8e-4ced-8951-7184edde2e47 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.610112 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-043ec4e3-bfa7-4876-a215-d5dd743584d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.610781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-043ec4e3-bfa7-4876-a215-d5dd743584d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:16.611900 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-043ec4e3-bfa7-4876-a215-d5dd743584d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.809251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a7f2e226-be8e-4ced-8951-7184edde2e47 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:16.812298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-043ec4e3-bfa7-4876-a215-d5dd743584d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:16.817195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a7f2e226-be8e-4ced-8951-7184edde2e47 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.220759 Aug 04 04:59:16.817783 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 885/1775] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:16 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:16.822220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c5c4db75-ff60-44b8-a7a8-6a36bb6bb3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:16.823044 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c5c4db75-ff60-44b8-a7a8-6a36bb6bb3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:16.825758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-043ec4e3-bfa7-4876-a215-d5dd743584d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.226794 Aug 04 04:59:16.826231 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 891/1776] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:16.829023 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c5c4db75-ff60-44b8-a7a8-6a36bb6bb3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:16.829468 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c5c4db75-ff60-44b8-a7a8-6a36bb6bb3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.830995 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c5c4db75-ff60-44b8-a7a8-6a36bb6bb3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:16.831578 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c5c4db75-ff60-44b8-a7a8-6a36bb6bb3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:16.891172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c5c4db75-ff60-44b8-a7a8-6a36bb6bb3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:16.899617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c5c4db75-ff60-44b8-a7a8-6a36bb6bb3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080903 Aug 04 04:59:16.900178 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 886/1777] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:16 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:17.838840 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a4bf985c-1f7d-467b-82f9-6d362bc3789b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:17.839508 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a4bf985c-1f7d-467b-82f9-6d362bc3789b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:17.848111 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c89538bf-7467-4b60-8e9f-2299a86d633e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:17.849088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c89538bf-7467-4b60-8e9f-2299a86d633e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:17.849921 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4bf985c-1f7d-467b-82f9-6d362bc3789b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:17.850376 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4bf985c-1f7d-467b-82f9-6d362bc3789b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:17.851151 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4bf985c-1f7d-467b-82f9-6d362bc3789b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:17.851588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4bf985c-1f7d-467b-82f9-6d362bc3789b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:17.855324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c89538bf-7467-4b60-8e9f-2299a86d633e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:17.855781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c89538bf-7467-4b60-8e9f-2299a86d633e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:17.856549 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c89538bf-7467-4b60-8e9f-2299a86d633e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:17.856996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c89538bf-7467-4b60-8e9f-2299a86d633e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:18.068421 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c89538bf-7467-4b60-8e9f-2299a86d633e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:18.075998 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a4bf985c-1f7d-467b-82f9-6d362bc3789b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:18.078891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c89538bf-7467-4b60-8e9f-2299a86d633e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.235161 Aug 04 04:59:18.083223 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 887/1778] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:17 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:18.086522 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a4bf985c-1f7d-467b-82f9-6d362bc3789b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.251473 Aug 04 04:59:18.087105 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 892/1779] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:17 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:18.087946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-81f75b32-b0be-44c8-b438-7ebbe6ccf715 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:18.088590 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-81f75b32-b0be-44c8-b438-7ebbe6ccf715 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:18.095123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81f75b32-b0be-44c8-b438-7ebbe6ccf715 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:18.095556 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81f75b32-b0be-44c8-b438-7ebbe6ccf715 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:18.096459 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81f75b32-b0be-44c8-b438-7ebbe6ccf715 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:18.097003 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81f75b32-b0be-44c8-b438-7ebbe6ccf715 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:18.166069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-81f75b32-b0be-44c8-b438-7ebbe6ccf715 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:18.174557 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-81f75b32-b0be-44c8-b438-7ebbe6ccf715 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.092632 Aug 04 04:59:18.175127 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 888/1780] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:18 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:19.102863 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e5637992-7c1a-4f40-bc8e-8540fb498b35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:19.103481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e5637992-7c1a-4f40-bc8e-8540fb498b35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:19.110121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5637992-7c1a-4f40-bc8e-8540fb498b35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:19.110573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5637992-7c1a-4f40-bc8e-8540fb498b35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:19.111373 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5637992-7c1a-4f40-bc8e-8540fb498b35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:19.111807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5637992-7c1a-4f40-bc8e-8540fb498b35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:19.112133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a51487fe-9935-4938-98c9-e60020126fc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:19.112757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a51487fe-9935-4938-98c9-e60020126fc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:19.119226 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a51487fe-9935-4938-98c9-e60020126fc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:19.119698 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a51487fe-9935-4938-98c9-e60020126fc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:19.120463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a51487fe-9935-4938-98c9-e60020126fc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:19.120904 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a51487fe-9935-4938-98c9-e60020126fc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:19.311304 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e5637992-7c1a-4f40-bc8e-8540fb498b35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:19.315667 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a51487fe-9935-4938-98c9-e60020126fc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:19.319436 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e5637992-7c1a-4f40-bc8e-8540fb498b35 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.220428 Aug 04 04:59:19.320014 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 893/1781] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:19.323658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a51487fe-9935-4938-98c9-e60020126fc5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.215850 Aug 04 04:59:19.332579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 889/1782] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:19 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:19.332765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8a4bff2f-681e-4068-8332-249eed6d6be2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:19.332765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8a4bff2f-681e-4068-8332-249eed6d6be2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:19.332765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a4bff2f-681e-4068-8332-249eed6d6be2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:19.332765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a4bff2f-681e-4068-8332-249eed6d6be2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:19.333514 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a4bff2f-681e-4068-8332-249eed6d6be2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:19.334012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8a4bff2f-681e-4068-8332-249eed6d6be2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:19.394502 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8a4bff2f-681e-4068-8332-249eed6d6be2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:19.402338 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8a4bff2f-681e-4068-8332-249eed6d6be2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081377 Aug 04 04:59:19.402900 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 894/1783] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:19 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:20.342118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0ad16767-a70d-4469-abdf-663d91fe1572 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:20.342721 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0ad16767-a70d-4469-abdf-663d91fe1572 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:20.344727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-af815dfe-2fc0-4ff0-b0cc-63e44ad2c096 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:20.346068 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-af815dfe-2fc0-4ff0-b0cc-63e44ad2c096 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:20.349858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ad16767-a70d-4469-abdf-663d91fe1572 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:20.350309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ad16767-a70d-4469-abdf-663d91fe1572 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:20.351082 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ad16767-a70d-4469-abdf-663d91fe1572 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:20.351516 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ad16767-a70d-4469-abdf-663d91fe1572 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:20.352725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af815dfe-2fc0-4ff0-b0cc-63e44ad2c096 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:20.353177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af815dfe-2fc0-4ff0-b0cc-63e44ad2c096 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:20.353971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af815dfe-2fc0-4ff0-b0cc-63e44ad2c096 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:20.354407 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af815dfe-2fc0-4ff0-b0cc-63e44ad2c096 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:20.545660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0ad16767-a70d-4469-abdf-663d91fe1572 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:20.550503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-af815dfe-2fc0-4ff0-b0cc-63e44ad2c096 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:20.554197 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0ad16767-a70d-4469-abdf-663d91fe1572 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215875 Aug 04 04:59:20.554765 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 890/1784] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:20.558693 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-af815dfe-2fc0-4ff0-b0cc-63e44ad2c096 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.217699 Aug 04 04:59:20.559183 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-aec54eef-eb71-426d-b661-f00ce96a92c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:20.559815 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-aec54eef-eb71-426d-b661-f00ce96a92c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:20.565830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aec54eef-eb71-426d-b661-f00ce96a92c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:20.566280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aec54eef-eb71-426d-b661-f00ce96a92c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:20.567040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aec54eef-eb71-426d-b661-f00ce96a92c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:20.567478 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aec54eef-eb71-426d-b661-f00ce96a92c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:20.568152 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 895/1785] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:20 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:20.630080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-aec54eef-eb71-426d-b661-f00ce96a92c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:20.638031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-aec54eef-eb71-426d-b661-f00ce96a92c9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082320 Aug 04 04:59:20.638589 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 891/1786] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:20 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:21.574526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bc3700f8-179a-49ec-98f3-e63563fb2a7c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:21.575260 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bc3700f8-179a-49ec-98f3-e63563fb2a7c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:21.580328 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e22897df-7d1b-4f56-bfc2-8e4e0eee95d6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:21.580899 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e22897df-7d1b-4f56-bfc2-8e4e0eee95d6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:21.581886 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc3700f8-179a-49ec-98f3-e63563fb2a7c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:21.582347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc3700f8-179a-49ec-98f3-e63563fb2a7c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:21.583127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc3700f8-179a-49ec-98f3-e63563fb2a7c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:21.583567 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc3700f8-179a-49ec-98f3-e63563fb2a7c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:21.587298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e22897df-7d1b-4f56-bfc2-8e4e0eee95d6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:21.587753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e22897df-7d1b-4f56-bfc2-8e4e0eee95d6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:21.588521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e22897df-7d1b-4f56-bfc2-8e4e0eee95d6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:21.588957 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e22897df-7d1b-4f56-bfc2-8e4e0eee95d6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:21.778323 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bc3700f8-179a-49ec-98f3-e63563fb2a7c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:21.785471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e22897df-7d1b-4f56-bfc2-8e4e0eee95d6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:21.787297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bc3700f8-179a-49ec-98f3-e63563fb2a7c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.216609 Aug 04 04:59:21.787885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 896/1787] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:21 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:21.792444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7d965e93-0d23-4213-8cd4-bcee1033bcf6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:21.793053 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7d965e93-0d23-4213-8cd4-bcee1033bcf6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:21.793576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e22897df-7d1b-4f56-bfc2-8e4e0eee95d6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.217369 Aug 04 04:59:21.794312 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 892/1788] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:21 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:21.800003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d965e93-0d23-4213-8cd4-bcee1033bcf6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:21.800525 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d965e93-0d23-4213-8cd4-bcee1033bcf6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:21.801206 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d965e93-0d23-4213-8cd4-bcee1033bcf6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:21.801668 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d965e93-0d23-4213-8cd4-bcee1033bcf6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:21.866107 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7d965e93-0d23-4213-8cd4-bcee1033bcf6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:21.874024 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7d965e93-0d23-4213-8cd4-bcee1033bcf6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085195 Aug 04 04:59:21.874580 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 897/1789] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:21 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:22.809351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0c851c7d-6399-4600-8d51-dbfb2699b42e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:22.809993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0c851c7d-6399-4600-8d51-dbfb2699b42e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:22.814612 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-de56e3d9-0131-4bbf-8740-121b073155fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:22.815245 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-de56e3d9-0131-4bbf-8740-121b073155fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:22.816795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c851c7d-6399-4600-8d51-dbfb2699b42e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:22.817256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c851c7d-6399-4600-8d51-dbfb2699b42e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:22.818059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c851c7d-6399-4600-8d51-dbfb2699b42e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:22.818504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c851c7d-6399-4600-8d51-dbfb2699b42e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:22.821676 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de56e3d9-0131-4bbf-8740-121b073155fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:22.822141 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de56e3d9-0131-4bbf-8740-121b073155fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:22.822916 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de56e3d9-0131-4bbf-8740-121b073155fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:22.823358 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-de56e3d9-0131-4bbf-8740-121b073155fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:23.014363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0c851c7d-6399-4600-8d51-dbfb2699b42e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:23.022073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-de56e3d9-0131-4bbf-8740-121b073155fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:23.022860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0c851c7d-6399-4600-8d51-dbfb2699b42e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.217407 Aug 04 04:59:23.023439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 893/1790] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:22 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:23.024277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:23.028388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2832f5e4-af7d-4cf2-99ab-70539dacfc76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:23.028999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2832f5e4-af7d-4cf2-99ab-70539dacfc76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:23.031632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-de56e3d9-0131-4bbf-8740-121b073155fb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.221056 Aug 04 04:59:23.032199 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 898/1791] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:22 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:23.035738 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2832f5e4-af7d-4cf2-99ab-70539dacfc76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:23.036254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2832f5e4-af7d-4cf2-99ab-70539dacfc76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:23.037086 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2832f5e4-af7d-4cf2-99ab-70539dacfc76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:23.037634 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2832f5e4-af7d-4cf2-99ab-70539dacfc76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:23.098325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2832f5e4-af7d-4cf2-99ab-70539dacfc76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:23.106116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2832f5e4-af7d-4cf2-99ab-70539dacfc76 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081728 Aug 04 04:59:23.106677 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 894/1792] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:23 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:24.044793 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b50a36d2-cfe1-46f9-8d60-e4d52d6ac0c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:24.045575 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b50a36d2-cfe1-46f9-8d60-e4d52d6ac0c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:24.052738 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b50a36d2-cfe1-46f9-8d60-e4d52d6ac0c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:24.053188 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b50a36d2-cfe1-46f9-8d60-e4d52d6ac0c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:24.053324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5e87ce57-6bf1-4569-9f4c-f4b46e874455 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:24.053933 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5e87ce57-6bf1-4569-9f4c-f4b46e874455 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:24.054061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b50a36d2-cfe1-46f9-8d60-e4d52d6ac0c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:24.054406 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b50a36d2-cfe1-46f9-8d60-e4d52d6ac0c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:24.060510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5e87ce57-6bf1-4569-9f4c-f4b46e874455 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:24.060968 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5e87ce57-6bf1-4569-9f4c-f4b46e874455 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:24.061769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5e87ce57-6bf1-4569-9f4c-f4b46e874455 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:24.062210 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5e87ce57-6bf1-4569-9f4c-f4b46e874455 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:24.250186 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b50a36d2-cfe1-46f9-8d60-e4d52d6ac0c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:24.254489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5e87ce57-6bf1-4569-9f4c-f4b46e874455 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:24.258516 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b50a36d2-cfe1-46f9-8d60-e4d52d6ac0c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.217531 Aug 04 04:59:24.259090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 899/1793] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:24 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:24.262328 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5e87ce57-6bf1-4569-9f4c-f4b46e874455 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.212797 Aug 04 04:59:24.262880 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 895/1794] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:24 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:24.263481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5278c25e-e432-4509-aa3b-fa0c8de7426c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:24.264081 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5278c25e-e432-4509-aa3b-fa0c8de7426c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:24.270139 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5278c25e-e432-4509-aa3b-fa0c8de7426c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:24.270583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5278c25e-e432-4509-aa3b-fa0c8de7426c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:24.271365 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5278c25e-e432-4509-aa3b-fa0c8de7426c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:24.271767 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5278c25e-e432-4509-aa3b-fa0c8de7426c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:24.332565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5278c25e-e432-4509-aa3b-fa0c8de7426c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:24.340443 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5278c25e-e432-4509-aa3b-fa0c8de7426c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080424 Aug 04 04:59:24.340997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 900/1795] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:24 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:25.279838 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0c202287-b345-45e0-b831-6d609bf5f5e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:25.280433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0c202287-b345-45e0-b831-6d609bf5f5e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:25.283242 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-51838f08-4402-4e62-b21c-fb288e8a2d41 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:25.283907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-51838f08-4402-4e62-b21c-fb288e8a2d41 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:25.287003 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c202287-b345-45e0-b831-6d609bf5f5e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:25.287449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c202287-b345-45e0-b831-6d609bf5f5e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:25.288201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c202287-b345-45e0-b831-6d609bf5f5e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:25.288632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c202287-b345-45e0-b831-6d609bf5f5e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:25.290659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-51838f08-4402-4e62-b21c-fb288e8a2d41 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:25.291111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-51838f08-4402-4e62-b21c-fb288e8a2d41 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:25.291883 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-51838f08-4402-4e62-b21c-fb288e8a2d41 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:25.292319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-51838f08-4402-4e62-b21c-fb288e8a2d41 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:25.489830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0c202287-b345-45e0-b831-6d609bf5f5e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:25.493112 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-51838f08-4402-4e62-b21c-fb288e8a2d41 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:25.498056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0c202287-b345-45e0-b831-6d609bf5f5e7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.221982 Aug 04 04:59:25.498633 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 896/1796] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:25 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:25.502813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-51838f08-4402-4e62-b21c-fb288e8a2d41 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.221860 Aug 04 04:59:25.503226 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5a9d7d02-1037-4283-a273-ffdb611b9c7b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:25.503776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5a9d7d02-1037-4283-a273-ffdb611b9c7b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:25.509834 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5a9d7d02-1037-4283-a273-ffdb611b9c7b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:25.510292 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5a9d7d02-1037-4283-a273-ffdb611b9c7b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:25.512002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5a9d7d02-1037-4283-a273-ffdb611b9c7b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:25.512002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5a9d7d02-1037-4283-a273-ffdb611b9c7b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:25.512793 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 901/1797] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:25 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:25.575428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5a9d7d02-1037-4283-a273-ffdb611b9c7b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:25.584166 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5a9d7d02-1037-4283-a273-ffdb611b9c7b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084588 Aug 04 04:59:25.584730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 897/1798] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:25 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:26.520659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-50b96212-93b7-4eaf-9529-3e611f7b0792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:26.521276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-50b96212-93b7-4eaf-9529-3e611f7b0792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:26.524118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b740cb57-9681-4602-8bb6-7541cda49e8f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:26.524785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b740cb57-9681-4602-8bb6-7541cda49e8f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:26.528194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-50b96212-93b7-4eaf-9529-3e611f7b0792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.528699 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-50b96212-93b7-4eaf-9529-3e611f7b0792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.529499 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-50b96212-93b7-4eaf-9529-3e611f7b0792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.529955 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-50b96212-93b7-4eaf-9529-3e611f7b0792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.531248 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b740cb57-9681-4602-8bb6-7541cda49e8f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.531691 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b740cb57-9681-4602-8bb6-7541cda49e8f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.532475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b740cb57-9681-4602-8bb6-7541cda49e8f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.533737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b740cb57-9681-4602-8bb6-7541cda49e8f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.728225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-50b96212-93b7-4eaf-9529-3e611f7b0792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:26.735883 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b740cb57-9681-4602-8bb6-7541cda49e8f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:26.737836 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-50b96212-93b7-4eaf-9529-3e611f7b0792 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.221992 Aug 04 04:59:26.738417 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 902/1799] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:26 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:26.742850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-07a162f7-b5cf-4f14-9185-33f7344e73fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:26.743450 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-07a162f7-b5cf-4f14-9185-33f7344e73fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:26.744398 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b740cb57-9681-4602-8bb6-7541cda49e8f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.224328 Aug 04 04:59:26.745315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 898/1800] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:26 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:26.749311 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-07a162f7-b5cf-4f14-9185-33f7344e73fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.749830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-07a162f7-b5cf-4f14-9185-33f7344e73fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.750618 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-07a162f7-b5cf-4f14-9185-33f7344e73fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:26.751053 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-07a162f7-b5cf-4f14-9185-33f7344e73fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:26.812103 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-07a162f7-b5cf-4f14-9185-33f7344e73fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:26.820079 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-07a162f7-b5cf-4f14-9185-33f7344e73fc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080727 Aug 04 04:59:26.820634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 903/1801] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:26 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:27.760025 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-622969dd-0e3e-48bd-a8b9-4697b4ac9924 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:27.760700 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-622969dd-0e3e-48bd-a8b9-4697b4ac9924 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:27.765165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dc268d3c-14f2-42e5-a673-05384345dc12 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:27.765835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dc268d3c-14f2-42e5-a673-05384345dc12 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:27.767399 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-622969dd-0e3e-48bd-a8b9-4697b4ac9924 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:27.767888 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-622969dd-0e3e-48bd-a8b9-4697b4ac9924 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:27.768292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=74 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:27.768659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-622969dd-0e3e-48bd-a8b9-4697b4ac9924 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:27.769099 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-622969dd-0e3e-48bd-a8b9-4697b4ac9924 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:27.773972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dc268d3c-14f2-42e5-a673-05384345dc12 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:27.774416 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dc268d3c-14f2-42e5-a673-05384345dc12 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:27.775186 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dc268d3c-14f2-42e5-a673-05384345dc12 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:27.775617 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dc268d3c-14f2-42e5-a673-05384345dc12 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:28.203034 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-622969dd-0e3e-48bd-a8b9-4697b4ac9924 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:28.206583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-dc268d3c-14f2-42e5-a673-05384345dc12 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:28.212253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-622969dd-0e3e-48bd-a8b9-4697b4ac9924 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.456158 Aug 04 04:59:28.212824 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 899/1802] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:27 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:28.214396 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dc268d3c-14f2-42e5-a673-05384345dc12 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.452995 Aug 04 04:59:28.215097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 904/1803] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:27 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:28.218024 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b6021284-d51a-4e00-97c6-aed7c0c1a759 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:28.218637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b6021284-d51a-4e00-97c6-aed7c0c1a759 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:28.220936 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=76 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:28.226239 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6021284-d51a-4e00-97c6-aed7c0c1a759 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:28.226700 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6021284-d51a-4e00-97c6-aed7c0c1a759 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:28.227463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6021284-d51a-4e00-97c6-aed7c0c1a759 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:28.227896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6021284-d51a-4e00-97c6-aed7c0c1a759 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:28.288962 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b6021284-d51a-4e00-97c6-aed7c0c1a759 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:28.291143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:28.298091 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b6021284-d51a-4e00-97c6-aed7c0c1a759 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084333 Aug 04 04:59:28.299146 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 900/1804] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:28 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:29.234204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-af33d38e-cf2c-4b4e-af56-90df4384790e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:29.234752 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-af33d38e-cf2c-4b4e-af56-90df4384790e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:29.236201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-43e20937-dee4-48e2-9e00-6e80e5104fd3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:29.236836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-43e20937-dee4-48e2-9e00-6e80e5104fd3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:29.241482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af33d38e-cf2c-4b4e-af56-90df4384790e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:29.242028 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af33d38e-cf2c-4b4e-af56-90df4384790e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:29.242771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af33d38e-cf2c-4b4e-af56-90df4384790e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:29.243206 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af33d38e-cf2c-4b4e-af56-90df4384790e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:29.243385 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-43e20937-dee4-48e2-9e00-6e80e5104fd3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:29.243851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-43e20937-dee4-48e2-9e00-6e80e5104fd3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:29.244609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-43e20937-dee4-48e2-9e00-6e80e5104fd3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:29.245042 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-43e20937-dee4-48e2-9e00-6e80e5104fd3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:29.441713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-af33d38e-cf2c-4b4e-af56-90df4384790e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:29.444871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-43e20937-dee4-48e2-9e00-6e80e5104fd3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:29.449785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-af33d38e-cf2c-4b4e-af56-90df4384790e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.219488 Aug 04 04:59:29.450526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 905/1805] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:29 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:29.452789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-43e20937-dee4-48e2-9e00-6e80e5104fd3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.220608 Aug 04 04:59:29.453462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 901/1806] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:29 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:29.456738 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-02c8bbc9-c43e-4c37-9ac7-9ff5e95ae402 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:29.457355 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-02c8bbc9-c43e-4c37-9ac7-9ff5e95ae402 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:29.463262 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02c8bbc9-c43e-4c37-9ac7-9ff5e95ae402 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:29.463835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02c8bbc9-c43e-4c37-9ac7-9ff5e95ae402 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:29.464607 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02c8bbc9-c43e-4c37-9ac7-9ff5e95ae402 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:29.465042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02c8bbc9-c43e-4c37-9ac7-9ff5e95ae402 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:29.530721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-02c8bbc9-c43e-4c37-9ac7-9ff5e95ae402 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:29.539464 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-02c8bbc9-c43e-4c37-9ac7-9ff5e95ae402 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.087502 Aug 04 04:59:29.540032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 906/1807] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:29 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:30.472390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a1e187d7-256b-4c1f-abd7-4630459ee83c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:30.473008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a1e187d7-256b-4c1f-abd7-4630459ee83c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:30.473397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8d1042ed-d20d-4f03-aab0-02309210fc24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:30.474045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8d1042ed-d20d-4f03-aab0-02309210fc24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:30.479681 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1e187d7-256b-4c1f-abd7-4630459ee83c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:30.480133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1e187d7-256b-4c1f-abd7-4630459ee83c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:30.480455 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d1042ed-d20d-4f03-aab0-02309210fc24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:30.480899 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1e187d7-256b-4c1f-abd7-4630459ee83c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:30.481019 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d1042ed-d20d-4f03-aab0-02309210fc24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:30.481335 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1e187d7-256b-4c1f-abd7-4630459ee83c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:30.481682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d1042ed-d20d-4f03-aab0-02309210fc24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:30.482118 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d1042ed-d20d-4f03-aab0-02309210fc24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:30.677769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a1e187d7-256b-4c1f-abd7-4630459ee83c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:30.682051 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8d1042ed-d20d-4f03-aab0-02309210fc24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:30.686011 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a1e187d7-256b-4c1f-abd7-4630459ee83c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.218105 Aug 04 04:59:30.686589 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 902/1808] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:30 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:30.690620 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8d1042ed-d20d-4f03-aab0-02309210fc24 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.221054 Aug 04 04:59:30.691315 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 907/1809] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:30 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:30.691581 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bba16900-3cf1-4e84-8143-8ae87cfb689e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:30.692202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-bba16900-3cf1-4e84-8143-8ae87cfb689e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:30.698014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bba16900-3cf1-4e84-8143-8ae87cfb689e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:30.698426 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bba16900-3cf1-4e84-8143-8ae87cfb689e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:30.699192 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bba16900-3cf1-4e84-8143-8ae87cfb689e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:30.699631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bba16900-3cf1-4e84-8143-8ae87cfb689e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:30.761349 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-bba16900-3cf1-4e84-8143-8ae87cfb689e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:30.769288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-bba16900-3cf1-4e84-8143-8ae87cfb689e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081753 Aug 04 04:59:30.769870 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 903/1810] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:30 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:31.708891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-36c5af11-0269-4066-9429-70cb4c017293 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:31.709502 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-36c5af11-0269-4066-9429-70cb4c017293 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:31.711464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-db131a2e-e1de-48b3-bdc0-453cf1b0b1ec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:31.712085 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-db131a2e-e1de-48b3-bdc0-453cf1b0b1ec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:31.716036 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-36c5af11-0269-4066-9429-70cb4c017293 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:31.716483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-36c5af11-0269-4066-9429-70cb4c017293 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:31.717251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-36c5af11-0269-4066-9429-70cb4c017293 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:31.717709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-36c5af11-0269-4066-9429-70cb4c017293 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:31.718628 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db131a2e-e1de-48b3-bdc0-453cf1b0b1ec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:31.719220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db131a2e-e1de-48b3-bdc0-453cf1b0b1ec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:31.719962 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db131a2e-e1de-48b3-bdc0-453cf1b0b1ec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:31.720668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db131a2e-e1de-48b3-bdc0-453cf1b0b1ec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:31.910484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-db131a2e-e1de-48b3-bdc0-453cf1b0b1ec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:31.913697 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-36c5af11-0269-4066-9429-70cb4c017293 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:31.918479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-db131a2e-e1de-48b3-bdc0-453cf1b0b1ec tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.210747 Aug 04 04:59:31.919050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 904/1811] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:31 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:31.922119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-36c5af11-0269-4066-9429-70cb4c017293 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.217381 Aug 04 04:59:31.922806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 908/1812] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:31 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:31.924727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-49017946-0507-4fb5-ae39-f11a978f7318 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:31.925337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-49017946-0507-4fb5-ae39-f11a978f7318 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:31.931235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49017946-0507-4fb5-ae39-f11a978f7318 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:31.931692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49017946-0507-4fb5-ae39-f11a978f7318 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:31.932455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49017946-0507-4fb5-ae39-f11a978f7318 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:31.932893 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49017946-0507-4fb5-ae39-f11a978f7318 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:31.993884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-49017946-0507-4fb5-ae39-f11a978f7318 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:32.001920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-49017946-0507-4fb5-ae39-f11a978f7318 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081467 Aug 04 04:59:32.002528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 905/1813] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:31 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:32.941251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c55ceb4c-e37b-420f-90d4-999a9124f8d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:32.941909 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c55ceb4c-e37b-420f-90d4-999a9124f8d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:32.944134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-758d1add-7be0-4709-a2a3-cbc514d3cea8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:32.944891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-758d1add-7be0-4709-a2a3-cbc514d3cea8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:32.948449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c55ceb4c-e37b-420f-90d4-999a9124f8d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:32.948898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c55ceb4c-e37b-420f-90d4-999a9124f8d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:32.949695 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c55ceb4c-e37b-420f-90d4-999a9124f8d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:32.950135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c55ceb4c-e37b-420f-90d4-999a9124f8d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:32.951204 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-758d1add-7be0-4709-a2a3-cbc514d3cea8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:32.951644 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-758d1add-7be0-4709-a2a3-cbc514d3cea8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:32.952432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-758d1add-7be0-4709-a2a3-cbc514d3cea8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:32.952860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-758d1add-7be0-4709-a2a3-cbc514d3cea8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:33.145702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c55ceb4c-e37b-420f-90d4-999a9124f8d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:33.149383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-758d1add-7be0-4709-a2a3-cbc514d3cea8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:33.153760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c55ceb4c-e37b-420f-90d4-999a9124f8d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.217175 Aug 04 04:59:33.154331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 909/1814] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:32 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:33.158134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-758d1add-7be0-4709-a2a3-cbc514d3cea8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.217098 Aug 04 04:59:33.159430 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 906/1815] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:32 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:33.160085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9cf58c05-3fd5-40fc-b01c-5b43b1d5a3a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:33.160704 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9cf58c05-3fd5-40fc-b01c-5b43b1d5a3a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:33.166787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9cf58c05-3fd5-40fc-b01c-5b43b1d5a3a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:33.167239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9cf58c05-3fd5-40fc-b01c-5b43b1d5a3a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:33.168009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9cf58c05-3fd5-40fc-b01c-5b43b1d5a3a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:33.168442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9cf58c05-3fd5-40fc-b01c-5b43b1d5a3a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:33.229005 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9cf58c05-3fd5-40fc-b01c-5b43b1d5a3a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:33.237454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9cf58c05-3fd5-40fc-b01c-5b43b1d5a3a4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082189 Aug 04 04:59:33.238041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 910/1816] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:33 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:34.176588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-44838172-5c9e-4117-8ea5-ae2c4a459fc8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:34.177140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-44838172-5c9e-4117-8ea5-ae2c4a459fc8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:34.179938 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a2c3451b-7590-4799-88fb-b975a3d9d5da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:34.180555 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a2c3451b-7590-4799-88fb-b975a3d9d5da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:34.183752 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-44838172-5c9e-4117-8ea5-ae2c4a459fc8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:34.184203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-44838172-5c9e-4117-8ea5-ae2c4a459fc8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:34.184971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-44838172-5c9e-4117-8ea5-ae2c4a459fc8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:34.185405 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-44838172-5c9e-4117-8ea5-ae2c4a459fc8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:34.186999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2c3451b-7590-4799-88fb-b975a3d9d5da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:34.187452 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2c3451b-7590-4799-88fb-b975a3d9d5da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:34.188219 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2c3451b-7590-4799-88fb-b975a3d9d5da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:34.189281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2c3451b-7590-4799-88fb-b975a3d9d5da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:34.380268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-44838172-5c9e-4117-8ea5-ae2c4a459fc8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:34.383149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a2c3451b-7590-4799-88fb-b975a3d9d5da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:34.388689 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-44838172-5c9e-4117-8ea5-ae2c4a459fc8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.217139 Aug 04 04:59:34.389256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 907/1817] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:34 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:34.391310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a2c3451b-7590-4799-88fb-b975a3d9d5da tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215203 Aug 04 04:59:34.392656 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 911/1818] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:34 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:34.394159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c77b3f4f-6966-4537-a0f1-c973d4bc317a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:34.394781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c77b3f4f-6966-4537-a0f1-c973d4bc317a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:34.400630 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c77b3f4f-6966-4537-a0f1-c973d4bc317a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:34.401079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c77b3f4f-6966-4537-a0f1-c973d4bc317a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:34.401864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c77b3f4f-6966-4537-a0f1-c973d4bc317a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:34.402300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c77b3f4f-6966-4537-a0f1-c973d4bc317a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:34.466535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c77b3f4f-6966-4537-a0f1-c973d4bc317a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:34.475045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c77b3f4f-6966-4537-a0f1-c973d4bc317a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084822 Aug 04 04:59:34.475602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 908/1819] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:34 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:35.410227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f2b7e816-c968-448a-b8e5-cbb1e5203247 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:35.410822 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f2b7e816-c968-448a-b8e5-cbb1e5203247 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:35.412325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e1618aee-6780-47b7-95e9-563550b74519 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:35.412948 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e1618aee-6780-47b7-95e9-563550b74519 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:35.417746 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f2b7e816-c968-448a-b8e5-cbb1e5203247 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:35.418195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f2b7e816-c968-448a-b8e5-cbb1e5203247 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:35.418961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f2b7e816-c968-448a-b8e5-cbb1e5203247 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:35.419392 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f2b7e816-c968-448a-b8e5-cbb1e5203247 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:35.419498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e1618aee-6780-47b7-95e9-563550b74519 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:35.419924 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e1618aee-6780-47b7-95e9-563550b74519 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:35.420692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e1618aee-6780-47b7-95e9-563550b74519 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:35.421131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e1618aee-6780-47b7-95e9-563550b74519 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:35.607172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e1618aee-6780-47b7-95e9-563550b74519 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:35.614132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f2b7e816-c968-448a-b8e5-cbb1e5203247 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:35.615947 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e1618aee-6780-47b7-95e9-563550b74519 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.207440 Aug 04 04:59:35.616602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 909/1820] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:35 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:35.621069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-844e3560-edbb-488f-aa3a-13437266f3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:35.621717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-844e3560-edbb-488f-aa3a-13437266f3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:35.622399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f2b7e816-c968-448a-b8e5-cbb1e5203247 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.216327 Aug 04 04:59:35.623231 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 912/1821] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:35 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:35.628024 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-844e3560-edbb-488f-aa3a-13437266f3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:35.628481 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-844e3560-edbb-488f-aa3a-13437266f3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:35.629252 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-844e3560-edbb-488f-aa3a-13437266f3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:35.629735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-844e3560-edbb-488f-aa3a-13437266f3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:35.693231 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-844e3560-edbb-488f-aa3a-13437266f3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:35.701103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-844e3560-edbb-488f-aa3a-13437266f3a0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083553 Aug 04 04:59:35.701692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 910/1822] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:35 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:36.637369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-46767e40-ab03-4d47-9b9f-a2d241fcaa6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:36.638218 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-46767e40-ab03-4d47-9b9f-a2d241fcaa6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:36.644786 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-da754699-43dc-4ddc-8d9d-8a661e8e774e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:36.645280 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46767e40-ab03-4d47-9b9f-a2d241fcaa6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:36.645417 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-da754699-43dc-4ddc-8d9d-8a661e8e774e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:36.645645 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46767e40-ab03-4d47-9b9f-a2d241fcaa6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:36.646425 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46767e40-ab03-4d47-9b9f-a2d241fcaa6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:36.646872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46767e40-ab03-4d47-9b9f-a2d241fcaa6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:36.651872 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-da754699-43dc-4ddc-8d9d-8a661e8e774e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:36.652320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-da754699-43dc-4ddc-8d9d-8a661e8e774e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:36.653069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-da754699-43dc-4ddc-8d9d-8a661e8e774e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:36.653501 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-da754699-43dc-4ddc-8d9d-8a661e8e774e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:36.844387 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-46767e40-ab03-4d47-9b9f-a2d241fcaa6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:36.852056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-da754699-43dc-4ddc-8d9d-8a661e8e774e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:36.854368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-46767e40-ab03-4d47-9b9f-a2d241fcaa6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.220781 Aug 04 04:59:36.855025 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 913/1823] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:36 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:36.859759 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1fbc3579-ca7d-4757-89ea-64f1a541eb62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:36.860369 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-da754699-43dc-4ddc-8d9d-8a661e8e774e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.220017 Aug 04 04:59:36.861004 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1fbc3579-ca7d-4757-89ea-64f1a541eb62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:36.862184 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 911/1824] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:36 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:36.866767 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1fbc3579-ca7d-4757-89ea-64f1a541eb62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:36.867211 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1fbc3579-ca7d-4757-89ea-64f1a541eb62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:36.867972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1fbc3579-ca7d-4757-89ea-64f1a541eb62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:36.868408 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1fbc3579-ca7d-4757-89ea-64f1a541eb62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:36.929102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1fbc3579-ca7d-4757-89ea-64f1a541eb62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:36.936999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1fbc3579-ca7d-4757-89ea-64f1a541eb62 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080741 Aug 04 04:59:36.937563 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 914/1825] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:36 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:37.876368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eb3c8d31-705a-48b5-9ca9-005237c9cd1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:37.876999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eb3c8d31-705a-48b5-9ca9-005237c9cd1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:37.882703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-80ead209-7ece-41b7-9bd0-1a765935c0ef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:37.883316 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-80ead209-7ece-41b7-9bd0-1a765935c0ef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:37.883672 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb3c8d31-705a-48b5-9ca9-005237c9cd1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:37.884116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb3c8d31-705a-48b5-9ca9-005237c9cd1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:37.884870 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb3c8d31-705a-48b5-9ca9-005237c9cd1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:37.885301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb3c8d31-705a-48b5-9ca9-005237c9cd1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:37.889814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-80ead209-7ece-41b7-9bd0-1a765935c0ef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:37.890276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-80ead209-7ece-41b7-9bd0-1a765935c0ef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:37.891041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-80ead209-7ece-41b7-9bd0-1a765935c0ef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:37.891476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-80ead209-7ece-41b7-9bd0-1a765935c0ef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:37.906593 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:38.077364 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-eb3c8d31-705a-48b5-9ca9-005237c9cd1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:38.080860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-80ead209-7ece-41b7-9bd0-1a765935c0ef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:38.086722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eb3c8d31-705a-48b5-9ca9-005237c9cd1d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.214635 Aug 04 04:59:38.087294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 912/1826] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:37 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:38.088900 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-80ead209-7ece-41b7-9bd0-1a765935c0ef tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.209943 Aug 04 04:59:38.089645 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 915/1827] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:37 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:38.092225 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2c15f9e9-cce3-473d-8f7d-c29d1d2bf6dd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:38.092828 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2c15f9e9-cce3-473d-8f7d-c29d1d2bf6dd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:38.099550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2c15f9e9-cce3-473d-8f7d-c29d1d2bf6dd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:38.100012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2c15f9e9-cce3-473d-8f7d-c29d1d2bf6dd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:38.100765 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2c15f9e9-cce3-473d-8f7d-c29d1d2bf6dd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:38.101196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2c15f9e9-cce3-473d-8f7d-c29d1d2bf6dd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:38.161800 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2c15f9e9-cce3-473d-8f7d-c29d1d2bf6dd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:38.169687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2c15f9e9-cce3-473d-8f7d-c29d1d2bf6dd tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081394 Aug 04 04:59:38.170237 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 913/1828] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:38 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:39.108200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cbb775e8-d1ee-4d17-9b64-6a1b4324ed50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:39.108818 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cbb775e8-d1ee-4d17-9b64-6a1b4324ed50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:39.110894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d34614ac-e08b-46d1-a845-23f66408b61a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:39.111529 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d34614ac-e08b-46d1-a845-23f66408b61a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:39.115745 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cbb775e8-d1ee-4d17-9b64-6a1b4324ed50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:39.116196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cbb775e8-d1ee-4d17-9b64-6a1b4324ed50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:39.116971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cbb775e8-d1ee-4d17-9b64-6a1b4324ed50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:39.117409 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cbb775e8-d1ee-4d17-9b64-6a1b4324ed50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:39.117973 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d34614ac-e08b-46d1-a845-23f66408b61a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:39.118425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d34614ac-e08b-46d1-a845-23f66408b61a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:39.119196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d34614ac-e08b-46d1-a845-23f66408b61a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:39.119624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d34614ac-e08b-46d1-a845-23f66408b61a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:39.314935 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-cbb775e8-d1ee-4d17-9b64-6a1b4324ed50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:39.318824 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d34614ac-e08b-46d1-a845-23f66408b61a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:39.322946 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cbb775e8-d1ee-4d17-9b64-6a1b4324ed50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.218642 Aug 04 04:59:39.323523 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 916/1829] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:39 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:39.327522 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d34614ac-e08b-46d1-a845-23f66408b61a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.220702 Aug 04 04:59:39.328249 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 914/1830] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:39 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:39.328439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7c778751-b7db-4ba0-89fc-745018729bc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:39.329127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7c778751-b7db-4ba0-89fc-745018729bc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:39.335550 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c778751-b7db-4ba0-89fc-745018729bc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:39.336006 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c778751-b7db-4ba0-89fc-745018729bc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:39.336819 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c778751-b7db-4ba0-89fc-745018729bc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:39.337305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7c778751-b7db-4ba0-89fc-745018729bc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:39.399113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7c778751-b7db-4ba0-89fc-745018729bc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:39.407050 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7c778751-b7db-4ba0-89fc-745018729bc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082585 Aug 04 04:59:39.407631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 917/1831] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:40.344313 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5309bb65-3eb3-4c86-b0a0-85d2a75c0f3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:40.345629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5309bb65-3eb3-4c86-b0a0-85d2a75c0f3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:40.348602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4775bdf2-f6ab-4f18-ae0e-52009b81944c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:40.349229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4775bdf2-f6ab-4f18-ae0e-52009b81944c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:40.352178 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5309bb65-3eb3-4c86-b0a0-85d2a75c0f3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:40.352637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5309bb65-3eb3-4c86-b0a0-85d2a75c0f3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:40.353418 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5309bb65-3eb3-4c86-b0a0-85d2a75c0f3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:40.353890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5309bb65-3eb3-4c86-b0a0-85d2a75c0f3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:40.356061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4775bdf2-f6ab-4f18-ae0e-52009b81944c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:40.356517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4775bdf2-f6ab-4f18-ae0e-52009b81944c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:40.357287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4775bdf2-f6ab-4f18-ae0e-52009b81944c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:40.357767 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4775bdf2-f6ab-4f18-ae0e-52009b81944c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:40.550507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5309bb65-3eb3-4c86-b0a0-85d2a75c0f3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:40.554874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4775bdf2-f6ab-4f18-ae0e-52009b81944c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:40.558407 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5309bb65-3eb3-4c86-b0a0-85d2a75c0f3c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.218013 Aug 04 04:59:40.558973 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 915/1832] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:40 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:40.563116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4775bdf2-f6ab-4f18-ae0e-52009b81944c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.218966 Aug 04 04:59:40.563932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f6372fbf-27c9-4e66-96dc-12b4d3674e2b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:40.564482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f6372fbf-27c9-4e66-96dc-12b4d3674e2b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:40.567678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 918/1833] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:40 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:40.574494 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6372fbf-27c9-4e66-96dc-12b4d3674e2b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:40.575732 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6372fbf-27c9-4e66-96dc-12b4d3674e2b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:40.577173 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6372fbf-27c9-4e66-96dc-12b4d3674e2b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:40.578070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6372fbf-27c9-4e66-96dc-12b4d3674e2b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:40.640514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f6372fbf-27c9-4e66-96dc-12b4d3674e2b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:40.649007 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f6372fbf-27c9-4e66-96dc-12b4d3674e2b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.089094 Aug 04 04:59:40.649711 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 916/1834] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:40 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:41.585333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5893f912-6f94-479e-bc3d-9bcf88b97b0d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:41.585982 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5893f912-6f94-479e-bc3d-9bcf88b97b0d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:41.587905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d2f70d4c-b36f-4ec8-8c5c-6d4af17daa44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:41.588512 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d2f70d4c-b36f-4ec8-8c5c-6d4af17daa44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:41.592638 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5893f912-6f94-479e-bc3d-9bcf88b97b0d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:41.593089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5893f912-6f94-479e-bc3d-9bcf88b97b0d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:41.593973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5893f912-6f94-479e-bc3d-9bcf88b97b0d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:41.594412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5893f912-6f94-479e-bc3d-9bcf88b97b0d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:41.595825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2f70d4c-b36f-4ec8-8c5c-6d4af17daa44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:41.596273 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2f70d4c-b36f-4ec8-8c5c-6d4af17daa44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:41.597032 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2f70d4c-b36f-4ec8-8c5c-6d4af17daa44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:41.597473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2f70d4c-b36f-4ec8-8c5c-6d4af17daa44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:41.613155 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:41.787537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5893f912-6f94-479e-bc3d-9bcf88b97b0d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:41.790781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d2f70d4c-b36f-4ec8-8c5c-6d4af17daa44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:41.795588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5893f912-6f94-479e-bc3d-9bcf88b97b0d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.214081 Aug 04 04:59:41.796160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 919/1835] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:41 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:41.799698 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d2f70d4c-b36f-4ec8-8c5c-6d4af17daa44 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215554 Aug 04 04:59:41.800409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 917/1836] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:41 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:41.800908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a9c27d8c-9881-47b0-b12c-b797cca582c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:41.801520 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a9c27d8c-9881-47b0-b12c-b797cca582c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:41.807404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a9c27d8c-9881-47b0-b12c-b797cca582c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:41.807864 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a9c27d8c-9881-47b0-b12c-b797cca582c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:41.808631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a9c27d8c-9881-47b0-b12c-b797cca582c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:41.809072 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a9c27d8c-9881-47b0-b12c-b797cca582c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:41.874880 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a9c27d8c-9881-47b0-b12c-b797cca582c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:41.883554 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a9c27d8c-9881-47b0-b12c-b797cca582c6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086167 Aug 04 04:59:41.884154 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 920/1837] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:41 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:42.817682 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ccc27b43-b3c3-4d44-ba08-38c865279348 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:42.818304 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ccc27b43-b3c3-4d44-ba08-38c865279348 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:42.820085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-15de3373-2261-4b65-bd85-104c96ea3f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:42.820698 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-15de3373-2261-4b65-bd85-104c96ea3f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:42.824937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ccc27b43-b3c3-4d44-ba08-38c865279348 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:42.825391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ccc27b43-b3c3-4d44-ba08-38c865279348 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:42.826185 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ccc27b43-b3c3-4d44-ba08-38c865279348 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:42.826627 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ccc27b43-b3c3-4d44-ba08-38c865279348 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:42.827130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-15de3373-2261-4b65-bd85-104c96ea3f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:42.827644 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-15de3373-2261-4b65-bd85-104c96ea3f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:42.828405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-15de3373-2261-4b65-bd85-104c96ea3f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:42.828879 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-15de3373-2261-4b65-bd85-104c96ea3f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:42.967841 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ccc27b43-b3c3-4d44-ba08-38c865279348 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:42.976223 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ccc27b43-b3c3-4d44-ba08-38c865279348 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.162952 Aug 04 04:59:42.976806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 918/1838] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:42 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:42.981399 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-043fea99-d486-4748-8f63-6f0ee6b115df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:42.982055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-043fea99-d486-4748-8f63-6f0ee6b115df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:42.988715 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-043fea99-d486-4748-8f63-6f0ee6b115df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:42.989166 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-043fea99-d486-4748-8f63-6f0ee6b115df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:42.989956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-043fea99-d486-4748-8f63-6f0ee6b115df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:42.990390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-043fea99-d486-4748-8f63-6f0ee6b115df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:43.072964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-043fea99-d486-4748-8f63-6f0ee6b115df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:43.081163 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-043fea99-d486-4748-8f63-6f0ee6b115df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.103380 Aug 04 04:59:43.081752 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 919/1839] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:42 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:43.138125 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-15de3373-2261-4b65-bd85-104c96ea3f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:43.146186 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-15de3373-2261-4b65-bd85-104c96ea3f3d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.329862 Aug 04 04:59:43.146744 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 921/1840] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:42 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:43.997719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-33754237-fba2-4b2b-91ee-2b0f249f0621 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:43.998337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-33754237-fba2-4b2b-91ee-2b0f249f0621 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:44.005212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-33754237-fba2-4b2b-91ee-2b0f249f0621 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:44.005711 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-33754237-fba2-4b2b-91ee-2b0f249f0621 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:44.006481 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-33754237-fba2-4b2b-91ee-2b0f249f0621 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:44.006920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-33754237-fba2-4b2b-91ee-2b0f249f0621 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:44.102106 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-47b4574e-763b-4f40-8484-c31897335405 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:44.102724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-47b4574e-763b-4f40-8484-c31897335405 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:44.109172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47b4574e-763b-4f40-8484-c31897335405 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:44.109656 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47b4574e-763b-4f40-8484-c31897335405 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:44.110594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47b4574e-763b-4f40-8484-c31897335405 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:44.111258 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47b4574e-763b-4f40-8484-c31897335405 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:44.135180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-33754237-fba2-4b2b-91ee-2b0f249f0621 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:44.143681 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-33754237-fba2-4b2b-91ee-2b0f249f0621 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149874 Aug 04 04:59:44.144256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 920/1841] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:43 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:44.166161 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8abce5db-72ad-45e9-b8d0-6f7cc49c9c17 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:44.166776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8abce5db-72ad-45e9-b8d0-6f7cc49c9c17 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:44.171975 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-47b4574e-763b-4f40-8484-c31897335405 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:44.173421 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8abce5db-72ad-45e9-b8d0-6f7cc49c9c17 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:44.173942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8abce5db-72ad-45e9-b8d0-6f7cc49c9c17 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:44.174745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8abce5db-72ad-45e9-b8d0-6f7cc49c9c17 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:44.175187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8abce5db-72ad-45e9-b8d0-6f7cc49c9c17 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:44.180198 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-47b4574e-763b-4f40-8484-c31897335405 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081868 Aug 04 04:59:44.180750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 922/1842] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:44 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:44.304632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8abce5db-72ad-45e9-b8d0-6f7cc49c9c17 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:44.312551 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8abce5db-72ad-45e9-b8d0-6f7cc49c9c17 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150153 Aug 04 04:59:44.313739 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 921/1843] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:44 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:45.164330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f9f6a8a7-42fe-4bc2-96fc-fdb86c6b7ee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:45.164948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f9f6a8a7-42fe-4bc2-96fc-fdb86c6b7ee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:45.171404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f9f6a8a7-42fe-4bc2-96fc-fdb86c6b7ee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:45.172104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f9f6a8a7-42fe-4bc2-96fc-fdb86c6b7ee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:45.174168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f9f6a8a7-42fe-4bc2-96fc-fdb86c6b7ee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:45.174608 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f9f6a8a7-42fe-4bc2-96fc-fdb86c6b7ee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:45.201558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-619ab686-227f-4cb0-a725-a702a4495fd2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:45.202225 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-619ab686-227f-4cb0-a725-a702a4495fd2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:45.208889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-619ab686-227f-4cb0-a725-a702a4495fd2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:45.209330 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-619ab686-227f-4cb0-a725-a702a4495fd2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:45.210282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-619ab686-227f-4cb0-a725-a702a4495fd2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:45.210724 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-619ab686-227f-4cb0-a725-a702a4495fd2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:45.286480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-619ab686-227f-4cb0-a725-a702a4495fd2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:45.294338 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-619ab686-227f-4cb0-a725-a702a4495fd2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.096575 Aug 04 04:59:45.294905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 922/1844] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:45 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:45.322279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f9f6a8a7-42fe-4bc2-96fc-fdb86c6b7ee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:45.331244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f9f6a8a7-42fe-4bc2-96fc-fdb86c6b7ee5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.170714 Aug 04 04:59:45.331797 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 923/1845] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:45 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:45.334830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b4b4ed55-afbb-4632-8359-237b103b5320 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:45.335442 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b4b4ed55-afbb-4632-8359-237b103b5320 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:45.342112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b4b4ed55-afbb-4632-8359-237b103b5320 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:45.342542 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b4b4ed55-afbb-4632-8359-237b103b5320 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:45.343297 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b4b4ed55-afbb-4632-8359-237b103b5320 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:45.343738 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b4b4ed55-afbb-4632-8359-237b103b5320 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:45.473428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b4b4ed55-afbb-4632-8359-237b103b5320 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:45.481276 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b4b4ed55-afbb-4632-8359-237b103b5320 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150379 Aug 04 04:59:45.481876 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 923/1846] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:45 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:46.316441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0f53878f-4614-4f60-9336-7fc2bed86dc1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:46.317069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0f53878f-4614-4f60-9336-7fc2bed86dc1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:46.323573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f53878f-4614-4f60-9336-7fc2bed86dc1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:46.324021 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f53878f-4614-4f60-9336-7fc2bed86dc1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:46.324780 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f53878f-4614-4f60-9336-7fc2bed86dc1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:46.325210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f53878f-4614-4f60-9336-7fc2bed86dc1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:46.351841 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-684f5115-88f2-4fad-a6cf-d54e0311e65b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:46.352442 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-684f5115-88f2-4fad-a6cf-d54e0311e65b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:46.358983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-684f5115-88f2-4fad-a6cf-d54e0311e65b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:46.359433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-684f5115-88f2-4fad-a6cf-d54e0311e65b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:46.360796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-684f5115-88f2-4fad-a6cf-d54e0311e65b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:46.361245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-684f5115-88f2-4fad-a6cf-d54e0311e65b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:46.388270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0f53878f-4614-4f60-9336-7fc2bed86dc1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:46.396958 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0f53878f-4614-4f60-9336-7fc2bed86dc1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084624 Aug 04 04:59:46.397748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 924/1847] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:46 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:46.489235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-684f5115-88f2-4fad-a6cf-d54e0311e65b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:46.497294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-684f5115-88f2-4fad-a6cf-d54e0311e65b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149172 Aug 04 04:59:46.498189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 924/1848] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:46 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:46.503609 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-76ce4a81-56fb-4885-82f6-1db65ce88e02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:46.504227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-76ce4a81-56fb-4885-82f6-1db65ce88e02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:46.510277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-76ce4a81-56fb-4885-82f6-1db65ce88e02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:46.510728 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-76ce4a81-56fb-4885-82f6-1db65ce88e02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:46.511495 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-76ce4a81-56fb-4885-82f6-1db65ce88e02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:46.511931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-76ce4a81-56fb-4885-82f6-1db65ce88e02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:46.647720 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-76ce4a81-56fb-4885-82f6-1db65ce88e02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:46.655576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-76ce4a81-56fb-4885-82f6-1db65ce88e02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.156582 Aug 04 04:59:46.656136 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 925/1849] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:46 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:47.418338 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ab376bbc-9468-487f-8e9b-76ca20050824 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:47.418868 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ab376bbc-9468-487f-8e9b-76ca20050824 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:47.426444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab376bbc-9468-487f-8e9b-76ca20050824 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:47.426905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab376bbc-9468-487f-8e9b-76ca20050824 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:47.427707 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab376bbc-9468-487f-8e9b-76ca20050824 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:47.428150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab376bbc-9468-487f-8e9b-76ca20050824 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:47.488877 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ab376bbc-9468-487f-8e9b-76ca20050824 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:47.497079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ab376bbc-9468-487f-8e9b-76ca20050824 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082682 Aug 04 04:59:47.497665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 925/1850] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:47 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:47.519014 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9190359f-6f64-40be-82f1-7b74c9cfeda6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:47.519636 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9190359f-6f64-40be-82f1-7b74c9cfeda6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:47.526227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9190359f-6f64-40be-82f1-7b74c9cfeda6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:47.526679 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9190359f-6f64-40be-82f1-7b74c9cfeda6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:47.527443 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9190359f-6f64-40be-82f1-7b74c9cfeda6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:47.527881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9190359f-6f64-40be-82f1-7b74c9cfeda6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:47.656813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9190359f-6f64-40be-82f1-7b74c9cfeda6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:47.664915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9190359f-6f64-40be-82f1-7b74c9cfeda6 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149761 Aug 04 04:59:47.665480 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 926/1851] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:47 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:47.678349 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bcce60d9-3c5a-40b8-a954-ab4cdce55372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:47.678925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-bcce60d9-3c5a-40b8-a954-ab4cdce55372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:47.687484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bcce60d9-3c5a-40b8-a954-ab4cdce55372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:47.687940 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bcce60d9-3c5a-40b8-a954-ab4cdce55372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:47.690004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bcce60d9-3c5a-40b8-a954-ab4cdce55372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:47.690449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bcce60d9-3c5a-40b8-a954-ab4cdce55372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:47.819838 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-bcce60d9-3c5a-40b8-a954-ab4cdce55372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:47.828175 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-bcce60d9-3c5a-40b8-a954-ab4cdce55372 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153815 Aug 04 04:59:47.828748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 926/1852] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:47 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:48.519314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9265533a-7055-4ce1-9319-6c6180c35ae3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:48.519932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9265533a-7055-4ce1-9319-6c6180c35ae3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:48.526175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9265533a-7055-4ce1-9319-6c6180c35ae3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:48.526628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9265533a-7055-4ce1-9319-6c6180c35ae3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:48.527392 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9265533a-7055-4ce1-9319-6c6180c35ae3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:48.527829 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9265533a-7055-4ce1-9319-6c6180c35ae3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:48.589709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9265533a-7055-4ce1-9319-6c6180c35ae3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:48.598749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9265533a-7055-4ce1-9319-6c6180c35ae3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083982 Aug 04 04:59:48.599308 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 927/1853] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:48 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:48.689783 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d39849cc-9bc7-46b3-8b63-e971572383d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:48.690397 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d39849cc-9bc7-46b3-8b63-e971572383d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:48.697189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d39849cc-9bc7-46b3-8b63-e971572383d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:48.697444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d39849cc-9bc7-46b3-8b63-e971572383d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:48.698578 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d39849cc-9bc7-46b3-8b63-e971572383d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:48.699251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d39849cc-9bc7-46b3-8b63-e971572383d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:48.832244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d39849cc-9bc7-46b3-8b63-e971572383d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:48.840111 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d39849cc-9bc7-46b3-8b63-e971572383d0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.156052 Aug 04 04:59:48.840674 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 927/1854] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:48 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:48.848892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-25d67332-6488-47fd-95ea-5905ef73d243 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:48.849507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-25d67332-6488-47fd-95ea-5905ef73d243 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:48.855453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-25d67332-6488-47fd-95ea-5905ef73d243 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:48.855896 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-25d67332-6488-47fd-95ea-5905ef73d243 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:48.856648 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-25d67332-6488-47fd-95ea-5905ef73d243 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:48.857078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-25d67332-6488-47fd-95ea-5905ef73d243 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:48.984763 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-25d67332-6488-47fd-95ea-5905ef73d243 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:48.993200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-25d67332-6488-47fd-95ea-5905ef73d243 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148777 Aug 04 04:59:48.993790 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 928/1855] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:48 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:49.619196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-80ff3f71-962d-4b29-915d-61732b680622 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:49.619808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-80ff3f71-962d-4b29-915d-61732b680622 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:49.626320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80ff3f71-962d-4b29-915d-61732b680622 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:49.626777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80ff3f71-962d-4b29-915d-61732b680622 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:49.627572 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80ff3f71-962d-4b29-915d-61732b680622 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:49.628010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80ff3f71-962d-4b29-915d-61732b680622 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:49.689101 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-80ff3f71-962d-4b29-915d-61732b680622 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:49.697414 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-80ff3f71-962d-4b29-915d-61732b680622 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082083 Aug 04 04:59:49.698116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 928/1856] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:49 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:49.862272 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-575ba638-967a-4073-820c-988d51145a44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:49.862922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-575ba638-967a-4073-820c-988d51145a44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:49.869444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-575ba638-967a-4073-820c-988d51145a44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:49.869932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-575ba638-967a-4073-820c-988d51145a44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:49.870728 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-575ba638-967a-4073-820c-988d51145a44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:49.871166 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-575ba638-967a-4073-820c-988d51145a44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:50.007572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-575ba638-967a-4073-820c-988d51145a44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:50.015123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ee97e096-954e-4992-b802-409c8b1ce405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:50.015729 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ee97e096-954e-4992-b802-409c8b1ce405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:50.015850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-575ba638-967a-4073-820c-988d51145a44 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.157432 Aug 04 04:59:50.017076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 929/1857] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:49 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:50.022223 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ee97e096-954e-4992-b802-409c8b1ce405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:50.022666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ee97e096-954e-4992-b802-409c8b1ce405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:50.023425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ee97e096-954e-4992-b802-409c8b1ce405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:50.023857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ee97e096-954e-4992-b802-409c8b1ce405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:50.150963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ee97e096-954e-4992-b802-409c8b1ce405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:50.159718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ee97e096-954e-4992-b802-409c8b1ce405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148309 Aug 04 04:59:50.160291 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 929/1858] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:50 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:50.718388 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bfa998d1-39cb-40ef-8d1e-67659f3539a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:50.718932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bfa998d1-39cb-40ef-8d1e-67659f3539a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:50.725749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bfa998d1-39cb-40ef-8d1e-67659f3539a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:50.726229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bfa998d1-39cb-40ef-8d1e-67659f3539a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:50.726997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bfa998d1-39cb-40ef-8d1e-67659f3539a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:50.727434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bfa998d1-39cb-40ef-8d1e-67659f3539a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:50.786753 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bfa998d1-39cb-40ef-8d1e-67659f3539a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:50.794660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bfa998d1-39cb-40ef-8d1e-67659f3539a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080343 Aug 04 04:59:50.795216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 930/1859] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:50 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:51.037727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8e64f148-e40a-40b0-b568-ae0225ec2f43 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:51.038340 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8e64f148-e40a-40b0-b568-ae0225ec2f43 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:51.044806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8e64f148-e40a-40b0-b568-ae0225ec2f43 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:51.045259 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8e64f148-e40a-40b0-b568-ae0225ec2f43 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:51.046055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8e64f148-e40a-40b0-b568-ae0225ec2f43 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:51.046760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8e64f148-e40a-40b0-b568-ae0225ec2f43 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:51.181083 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8e64f148-e40a-40b0-b568-ae0225ec2f43 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:51.181462 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a51179e8-bedf-44e7-9d0b-e94a1b4a1338 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:51.182134 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a51179e8-bedf-44e7-9d0b-e94a1b4a1338 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:51.188697 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a51179e8-bedf-44e7-9d0b-e94a1b4a1338 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:51.189137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a51179e8-bedf-44e7-9d0b-e94a1b4a1338 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:51.189537 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8e64f148-e40a-40b0-b568-ae0225ec2f43 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.155710 Aug 04 04:59:51.189926 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a51179e8-bedf-44e7-9d0b-e94a1b4a1338 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:51.197722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 930/1860] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:51 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:51.197908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a51179e8-bedf-44e7-9d0b-e94a1b4a1338 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:51.317629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a51179e8-bedf-44e7-9d0b-e94a1b4a1338 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:51.325502 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a51179e8-bedf-44e7-9d0b-e94a1b4a1338 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.147937 Aug 04 04:59:51.326085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 931/1861] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:51 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:51.816879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-883c675c-3a60-4cbd-a397-2a2e10e58aba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:51.817496 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-883c675c-3a60-4cbd-a397-2a2e10e58aba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:51.823491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-883c675c-3a60-4cbd-a397-2a2e10e58aba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:51.823937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-883c675c-3a60-4cbd-a397-2a2e10e58aba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:51.824688 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-883c675c-3a60-4cbd-a397-2a2e10e58aba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:51.825120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-883c675c-3a60-4cbd-a397-2a2e10e58aba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:51.886794 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-883c675c-3a60-4cbd-a397-2a2e10e58aba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:51.895513 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-883c675c-3a60-4cbd-a397-2a2e10e58aba tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083173 Aug 04 04:59:51.896060 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 931/1862] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:51 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:52.210304 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6fe3123c-4b28-4838-b97a-475c563ce765 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:52.210845 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6fe3123c-4b28-4838-b97a-475c563ce765 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:52.217330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6fe3123c-4b28-4838-b97a-475c563ce765 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:52.217812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6fe3123c-4b28-4838-b97a-475c563ce765 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:52.218570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6fe3123c-4b28-4838-b97a-475c563ce765 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:52.219001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6fe3123c-4b28-4838-b97a-475c563ce765 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:52.223659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:52.347223 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dc84a2fc-0591-41de-8636-2290ddd6522d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:52.347828 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dc84a2fc-0591-41de-8636-2290ddd6522d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:52.352290 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6fe3123c-4b28-4838-b97a-475c563ce765 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:52.354268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc84a2fc-0591-41de-8636-2290ddd6522d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:52.354718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc84a2fc-0591-41de-8636-2290ddd6522d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:52.355482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc84a2fc-0591-41de-8636-2290ddd6522d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:52.355913 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc84a2fc-0591-41de-8636-2290ddd6522d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:52.360833 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6fe3123c-4b28-4838-b97a-475c563ce765 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154403 Aug 04 04:59:52.361404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 932/1863] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:52 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:52.486933 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dc84a2fc-0591-41de-8636-2290ddd6522d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:52.494782 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dc84a2fc-0591-41de-8636-2290ddd6522d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151546 Aug 04 04:59:52.495340 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 932/1864] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:52 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:52.916438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a31a0d63-5f46-47fb-8092-c4c3b67e3ca7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:52.917053 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a31a0d63-5f46-47fb-8092-c4c3b67e3ca7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:52.923375 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a31a0d63-5f46-47fb-8092-c4c3b67e3ca7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:52.923826 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a31a0d63-5f46-47fb-8092-c4c3b67e3ca7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:52.924580 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a31a0d63-5f46-47fb-8092-c4c3b67e3ca7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:52.925011 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a31a0d63-5f46-47fb-8092-c4c3b67e3ca7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:52.984356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a31a0d63-5f46-47fb-8092-c4c3b67e3ca7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:52.992457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a31a0d63-5f46-47fb-8092-c4c3b67e3ca7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.079917 Aug 04 04:59:52.993002 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 933/1865] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:52 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:53.382105 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1e119790-9720-4084-9ce3-83342811f22b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:53.382727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1e119790-9720-4084-9ce3-83342811f22b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:53.389292 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1e119790-9720-4084-9ce3-83342811f22b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:53.389785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1e119790-9720-4084-9ce3-83342811f22b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:53.390548 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1e119790-9720-4084-9ce3-83342811f22b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:53.391639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1e119790-9720-4084-9ce3-83342811f22b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:53.514993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-26ac24f4-81b9-417b-a2f9-2131dabef4c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:53.515709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-26ac24f4-81b9-417b-a2f9-2131dabef4c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:53.522016 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1e119790-9720-4084-9ce3-83342811f22b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:53.522507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-26ac24f4-81b9-417b-a2f9-2131dabef4c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:53.522960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-26ac24f4-81b9-417b-a2f9-2131dabef4c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:53.523730 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-26ac24f4-81b9-417b-a2f9-2131dabef4c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:53.524174 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-26ac24f4-81b9-417b-a2f9-2131dabef4c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:53.529990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1e119790-9720-4084-9ce3-83342811f22b tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151728 Aug 04 04:59:53.530555 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 933/1866] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:53 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:53.654496 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-26ac24f4-81b9-417b-a2f9-2131dabef4c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:53.663416 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-26ac24f4-81b9-417b-a2f9-2131dabef4c7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152256 Aug 04 04:59:53.663975 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 934/1867] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:53 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:54.012869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0d891d89-fc50-4e66-b66a-35fd0e534d1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:54.013420 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0d891d89-fc50-4e66-b66a-35fd0e534d1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:54.020158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d891d89-fc50-4e66-b66a-35fd0e534d1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:54.020613 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d891d89-fc50-4e66-b66a-35fd0e534d1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:54.021380 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d891d89-fc50-4e66-b66a-35fd0e534d1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:54.021845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d891d89-fc50-4e66-b66a-35fd0e534d1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:54.024353 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:54.086744 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0d891d89-fc50-4e66-b66a-35fd0e534d1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:54.095394 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0d891d89-fc50-4e66-b66a-35fd0e534d1a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086091 Aug 04 04:59:54.095953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 934/1868] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:54 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:54.552570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e4635037-d650-4d8d-96cf-81a56e6e8099 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:54.553195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e4635037-d650-4d8d-96cf-81a56e6e8099 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:54.559686 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e4635037-d650-4d8d-96cf-81a56e6e8099 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:54.560137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e4635037-d650-4d8d-96cf-81a56e6e8099 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:54.560897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e4635037-d650-4d8d-96cf-81a56e6e8099 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:54.561334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e4635037-d650-4d8d-96cf-81a56e6e8099 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:54.684946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2ad8edae-9b80-432a-bba3-13c619945d82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:54.685506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2ad8edae-9b80-432a-bba3-13c619945d82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:54.688677 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e4635037-d650-4d8d-96cf-81a56e6e8099 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:54.692652 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ad8edae-9b80-432a-bba3-13c619945d82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:54.693114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ad8edae-9b80-432a-bba3-13c619945d82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:54.693908 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ad8edae-9b80-432a-bba3-13c619945d82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:54.694350 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2ad8edae-9b80-432a-bba3-13c619945d82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:54.696763 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e4635037-d650-4d8d-96cf-81a56e6e8099 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148068 Aug 04 04:59:54.697329 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 935/1869] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:54 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:54.820017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2ad8edae-9b80-432a-bba3-13c619945d82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:54.827916 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2ad8edae-9b80-432a-bba3-13c619945d82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.146958 Aug 04 04:59:54.829144 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 935/1870] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:54 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:55.116010 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3bf494f5-afaa-4522-b425-2018f7a11d5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:55.116637 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3bf494f5-afaa-4522-b425-2018f7a11d5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:55.122698 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3bf494f5-afaa-4522-b425-2018f7a11d5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:55.123154 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3bf494f5-afaa-4522-b425-2018f7a11d5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:55.123922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3bf494f5-afaa-4522-b425-2018f7a11d5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:55.124357 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3bf494f5-afaa-4522-b425-2018f7a11d5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:55.187230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3bf494f5-afaa-4522-b425-2018f7a11d5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:55.195328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3bf494f5-afaa-4522-b425-2018f7a11d5a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083192 Aug 04 04:59:55.195884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 936/1871] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:55 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:55.718403 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-abbf5249-f2ab-4efa-85ac-d832bb804c18 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:55.719666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-abbf5249-f2ab-4efa-85ac-d832bb804c18 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:55.726177 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-abbf5249-f2ab-4efa-85ac-d832bb804c18 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:55.726631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-abbf5249-f2ab-4efa-85ac-d832bb804c18 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:55.727393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-abbf5249-f2ab-4efa-85ac-d832bb804c18 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:55.727835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-abbf5249-f2ab-4efa-85ac-d832bb804c18 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:55.849449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-182db553-0e54-47f1-8c97-f32e2504a1d7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:55.850685 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-182db553-0e54-47f1-8c97-f32e2504a1d7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:55.857456 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-182db553-0e54-47f1-8c97-f32e2504a1d7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:55.857936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-182db553-0e54-47f1-8c97-f32e2504a1d7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:55.858717 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-182db553-0e54-47f1-8c97-f32e2504a1d7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:55.859154 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-182db553-0e54-47f1-8c97-f32e2504a1d7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:55.861874 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-abbf5249-f2ab-4efa-85ac-d832bb804c18 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:55.870277 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-abbf5249-f2ab-4efa-85ac-d832bb804c18 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.155735 Aug 04 04:59:55.873577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 936/1872] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:55 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:55.995595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-182db553-0e54-47f1-8c97-f32e2504a1d7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:56.003682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-182db553-0e54-47f1-8c97-f32e2504a1d7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.158306 Aug 04 04:59:56.004244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 937/1873] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:55 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:56.216621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ab98826f-6795-43ba-a9ba-d68cfe1fedf8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:56.217233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ab98826f-6795-43ba-a9ba-d68cfe1fedf8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:56.223217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab98826f-6795-43ba-a9ba-d68cfe1fedf8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:56.223663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab98826f-6795-43ba-a9ba-d68cfe1fedf8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:56.224455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab98826f-6795-43ba-a9ba-d68cfe1fedf8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:56.224890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab98826f-6795-43ba-a9ba-d68cfe1fedf8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:56.288234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ab98826f-6795-43ba-a9ba-d68cfe1fedf8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:56.296159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ab98826f-6795-43ba-a9ba-d68cfe1fedf8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083376 Aug 04 04:59:56.296986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 937/1874] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:56 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:56.892192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-179ade56-fa34-4fc5-b8c3-81e2d93add23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:56.892811 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-179ade56-fa34-4fc5-b8c3-81e2d93add23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:56.899578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-179ade56-fa34-4fc5-b8c3-81e2d93add23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:56.900031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-179ade56-fa34-4fc5-b8c3-81e2d93add23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:56.900803 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-179ade56-fa34-4fc5-b8c3-81e2d93add23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:56.901242 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-179ade56-fa34-4fc5-b8c3-81e2d93add23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:57.026420 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e3eef9f6-5aec-4252-8921-4f10198ddd9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:57.027068 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e3eef9f6-5aec-4252-8921-4f10198ddd9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:57.027809 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-179ade56-fa34-4fc5-b8c3-81e2d93add23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:57.034289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e3eef9f6-5aec-4252-8921-4f10198ddd9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:57.034751 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e3eef9f6-5aec-4252-8921-4f10198ddd9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:57.035525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e3eef9f6-5aec-4252-8921-4f10198ddd9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:57.035967 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e3eef9f6-5aec-4252-8921-4f10198ddd9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:57.036341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-179ade56-fa34-4fc5-b8c3-81e2d93add23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148595 Aug 04 04:59:57.036910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 938/1875] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:56 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:57.164210 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e3eef9f6-5aec-4252-8921-4f10198ddd9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:57.172315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e3eef9f6-5aec-4252-8921-4f10198ddd9a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149789 Aug 04 04:59:57.172870 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 938/1876] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:57 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:57.317439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-49f840f6-566e-42b2-b480-f366d7c3e129 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:57.318074 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-49f840f6-566e-42b2-b480-f366d7c3e129 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:57.324017 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-49f840f6-566e-42b2-b480-f366d7c3e129 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:57.324462 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-49f840f6-566e-42b2-b480-f366d7c3e129 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:57.325952 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-49f840f6-566e-42b2-b480-f366d7c3e129 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:57.326399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-49f840f6-566e-42b2-b480-f366d7c3e129 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:57.390425 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-49f840f6-566e-42b2-b480-f366d7c3e129 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:57.398876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-49f840f6-566e-42b2-b480-f366d7c3e129 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085475 Aug 04 04:59:57.399428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 939/1877] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:57 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:58.057956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-42c8c64f-2730-47b5-b061-63a74663bf67 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:58.058568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-42c8c64f-2730-47b5-b061-63a74663bf67 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:58.066625 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-42c8c64f-2730-47b5-b061-63a74663bf67 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:58.067074 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-42c8c64f-2730-47b5-b061-63a74663bf67 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:58.067835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-42c8c64f-2730-47b5-b061-63a74663bf67 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:58.068266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-42c8c64f-2730-47b5-b061-63a74663bf67 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:58.194167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fb6fb080-71e1-4701-ac7e-956eb839b47c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:58.194777 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fb6fb080-71e1-4701-ac7e-956eb839b47c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:58.197242 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=72 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:58.200442 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-42c8c64f-2730-47b5-b061-63a74663bf67 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:58.202949 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fb6fb080-71e1-4701-ac7e-956eb839b47c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:58.203410 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fb6fb080-71e1-4701-ac7e-956eb839b47c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:58.204205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fb6fb080-71e1-4701-ac7e-956eb839b47c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:58.204648 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fb6fb080-71e1-4701-ac7e-956eb839b47c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:58.208987 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-42c8c64f-2730-47b5-b061-63a74663bf67 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154841 Aug 04 04:59:58.209570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 939/1878] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:58 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:58.336023 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fb6fb080-71e1-4701-ac7e-956eb839b47c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:58.343819 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fb6fb080-71e1-4701-ac7e-956eb839b47c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.154173 Aug 04 04:59:58.344372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 940/1879] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:58 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:58.420420 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e4203033-23a3-4cf8-b0ef-1cb8fb058b83 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:58.420954 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e4203033-23a3-4cf8-b0ef-1cb8fb058b83 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:58.423059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=80 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:59:58.428567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e4203033-23a3-4cf8-b0ef-1cb8fb058b83 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:58.429004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e4203033-23a3-4cf8-b0ef-1cb8fb058b83 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:58.429805 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e4203033-23a3-4cf8-b0ef-1cb8fb058b83 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:58.430244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e4203033-23a3-4cf8-b0ef-1cb8fb058b83 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:58.493093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e4203033-23a3-4cf8-b0ef-1cb8fb058b83 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:58.501147 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e4203033-23a3-4cf8-b0ef-1cb8fb058b83 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084616 Aug 04 04:59:58.501736 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 940/1880] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:58 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:59.230588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0b60faec-adcc-4da3-a5c3-3f9a28098df2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:59.231188 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0b60faec-adcc-4da3-a5c3-3f9a28098df2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:59.237948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b60faec-adcc-4da3-a5c3-3f9a28098df2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:59.238400 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b60faec-adcc-4da3-a5c3-3f9a28098df2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:59.239165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b60faec-adcc-4da3-a5c3-3f9a28098df2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:59.239596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0b60faec-adcc-4da3-a5c3-3f9a28098df2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:59.365681 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6adb790e-d1ad-402c-adb2-1422603d606e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:59.366561 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6adb790e-d1ad-402c-adb2-1422603d606e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:59.369269 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0b60faec-adcc-4da3-a5c3-3f9a28098df2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:59.373014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6adb790e-d1ad-402c-adb2-1422603d606e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:59.373460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6adb790e-d1ad-402c-adb2-1422603d606e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:59.374255 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6adb790e-d1ad-402c-adb2-1422603d606e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:59.374690 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6adb790e-d1ad-402c-adb2-1422603d606e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:59.378252 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0b60faec-adcc-4da3-a5c3-3f9a28098df2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.150510 Aug 04 04:59:59.378629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 941/1881] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:59 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 04:59:59.504770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6adb790e-d1ad-402c-adb2-1422603d606e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:59.512705 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6adb790e-d1ad-402c-adb2-1422603d606e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150856 Aug 04 04:59:59.513266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 941/1882] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:59 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 04:59:59.523301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-443d9bcb-d598-48ae-90f2-00778927b198 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 04:59:59.523912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-443d9bcb-d598-48ae-90f2-00778927b198 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 04:59:59.529864 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-443d9bcb-d598-48ae-90f2-00778927b198 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:59.530313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-443d9bcb-d598-48ae-90f2-00778927b198 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:59.531063 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-443d9bcb-d598-48ae-90f2-00778927b198 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 04:59:59.531495 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-443d9bcb-d598-48ae-90f2-00778927b198 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 04:59:59.595646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-443d9bcb-d598-48ae-90f2-00778927b198 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 04:59:59.603565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-443d9bcb-d598-48ae-90f2-00778927b198 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084316 Aug 04 04:59:59.604124 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 942/1883] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 04:59:59 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:00.400221 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-897501d2-88c7-408f-aac1-7a20f9b192cb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:00.400836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-897501d2-88c7-408f-aac1-7a20f9b192cb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:00.407363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-897501d2-88c7-408f-aac1-7a20f9b192cb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:00.407811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-897501d2-88c7-408f-aac1-7a20f9b192cb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:00.409768 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-897501d2-88c7-408f-aac1-7a20f9b192cb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:00.410212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-897501d2-88c7-408f-aac1-7a20f9b192cb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:00.535507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1a8ba4aa-82f0-4909-b693-665364f550ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:00.536130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1a8ba4aa-82f0-4909-b693-665364f550ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:00.540126 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-897501d2-88c7-408f-aac1-7a20f9b192cb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:00.542803 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a8ba4aa-82f0-4909-b693-665364f550ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:00.543260 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a8ba4aa-82f0-4909-b693-665364f550ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:00.544039 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a8ba4aa-82f0-4909-b693-665364f550ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:00.544479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a8ba4aa-82f0-4909-b693-665364f550ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:00.548558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-897501d2-88c7-408f-aac1-7a20f9b192cb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.152196 Aug 04 05:00:00.549284 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 942/1884] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:00 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:00.624843 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8a61b74d-8df8-4330-9d66-1d17621f0e32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:00.625479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8a61b74d-8df8-4330-9d66-1d17621f0e32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:00.632932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a61b74d-8df8-4330-9d66-1d17621f0e32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:00.633513 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a61b74d-8df8-4330-9d66-1d17621f0e32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:00.634314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a61b74d-8df8-4330-9d66-1d17621f0e32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:00.634755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a61b74d-8df8-4330-9d66-1d17621f0e32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:00.686081 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1a8ba4aa-82f0-4909-b693-665364f550ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:00.695119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1a8ba4aa-82f0-4909-b693-665364f550ca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.164314 Aug 04 05:00:00.695925 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 943/1885] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:00 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:00.706210 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8a61b74d-8df8-4330-9d66-1d17621f0e32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:00.714288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8a61b74d-8df8-4330-9d66-1d17621f0e32 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.093287 Aug 04 05:00:00.714849 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 943/1886] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:00 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:01.569723 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7560257e-e6c9-4dfc-b8b5-b7204a1ada1c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:01.570379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7560257e-e6c9-4dfc-b8b5-b7204a1ada1c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:01.576786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7560257e-e6c9-4dfc-b8b5-b7204a1ada1c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:01.577227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7560257e-e6c9-4dfc-b8b5-b7204a1ada1c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:01.578014 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7560257e-e6c9-4dfc-b8b5-b7204a1ada1c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:01.578443 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7560257e-e6c9-4dfc-b8b5-b7204a1ada1c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:01.713751 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7560257e-e6c9-4dfc-b8b5-b7204a1ada1c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:01.717345 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-230ae228-b78d-4623-8dfd-bdc45bf6a0dd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:01.717991 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-230ae228-b78d-4623-8dfd-bdc45bf6a0dd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:01.722284 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7560257e-e6c9-4dfc-b8b5-b7204a1ada1c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.156391 Aug 04 05:00:01.722853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 944/1887] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:01 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:01.725261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-230ae228-b78d-4623-8dfd-bdc45bf6a0dd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:01.725759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-230ae228-b78d-4623-8dfd-bdc45bf6a0dd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:01.726586 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-230ae228-b78d-4623-8dfd-bdc45bf6a0dd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:01.727024 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-230ae228-b78d-4623-8dfd-bdc45bf6a0dd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:01.734862 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-074267ae-1b1e-41a4-b242-9e7166ffcf02 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:01.735478 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-074267ae-1b1e-41a4-b242-9e7166ffcf02 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:01.742051 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-074267ae-1b1e-41a4-b242-9e7166ffcf02 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:01.742493 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-074267ae-1b1e-41a4-b242-9e7166ffcf02 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:01.743258 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-074267ae-1b1e-41a4-b242-9e7166ffcf02 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:01.743703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-074267ae-1b1e-41a4-b242-9e7166ffcf02 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:01.822415 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-074267ae-1b1e-41a4-b242-9e7166ffcf02 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:01.831060 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-074267ae-1b1e-41a4-b242-9e7166ffcf02 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.099633 Aug 04 05:00:01.831876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 945/1888] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:01 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:01.882022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-230ae228-b78d-4623-8dfd-bdc45bf6a0dd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:01.889897 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-230ae228-b78d-4623-8dfd-bdc45bf6a0dd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.176304 Aug 04 05:00:01.890449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 944/1889] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:01 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:02.743323 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6f560309-b38a-45d2-bf6d-4f0332b95941 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:02.743934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6f560309-b38a-45d2-bf6d-4f0332b95941 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:02.750409 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6f560309-b38a-45d2-bf6d-4f0332b95941 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:02.750879 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6f560309-b38a-45d2-bf6d-4f0332b95941 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:02.751628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6f560309-b38a-45d2-bf6d-4f0332b95941 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:02.752859 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6f560309-b38a-45d2-bf6d-4f0332b95941 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:02.852430 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eb31833d-eae8-4464-b363-2718b79f76b6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:02.853045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eb31833d-eae8-4464-b363-2718b79f76b6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:02.859475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb31833d-eae8-4464-b363-2718b79f76b6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:02.859922 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb31833d-eae8-4464-b363-2718b79f76b6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:02.860693 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb31833d-eae8-4464-b363-2718b79f76b6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:02.861179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb31833d-eae8-4464-b363-2718b79f76b6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:02.881090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6f560309-b38a-45d2-bf6d-4f0332b95941 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:02.888975 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6f560309-b38a-45d2-bf6d-4f0332b95941 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149562 Aug 04 05:00:02.889559 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 946/1890] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:02 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:02.911246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-96b6f3ad-be9c-4f1c-8bef-20440f2b1c4c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:02.911865 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-96b6f3ad-be9c-4f1c-8bef-20440f2b1c4c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:02.917883 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96b6f3ad-be9c-4f1c-8bef-20440f2b1c4c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:02.918337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96b6f3ad-be9c-4f1c-8bef-20440f2b1c4c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:02.919104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96b6f3ad-be9c-4f1c-8bef-20440f2b1c4c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:02.919551 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-96b6f3ad-be9c-4f1c-8bef-20440f2b1c4c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:02.922774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-eb31833d-eae8-4464-b363-2718b79f76b6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:02.930891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eb31833d-eae8-4464-b363-2718b79f76b6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082279 Aug 04 05:00:02.931461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 945/1891] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:02 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:03.048264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-96b6f3ad-be9c-4f1c-8bef-20440f2b1c4c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:03.056365 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-96b6f3ad-be9c-4f1c-8bef-20440f2b1c4c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149115 Aug 04 05:00:03.056925 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 947/1892] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:02 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:03.910939 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4fef783a-87a7-4555-9a8b-d83e6fb86d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:03.911559 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4fef783a-87a7-4555-9a8b-d83e6fb86d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:03.918036 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fef783a-87a7-4555-9a8b-d83e6fb86d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:03.918500 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fef783a-87a7-4555-9a8b-d83e6fb86d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:03.919245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fef783a-87a7-4555-9a8b-d83e6fb86d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:03.919681 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fef783a-87a7-4555-9a8b-d83e6fb86d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:03.952293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a64b323f-fd3c-4a81-a8f9-5683cbf3a106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:03.952915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a64b323f-fd3c-4a81-a8f9-5683cbf3a106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:03.960000 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a64b323f-fd3c-4a81-a8f9-5683cbf3a106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:03.960460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a64b323f-fd3c-4a81-a8f9-5683cbf3a106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:03.961330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a64b323f-fd3c-4a81-a8f9-5683cbf3a106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:03.961799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a64b323f-fd3c-4a81-a8f9-5683cbf3a106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:04.038300 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a64b323f-fd3c-4a81-a8f9-5683cbf3a106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:04.040554 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:04.047987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a64b323f-fd3c-4a81-a8f9-5683cbf3a106 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.099519 Aug 04 05:00:04.049582 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 948/1893] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:03 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:04.069571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4fef783a-87a7-4555-9a8b-d83e6fb86d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:04.077654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2cd8cc31-55b9-4a1a-8f18-00548d9a1c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:04.077815 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4fef783a-87a7-4555-9a8b-d83e6fb86d92 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.171429 Aug 04 05:00:04.078276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2cd8cc31-55b9-4a1a-8f18-00548d9a1c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:04.078393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 946/1894] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:03 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:04.084625 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2cd8cc31-55b9-4a1a-8f18-00548d9a1c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:04.085076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2cd8cc31-55b9-4a1a-8f18-00548d9a1c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:04.085865 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2cd8cc31-55b9-4a1a-8f18-00548d9a1c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:04.086302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2cd8cc31-55b9-4a1a-8f18-00548d9a1c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:04.217123 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2cd8cc31-55b9-4a1a-8f18-00548d9a1c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:04.225224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2cd8cc31-55b9-4a1a-8f18-00548d9a1c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151371 Aug 04 05:00:04.225800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 949/1895] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:04 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:05.069461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-73c801ac-0a70-4284-b01a-cfea7210dfec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:05.070102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-73c801ac-0a70-4284-b01a-cfea7210dfec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:05.076624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73c801ac-0a70-4284-b01a-cfea7210dfec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:05.077071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73c801ac-0a70-4284-b01a-cfea7210dfec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:05.077856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73c801ac-0a70-4284-b01a-cfea7210dfec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:05.078289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-73c801ac-0a70-4284-b01a-cfea7210dfec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:05.098560 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2368c088-0896-4c45-83d1-8d98f390d51c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:05.099182 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2368c088-0896-4c45-83d1-8d98f390d51c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:05.105968 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2368c088-0896-4c45-83d1-8d98f390d51c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:05.106535 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2368c088-0896-4c45-83d1-8d98f390d51c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:05.107303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2368c088-0896-4c45-83d1-8d98f390d51c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:05.107736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2368c088-0896-4c45-83d1-8d98f390d51c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:05.138583 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-73c801ac-0a70-4284-b01a-cfea7210dfec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:05.147349 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-73c801ac-0a70-4284-b01a-cfea7210dfec tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081677 Aug 04 05:00:05.148038 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 947/1896] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:05 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:05.235005 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2368c088-0896-4c45-83d1-8d98f390d51c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:05.243654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2368c088-0896-4c45-83d1-8d98f390d51c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.148999 Aug 04 05:00:05.244217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 950/1897] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:05 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:05.246625 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-48ae1d82-b4f7-4af8-a116-e2b6ee924dd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:05.247240 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-48ae1d82-b4f7-4af8-a116-e2b6ee924dd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:05.253611 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48ae1d82-b4f7-4af8-a116-e2b6ee924dd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:05.254068 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48ae1d82-b4f7-4af8-a116-e2b6ee924dd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:05.254863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48ae1d82-b4f7-4af8-a116-e2b6ee924dd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:05.255300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-48ae1d82-b4f7-4af8-a116-e2b6ee924dd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:05.385597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-48ae1d82-b4f7-4af8-a116-e2b6ee924dd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:05.393814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-48ae1d82-b4f7-4af8-a116-e2b6ee924dd4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151141 Aug 04 05:00:05.394375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 948/1898] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:05 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:06.167915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3b07bf43-8310-40db-9dbc-4216bcccb077 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:06.169110 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3b07bf43-8310-40db-9dbc-4216bcccb077 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:06.175317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3b07bf43-8310-40db-9dbc-4216bcccb077 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:06.175764 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3b07bf43-8310-40db-9dbc-4216bcccb077 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:06.176543 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3b07bf43-8310-40db-9dbc-4216bcccb077 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:06.176960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3b07bf43-8310-40db-9dbc-4216bcccb077 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:06.241472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3b07bf43-8310-40db-9dbc-4216bcccb077 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:06.249367 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3b07bf43-8310-40db-9dbc-4216bcccb077 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085373 Aug 04 05:00:06.249950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 951/1899] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:06 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:06.264049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9da205f9-7065-4a5f-956a-a5165102cc27 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:06.264701 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9da205f9-7065-4a5f-956a-a5165102cc27 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:06.272199 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9da205f9-7065-4a5f-956a-a5165102cc27 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:06.272654 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9da205f9-7065-4a5f-956a-a5165102cc27 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:06.273418 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9da205f9-7065-4a5f-956a-a5165102cc27 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:06.273884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9da205f9-7065-4a5f-956a-a5165102cc27 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:06.407123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9da205f9-7065-4a5f-956a-a5165102cc27 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:06.414755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-054ac729-b598-436b-90f3-f5be00e6c093 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:06.415197 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9da205f9-7065-4a5f-956a-a5165102cc27 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.154941 Aug 04 05:00:06.415402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-054ac729-b598-436b-90f3-f5be00e6c093 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:06.415765 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 949/1900] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:06 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:06.421323 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-054ac729-b598-436b-90f3-f5be00e6c093 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:06.422094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-054ac729-b598-436b-90f3-f5be00e6c093 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:06.422928 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-054ac729-b598-436b-90f3-f5be00e6c093 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:06.423372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-054ac729-b598-436b-90f3-f5be00e6c093 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:06.552597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-054ac729-b598-436b-90f3-f5be00e6c093 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:06.560649 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-054ac729-b598-436b-90f3-f5be00e6c093 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149753 Aug 04 05:00:06.561206 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 952/1901] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:06 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:07.270977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1570a894-bebd-499e-b1d1-41812bf528e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:07.271632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1570a894-bebd-499e-b1d1-41812bf528e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:07.278109 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1570a894-bebd-499e-b1d1-41812bf528e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:07.278571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1570a894-bebd-499e-b1d1-41812bf528e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:07.279341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1570a894-bebd-499e-b1d1-41812bf528e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:07.279807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1570a894-bebd-499e-b1d1-41812bf528e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:07.341478 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1570a894-bebd-499e-b1d1-41812bf528e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:07.343685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:07.350986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1570a894-bebd-499e-b1d1-41812bf528e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084045 Aug 04 05:00:07.351547 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 950/1902] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:07 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:07.436969 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-270c2cf5-1aba-4493-986f-57613175982d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:07.437630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-270c2cf5-1aba-4493-986f-57613175982d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:07.444714 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-270c2cf5-1aba-4493-986f-57613175982d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:07.445169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-270c2cf5-1aba-4493-986f-57613175982d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:07.446066 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-270c2cf5-1aba-4493-986f-57613175982d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:07.446509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-270c2cf5-1aba-4493-986f-57613175982d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:07.578082 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-270c2cf5-1aba-4493-986f-57613175982d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:07.583249 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3e4443e1-4fa3-4c4d-a2d4-3c7d4efab391 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:07.583863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3e4443e1-4fa3-4c4d-a2d4-3c7d4efab391 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:07.586248 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-270c2cf5-1aba-4493-986f-57613175982d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.153081 Aug 04 05:00:07.586826 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 953/1903] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:07 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:07.590055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3e4443e1-4fa3-4c4d-a2d4-3c7d4efab391 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:07.590508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3e4443e1-4fa3-4c4d-a2d4-3c7d4efab391 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:07.591272 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3e4443e1-4fa3-4c4d-a2d4-3c7d4efab391 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:07.591713 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3e4443e1-4fa3-4c4d-a2d4-3c7d4efab391 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:07.719673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3e4443e1-4fa3-4c4d-a2d4-3c7d4efab391 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:07.728085 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3e4443e1-4fa3-4c4d-a2d4-3c7d4efab391 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149175 Aug 04 05:00:07.728642 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 951/1904] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:07 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:08.372391 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2d3d48fe-e690-495b-bd6e-8e67500b2884 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:08.373015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2d3d48fe-e690-495b-bd6e-8e67500b2884 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:08.379114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d3d48fe-e690-495b-bd6e-8e67500b2884 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.379570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d3d48fe-e690-495b-bd6e-8e67500b2884 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.380338 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d3d48fe-e690-495b-bd6e-8e67500b2884 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.380779 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d3d48fe-e690-495b-bd6e-8e67500b2884 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.442561 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2d3d48fe-e690-495b-bd6e-8e67500b2884 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:08.450903 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2d3d48fe-e690-495b-bd6e-8e67500b2884 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082462 Aug 04 05:00:08.451461 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 954/1905] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:08.607398 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4be5e503-0645-4cdf-8f28-f3c91f22b9ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:08.608019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4be5e503-0645-4cdf-8f28-f3c91f22b9ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:08.615498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4be5e503-0645-4cdf-8f28-f3c91f22b9ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.615952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4be5e503-0645-4cdf-8f28-f3c91f22b9ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.616717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4be5e503-0645-4cdf-8f28-f3c91f22b9ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.617155 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4be5e503-0645-4cdf-8f28-f3c91f22b9ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.748637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4be5e503-0645-4cdf-8f28-f3c91f22b9ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:08.750217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-312ddf03-70f7-4681-97ae-326706a93a72 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:08.750861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-312ddf03-70f7-4681-97ae-326706a93a72 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:08.757391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4be5e503-0645-4cdf-8f28-f3c91f22b9ad tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.153764 Aug 04 05:00:08.757614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-312ddf03-70f7-4681-97ae-326706a93a72 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.757893 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-312ddf03-70f7-4681-97ae-326706a93a72 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.758014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 952/1906] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:08 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:08.758657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-312ddf03-70f7-4681-97ae-326706a93a72 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:08.759091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-312ddf03-70f7-4681-97ae-326706a93a72 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:08.885185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-312ddf03-70f7-4681-97ae-326706a93a72 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:08.893046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-312ddf03-70f7-4681-97ae-326706a93a72 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.146694 Aug 04 05:00:08.893619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 955/1907] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:08 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:09.472310 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1c0eef7e-cfee-4990-adea-75fde160f6c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:09.472915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1c0eef7e-cfee-4990-adea-75fde160f6c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:09.479054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c0eef7e-cfee-4990-adea-75fde160f6c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:09.479499 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c0eef7e-cfee-4990-adea-75fde160f6c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:09.480249 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c0eef7e-cfee-4990-adea-75fde160f6c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:09.480682 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c0eef7e-cfee-4990-adea-75fde160f6c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:09.543613 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1c0eef7e-cfee-4990-adea-75fde160f6c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:09.552174 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1c0eef7e-cfee-4990-adea-75fde160f6c1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084367 Aug 04 05:00:09.552736 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 953/1908] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:09 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:09.779161 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7e5dd66e-161d-4d12-b78b-52ef924a7010 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:09.779731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7e5dd66e-161d-4d12-b78b-52ef924a7010 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:09.786363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7e5dd66e-161d-4d12-b78b-52ef924a7010 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:09.786820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7e5dd66e-161d-4d12-b78b-52ef924a7010 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:09.787585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7e5dd66e-161d-4d12-b78b-52ef924a7010 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:09.788023 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7e5dd66e-161d-4d12-b78b-52ef924a7010 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:09.913985 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3732106b-f6c0-4ced-8ac8-6de44876723b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:09.914694 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3732106b-f6c0-4ced-8ac8-6de44876723b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:09.920352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7e5dd66e-161d-4d12-b78b-52ef924a7010 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:09.921749 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3732106b-f6c0-4ced-8ac8-6de44876723b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:09.922201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3732106b-f6c0-4ced-8ac8-6de44876723b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:09.922971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3732106b-f6c0-4ced-8ac8-6de44876723b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:09.923408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3732106b-f6c0-4ced-8ac8-6de44876723b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:09.928584 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7e5dd66e-161d-4d12-b78b-52ef924a7010 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.153363 Aug 04 05:00:09.929160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 956/1909] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:09 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:10.050929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3732106b-f6c0-4ced-8ac8-6de44876723b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:10.058825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3732106b-f6c0-4ced-8ac8-6de44876723b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148787 Aug 04 05:00:10.059389 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 954/1910] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:09 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:10.572878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9ebe2b18-34ca-4c40-b487-3581d0e6d3e1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:10.573516 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9ebe2b18-34ca-4c40-b487-3581d0e6d3e1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:10.579566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ebe2b18-34ca-4c40-b487-3581d0e6d3e1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:10.580255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ebe2b18-34ca-4c40-b487-3581d0e6d3e1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:10.580844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ebe2b18-34ca-4c40-b487-3581d0e6d3e1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:10.581282 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ebe2b18-34ca-4c40-b487-3581d0e6d3e1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:10.648426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9ebe2b18-34ca-4c40-b487-3581d0e6d3e1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:10.656434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9ebe2b18-34ca-4c40-b487-3581d0e6d3e1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.087510 Aug 04 05:00:10.656988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 957/1911] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:10.951322 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f262949e-36f5-446f-bba4-9c07862a7223 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:10.951927 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f262949e-36f5-446f-bba4-9c07862a7223 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:10.959008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f262949e-36f5-446f-bba4-9c07862a7223 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:10.959470 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f262949e-36f5-446f-bba4-9c07862a7223 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:10.960211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f262949e-36f5-446f-bba4-9c07862a7223 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:10.960680 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f262949e-36f5-446f-bba4-9c07862a7223 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:11.081322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f7bbb005-06ee-43ef-8ce0-fa33e67524c0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:11.081998 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f7bbb005-06ee-43ef-8ce0-fa33e67524c0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:11.088706 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f7bbb005-06ee-43ef-8ce0-fa33e67524c0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:11.089160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f7bbb005-06ee-43ef-8ce0-fa33e67524c0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:11.089988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f7bbb005-06ee-43ef-8ce0-fa33e67524c0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:11.090427 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f7bbb005-06ee-43ef-8ce0-fa33e67524c0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:11.389524 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f262949e-36f5-446f-bba4-9c07862a7223 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:11.398507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f262949e-36f5-446f-bba4-9c07862a7223 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.451009 Aug 04 05:00:11.399289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 955/1912] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:10 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:11.412340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f7bbb005-06ee-43ef-8ce0-fa33e67524c0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:11.420549 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f7bbb005-06ee-43ef-8ce0-fa33e67524c0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.344022 Aug 04 05:00:11.421176 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 958/1913] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:11 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:11.678725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-264a4645-739a-4c2f-baa6-30193b01661c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:11.679256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-264a4645-739a-4c2f-baa6-30193b01661c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:11.685479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-264a4645-739a-4c2f-baa6-30193b01661c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:11.685970 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-264a4645-739a-4c2f-baa6-30193b01661c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:11.686761 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-264a4645-739a-4c2f-baa6-30193b01661c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:11.687198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-264a4645-739a-4c2f-baa6-30193b01661c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:11.749258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-264a4645-739a-4c2f-baa6-30193b01661c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:11.757253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-264a4645-739a-4c2f-baa6-30193b01661c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082515 Aug 04 05:00:11.757859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 956/1914] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:11 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:12.420299 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-795cf067-f998-4ef5-b15c-1b10e4401d53 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:12.420892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-795cf067-f998-4ef5-b15c-1b10e4401d53 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:12.427905 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-795cf067-f998-4ef5-b15c-1b10e4401d53 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:12.428351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-795cf067-f998-4ef5-b15c-1b10e4401d53 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:12.429122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-795cf067-f998-4ef5-b15c-1b10e4401d53 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:12.429567 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-795cf067-f998-4ef5-b15c-1b10e4401d53 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:12.443879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a5999f88-9de2-4ac0-a0ce-8f948719cb87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:12.444500 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a5999f88-9de2-4ac0-a0ce-8f948719cb87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:12.451121 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a5999f88-9de2-4ac0-a0ce-8f948719cb87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:12.451574 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a5999f88-9de2-4ac0-a0ce-8f948719cb87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:12.452341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a5999f88-9de2-4ac0-a0ce-8f948719cb87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:12.452776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a5999f88-9de2-4ac0-a0ce-8f948719cb87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:12.632840 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-795cf067-f998-4ef5-b15c-1b10e4401d53 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:12.639805 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a5999f88-9de2-4ac0-a0ce-8f948719cb87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:12.641159 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-795cf067-f998-4ef5-b15c-1b10e4401d53 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.224795 Aug 04 05:00:12.642710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 959/1915] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:12 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:12.648500 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a5999f88-9de2-4ac0-a0ce-8f948719cb87 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.209560 Aug 04 05:00:12.649320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 957/1916] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:12.777864 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a5c859e1-1c81-4426-b0f0-6e0411bd8f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:12.778484 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a5c859e1-1c81-4426-b0f0-6e0411bd8f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:12.785659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a5c859e1-1c81-4426-b0f0-6e0411bd8f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:12.786111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a5c859e1-1c81-4426-b0f0-6e0411bd8f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:12.786892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a5c859e1-1c81-4426-b0f0-6e0411bd8f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:12.787333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a5c859e1-1c81-4426-b0f0-6e0411bd8f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:12.854479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a5c859e1-1c81-4426-b0f0-6e0411bd8f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:12.864108 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a5c859e1-1c81-4426-b0f0-6e0411bd8f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.090192 Aug 04 05:00:12.864872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 960/1917] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:12 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:13.664063 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a2c015c0-df5e-4e0b-a306-82af7c1c825f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:13.664684 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a2c015c0-df5e-4e0b-a306-82af7c1c825f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:13.671294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a2c015c0-df5e-4e0b-a306-82af7c1c825f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:13.674410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a2c015c0-df5e-4e0b-a306-82af7c1c825f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:13.675343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a2c015c0-df5e-4e0b-a306-82af7c1c825f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:13.675785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a2c015c0-df5e-4e0b-a306-82af7c1c825f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:13.763308 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-aca9cac6-c9cd-439a-8f9d-64c5c6350f2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:13.764088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-aca9cac6-c9cd-439a-8f9d-64c5c6350f2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:13.770789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aca9cac6-c9cd-439a-8f9d-64c5c6350f2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:13.771245 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aca9cac6-c9cd-439a-8f9d-64c5c6350f2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:13.772020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aca9cac6-c9cd-439a-8f9d-64c5c6350f2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:13.772463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-aca9cac6-c9cd-439a-8f9d-64c5c6350f2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:13.807781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a2c015c0-df5e-4e0b-a306-82af7c1c825f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:13.816178 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a2c015c0-df5e-4e0b-a306-82af7c1c825f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.156054 Aug 04 05:00:13.816845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 958/1918] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:13 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:13.884132 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4dc75c16-9bb5-4cf8-9110-f29ee15f6635 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:13.884807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4dc75c16-9bb5-4cf8-9110-f29ee15f6635 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:13.890680 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4dc75c16-9bb5-4cf8-9110-f29ee15f6635 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:13.891129 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4dc75c16-9bb5-4cf8-9110-f29ee15f6635 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:13.892495 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4dc75c16-9bb5-4cf8-9110-f29ee15f6635 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:13.893078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4dc75c16-9bb5-4cf8-9110-f29ee15f6635 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:13.904408 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-aca9cac6-c9cd-439a-8f9d-64c5c6350f2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:13.913590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-aca9cac6-c9cd-439a-8f9d-64c5c6350f2f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.247176 Aug 04 05:00:13.914168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 961/1919] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:13 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:13.958085 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4dc75c16-9bb5-4cf8-9110-f29ee15f6635 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:13.966041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4dc75c16-9bb5-4cf8-9110-f29ee15f6635 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085593 Aug 04 05:00:13.966605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 959/1920] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:13 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:14.838099 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-18fe21c1-acf2-4cb2-b66e-dc55bf9c6546 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:14.838743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-18fe21c1-acf2-4cb2-b66e-dc55bf9c6546 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:14.845951 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18fe21c1-acf2-4cb2-b66e-dc55bf9c6546 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:14.846396 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18fe21c1-acf2-4cb2-b66e-dc55bf9c6546 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:14.847149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18fe21c1-acf2-4cb2-b66e-dc55bf9c6546 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:14.847578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18fe21c1-acf2-4cb2-b66e-dc55bf9c6546 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:14.935229 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7b5140d0-02fa-44d4-b0af-71f306a3bdce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:14.935974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7b5140d0-02fa-44d4-b0af-71f306a3bdce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:14.943403 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b5140d0-02fa-44d4-b0af-71f306a3bdce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:14.943946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b5140d0-02fa-44d4-b0af-71f306a3bdce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:14.944779 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b5140d0-02fa-44d4-b0af-71f306a3bdce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:14.945281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b5140d0-02fa-44d4-b0af-71f306a3bdce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:14.977042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-18fe21c1-acf2-4cb2-b66e-dc55bf9c6546 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:14.985601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-18fe21c1-acf2-4cb2-b66e-dc55bf9c6546 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151293 Aug 04 05:00:14.986858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 962/1921] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:14 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:14.991620 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1846a38f-fa4a-4739-aa7b-b780b3743615 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:14.992232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1846a38f-fa4a-4739-aa7b-b780b3743615 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:14.998157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1846a38f-fa4a-4739-aa7b-b780b3743615 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:14.998610 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1846a38f-fa4a-4739-aa7b-b780b3743615 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:14.999395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1846a38f-fa4a-4739-aa7b-b780b3743615 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:14.999835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1846a38f-fa4a-4739-aa7b-b780b3743615 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:15.078717 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1846a38f-fa4a-4739-aa7b-b780b3743615 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:15.087808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1846a38f-fa4a-4739-aa7b-b780b3743615 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.099979 Aug 04 05:00:15.088438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 963/1922] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:14 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:15.102152 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7b5140d0-02fa-44d4-b0af-71f306a3bdce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:15.109923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7b5140d0-02fa-44d4-b0af-71f306a3bdce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.178798 Aug 04 05:00:15.110477 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 960/1923] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:14 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:16.007785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-10010cc6-33e3-47c7-a85d-4f4a81591745 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:16.008395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-10010cc6-33e3-47c7-a85d-4f4a81591745 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:16.014939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-10010cc6-33e3-47c7-a85d-4f4a81591745 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:16.015382 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-10010cc6-33e3-47c7-a85d-4f4a81591745 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:16.016132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-10010cc6-33e3-47c7-a85d-4f4a81591745 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:16.016561 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-10010cc6-33e3-47c7-a85d-4f4a81591745 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:16.107990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ed1f9ae7-816b-4106-9a99-de685a777098 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:16.108597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ed1f9ae7-816b-4106-9a99-de685a777098 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:16.115682 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ed1f9ae7-816b-4106-9a99-de685a777098 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:16.116131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ed1f9ae7-816b-4106-9a99-de685a777098 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:16.116898 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ed1f9ae7-816b-4106-9a99-de685a777098 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:16.117326 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ed1f9ae7-816b-4106-9a99-de685a777098 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:16.145578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-10010cc6-33e3-47c7-a85d-4f4a81591745 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:16.153676 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-10010cc6-33e3-47c7-a85d-4f4a81591745 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149713 Aug 04 05:00:16.154248 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 964/1924] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:16 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:16.159548 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bf99e5ea-f721-40b9-aae3-e6d277ef4e0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:16.160172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bf99e5ea-f721-40b9-aae3-e6d277ef4e0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:16.166053 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bf99e5ea-f721-40b9-aae3-e6d277ef4e0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:16.166508 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bf99e5ea-f721-40b9-aae3-e6d277ef4e0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:16.167277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bf99e5ea-f721-40b9-aae3-e6d277ef4e0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:16.167717 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bf99e5ea-f721-40b9-aae3-e6d277ef4e0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:16.178686 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ed1f9ae7-816b-4106-9a99-de685a777098 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:16.183236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:16.186972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ed1f9ae7-816b-4106-9a99-de685a777098 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082650 Aug 04 05:00:16.187481 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 961/1925] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:16 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:16.304233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bf99e5ea-f721-40b9-aae3-e6d277ef4e0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:16.311355 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bf99e5ea-f721-40b9-aae3-e6d277ef4e0e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.156108 Aug 04 05:00:16.312023 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 965/1926] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:17.175676 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1dfaefb5-8106-403a-b9f7-dd1185390246 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:17.176275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1dfaefb5-8106-403a-b9f7-dd1185390246 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:17.182783 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1dfaefb5-8106-403a-b9f7-dd1185390246 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:17.183235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1dfaefb5-8106-403a-b9f7-dd1185390246 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:17.184063 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1dfaefb5-8106-403a-b9f7-dd1185390246 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:17.184499 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1dfaefb5-8106-403a-b9f7-dd1185390246 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:17.209157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-636f0c7c-e071-4d81-9406-53d913baf9a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:17.209803 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-636f0c7c-e071-4d81-9406-53d913baf9a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:17.216265 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-636f0c7c-e071-4d81-9406-53d913baf9a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:17.216712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-636f0c7c-e071-4d81-9406-53d913baf9a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:17.217479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-636f0c7c-e071-4d81-9406-53d913baf9a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:17.217942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-636f0c7c-e071-4d81-9406-53d913baf9a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:17.296805 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-636f0c7c-e071-4d81-9406-53d913baf9a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:17.305220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-636f0c7c-e071-4d81-9406-53d913baf9a7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.100732 Aug 04 05:00:17.305832 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 966/1927] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:17 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:17.333245 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2238d4ab-8870-423a-8bb9-570d0b8f7e62 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:17.333897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2238d4ab-8870-423a-8bb9-570d0b8f7e62 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:17.334931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1dfaefb5-8106-403a-b9f7-dd1185390246 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:17.340125 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2238d4ab-8870-423a-8bb9-570d0b8f7e62 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:17.340576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2238d4ab-8870-423a-8bb9-570d0b8f7e62 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:17.341349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2238d4ab-8870-423a-8bb9-570d0b8f7e62 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:17.341813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2238d4ab-8870-423a-8bb9-570d0b8f7e62 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:17.342946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1dfaefb5-8106-403a-b9f7-dd1185390246 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.171443 Aug 04 05:00:17.343510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 962/1928] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:17 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:17.472619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2238d4ab-8870-423a-8bb9-570d0b8f7e62 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:17.480434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2238d4ab-8870-423a-8bb9-570d0b8f7e62 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151815 Aug 04 05:00:17.480988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 967/1929] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:17 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:18.326778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-47fcf92f-da93-4666-a865-e8fea77b9ac3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:18.327391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-47fcf92f-da93-4666-a865-e8fea77b9ac3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:18.333992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-47fcf92f-da93-4666-a865-e8fea77b9ac3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:18.334437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-47fcf92f-da93-4666-a865-e8fea77b9ac3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:18.335189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-47fcf92f-da93-4666-a865-e8fea77b9ac3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:18.335617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-47fcf92f-da93-4666-a865-e8fea77b9ac3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:18.364636 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f57a9c48-c981-4fa4-9ffa-5a920ffc3e5e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:18.365344 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f57a9c48-c981-4fa4-9ffa-5a920ffc3e5e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:18.371943 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f57a9c48-c981-4fa4-9ffa-5a920ffc3e5e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:18.372457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f57a9c48-c981-4fa4-9ffa-5a920ffc3e5e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:18.373220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f57a9c48-c981-4fa4-9ffa-5a920ffc3e5e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:18.373677 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f57a9c48-c981-4fa4-9ffa-5a920ffc3e5e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:18.396401 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-47fcf92f-da93-4666-a865-e8fea77b9ac3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:18.404332 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-47fcf92f-da93-4666-a865-e8fea77b9ac3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081319 Aug 04 05:00:18.404894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 963/1930] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:18 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:18.500710 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f57a9c48-c981-4fa4-9ffa-5a920ffc3e5e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:18.503584 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-77790630-5c63-46f3-b3ce-9c3f6b1e5604 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:18.504222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-77790630-5c63-46f3-b3ce-9c3f6b1e5604 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:18.509439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f57a9c48-c981-4fa4-9ffa-5a920ffc3e5e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.149187 Aug 04 05:00:18.510035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 968/1931] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:18 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:18.510481 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-77790630-5c63-46f3-b3ce-9c3f6b1e5604 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:18.511014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-77790630-5c63-46f3-b3ce-9c3f6b1e5604 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:18.511798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-77790630-5c63-46f3-b3ce-9c3f6b1e5604 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:18.512235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-77790630-5c63-46f3-b3ce-9c3f6b1e5604 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:18.643097 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-77790630-5c63-46f3-b3ce-9c3f6b1e5604 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:18.650954 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-77790630-5c63-46f3-b3ce-9c3f6b1e5604 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152589 Aug 04 05:00:18.651514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 964/1932] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:18 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:19.425775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-95baf504-bee3-45d6-9023-2e0191947029 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:19.426395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-95baf504-bee3-45d6-9023-2e0191947029 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:19.432830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-95baf504-bee3-45d6-9023-2e0191947029 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:19.433277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-95baf504-bee3-45d6-9023-2e0191947029 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:19.434082 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-95baf504-bee3-45d6-9023-2e0191947029 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:19.434516 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-95baf504-bee3-45d6-9023-2e0191947029 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:19.495695 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-95baf504-bee3-45d6-9023-2e0191947029 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:19.504534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-95baf504-bee3-45d6-9023-2e0191947029 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083235 Aug 04 05:00:19.505107 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 969/1933] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:19 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:19.530487 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f06c7304-1c19-4b7e-b047-9e295ae75df5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:19.531107 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f06c7304-1c19-4b7e-b047-9e295ae75df5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:19.538294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f06c7304-1c19-4b7e-b047-9e295ae75df5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:19.538807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f06c7304-1c19-4b7e-b047-9e295ae75df5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:19.539599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f06c7304-1c19-4b7e-b047-9e295ae75df5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:19.540039 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f06c7304-1c19-4b7e-b047-9e295ae75df5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:19.672979 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8c36becd-3047-413a-9183-d7f05d41ee13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:19.673773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8c36becd-3047-413a-9183-d7f05d41ee13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:19.681104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8c36becd-3047-413a-9183-d7f05d41ee13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:19.681497 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8c36becd-3047-413a-9183-d7f05d41ee13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:19.682298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8c36becd-3047-413a-9183-d7f05d41ee13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:19.682734 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8c36becd-3047-413a-9183-d7f05d41ee13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:19.686039 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f06c7304-1c19-4b7e-b047-9e295ae75df5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:19.694461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f06c7304-1c19-4b7e-b047-9e295ae75df5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.167809 Aug 04 05:00:19.695133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 965/1934] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:19 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:19.817085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8c36becd-3047-413a-9183-d7f05d41ee13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:19.829224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8c36becd-3047-413a-9183-d7f05d41ee13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.160923 Aug 04 05:00:19.829831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 970/1935] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:20.526510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-db2eb886-f905-4792-9ab0-66c5cc0fe65c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:20.527158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-db2eb886-f905-4792-9ab0-66c5cc0fe65c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:20.533211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db2eb886-f905-4792-9ab0-66c5cc0fe65c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:20.533860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db2eb886-f905-4792-9ab0-66c5cc0fe65c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:20.534434 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db2eb886-f905-4792-9ab0-66c5cc0fe65c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:20.534868 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-db2eb886-f905-4792-9ab0-66c5cc0fe65c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:20.596629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-db2eb886-f905-4792-9ab0-66c5cc0fe65c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:20.604511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-db2eb886-f905-4792-9ab0-66c5cc0fe65c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081850 Aug 04 05:00:20.605079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 966/1936] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:20 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:20.716395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-29caf498-938c-48d8-a718-922206e101df tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:20.717016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-29caf498-938c-48d8-a718-922206e101df tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:20.723471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29caf498-938c-48d8-a718-922206e101df tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:20.723917 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29caf498-938c-48d8-a718-922206e101df tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:20.724678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29caf498-938c-48d8-a718-922206e101df tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:20.725109 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29caf498-938c-48d8-a718-922206e101df tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:20.850986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2d11f1f9-e1a9-4553-920b-a7a6f99d23eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:20.851846 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2d11f1f9-e1a9-4553-920b-a7a6f99d23eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:20.855673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-29caf498-938c-48d8-a718-922206e101df tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:20.858234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2d11f1f9-e1a9-4553-920b-a7a6f99d23eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:20.858689 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2d11f1f9-e1a9-4553-920b-a7a6f99d23eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:20.859463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2d11f1f9-e1a9-4553-920b-a7a6f99d23eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:20.859903 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2d11f1f9-e1a9-4553-920b-a7a6f99d23eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:20.864277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-29caf498-938c-48d8-a718-922206e101df tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.151895 Aug 04 05:00:20.865087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 971/1937] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:20 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:20.875545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:20.992255 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2d11f1f9-e1a9-4553-920b-a7a6f99d23eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:21.000108 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2d11f1f9-e1a9-4553-920b-a7a6f99d23eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152956 Aug 04 05:00:21.000660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 967/1938] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:21.625606 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-03973c70-b2d5-43c6-970d-ff50335cd7c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:21.626222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-03973c70-b2d5-43c6-970d-ff50335cd7c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:21.632978 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03973c70-b2d5-43c6-970d-ff50335cd7c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:21.633424 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03973c70-b2d5-43c6-970d-ff50335cd7c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:21.634206 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03973c70-b2d5-43c6-970d-ff50335cd7c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:21.634639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-03973c70-b2d5-43c6-970d-ff50335cd7c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:21.701762 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-03973c70-b2d5-43c6-970d-ff50335cd7c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:21.709813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-03973c70-b2d5-43c6-970d-ff50335cd7c4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.088085 Aug 04 05:00:21.710408 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 972/1939] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:21 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:21.886427 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-697a78a6-7ddb-4f9b-8bf5-7371809632e9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:21.887031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-697a78a6-7ddb-4f9b-8bf5-7371809632e9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:21.894274 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-697a78a6-7ddb-4f9b-8bf5-7371809632e9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:21.894715 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-697a78a6-7ddb-4f9b-8bf5-7371809632e9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:21.895480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-697a78a6-7ddb-4f9b-8bf5-7371809632e9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:21.895908 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-697a78a6-7ddb-4f9b-8bf5-7371809632e9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:22.023089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-77cba29d-19b8-475b-bbbf-430fb1caaff6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:22.023804 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-77cba29d-19b8-475b-bbbf-430fb1caaff6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:22.030667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77cba29d-19b8-475b-bbbf-430fb1caaff6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:22.031124 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77cba29d-19b8-475b-bbbf-430fb1caaff6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:22.031906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77cba29d-19b8-475b-bbbf-430fb1caaff6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:22.032342 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77cba29d-19b8-475b-bbbf-430fb1caaff6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:22.215665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-77cba29d-19b8-475b-bbbf-430fb1caaff6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:22.224539 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-77cba29d-19b8-475b-bbbf-430fb1caaff6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.205360 Aug 04 05:00:22.225107 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 973/1940] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:22 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:22.259096 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-697a78a6-7ddb-4f9b-8bf5-7371809632e9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:22.266915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-697a78a6-7ddb-4f9b-8bf5-7371809632e9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.384279 Aug 04 05:00:22.268035 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 968/1941] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:21 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:22.731289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6b86978d-7910-42b3-83d0-8203641ca516 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:22.731930 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6b86978d-7910-42b3-83d0-8203641ca516 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:22.738235 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b86978d-7910-42b3-83d0-8203641ca516 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:22.738678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b86978d-7910-42b3-83d0-8203641ca516 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:22.739436 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b86978d-7910-42b3-83d0-8203641ca516 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:22.739867 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6b86978d-7910-42b3-83d0-8203641ca516 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:22.845137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6b86978d-7910-42b3-83d0-8203641ca516 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:22.853501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6b86978d-7910-42b3-83d0-8203641ca516 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.126104 Aug 04 05:00:22.854085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 974/1942] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:22 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:23.246218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5462fde7-3407-4212-8a6e-6019f3f039de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:23.246835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5462fde7-3407-4212-8a6e-6019f3f039de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:23.254041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5462fde7-3407-4212-8a6e-6019f3f039de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:23.254493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5462fde7-3407-4212-8a6e-6019f3f039de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:23.255256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5462fde7-3407-4212-8a6e-6019f3f039de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:23.255694 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5462fde7-3407-4212-8a6e-6019f3f039de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:23.288296 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a373d929-7332-4b83-a555-67e778211ef9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:23.288908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a373d929-7332-4b83-a555-67e778211ef9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:23.295207 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a373d929-7332-4b83-a555-67e778211ef9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:23.295651 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a373d929-7332-4b83-a555-67e778211ef9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:23.296684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a373d929-7332-4b83-a555-67e778211ef9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:23.297118 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a373d929-7332-4b83-a555-67e778211ef9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:23.445250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5462fde7-3407-4212-8a6e-6019f3f039de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:23.453271 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5462fde7-3407-4212-8a6e-6019f3f039de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.210893 Aug 04 05:00:23.453869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 969/1943] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:23 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:23.466307 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a373d929-7332-4b83-a555-67e778211ef9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:23.475020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a373d929-7332-4b83-a555-67e778211ef9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.190590 Aug 04 05:00:23.475573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 975/1944] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:23 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:23.874472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6892473d-b31b-4ed5-ac9f-aacb7674ee34 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:23.875081 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6892473d-b31b-4ed5-ac9f-aacb7674ee34 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:23.881216 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6892473d-b31b-4ed5-ac9f-aacb7674ee34 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:23.881688 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6892473d-b31b-4ed5-ac9f-aacb7674ee34 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:23.882436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6892473d-b31b-4ed5-ac9f-aacb7674ee34 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:23.882870 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6892473d-b31b-4ed5-ac9f-aacb7674ee34 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:23.943686 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6892473d-b31b-4ed5-ac9f-aacb7674ee34 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:23.951487 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6892473d-b31b-4ed5-ac9f-aacb7674ee34 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080922 Aug 04 05:00:23.952036 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 970/1945] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:23 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:24.473695 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d767abc1-06b6-4157-81ec-6daa950ca154 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:24.474325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d767abc1-06b6-4157-81ec-6daa950ca154 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:24.480745 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d767abc1-06b6-4157-81ec-6daa950ca154 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:24.481189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d767abc1-06b6-4157-81ec-6daa950ca154 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:24.481976 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d767abc1-06b6-4157-81ec-6daa950ca154 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:24.482408 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d767abc1-06b6-4157-81ec-6daa950ca154 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:24.496776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cb1c8fa9-bfcf-41c8-a603-21585221953a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:24.497398 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cb1c8fa9-bfcf-41c8-a603-21585221953a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:24.504162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb1c8fa9-bfcf-41c8-a603-21585221953a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:24.504671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb1c8fa9-bfcf-41c8-a603-21585221953a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:24.505454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb1c8fa9-bfcf-41c8-a603-21585221953a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:24.505967 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cb1c8fa9-bfcf-41c8-a603-21585221953a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:24.690130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d767abc1-06b6-4157-81ec-6daa950ca154 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:24.694674 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-cb1c8fa9-bfcf-41c8-a603-21585221953a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:24.698245 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d767abc1-06b6-4157-81ec-6daa950ca154 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.228507 Aug 04 05:00:24.698808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 976/1946] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:24 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:24.702813 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cb1c8fa9-bfcf-41c8-a603-21585221953a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.210039 Aug 04 05:00:24.703441 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 971/1947] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:24 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:24.973442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-847dfb39-6436-4110-ab8a-3e5b5c3d0aaf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:24.974105 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-847dfb39-6436-4110-ab8a-3e5b5c3d0aaf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:24.980167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-847dfb39-6436-4110-ab8a-3e5b5c3d0aaf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:24.980605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-847dfb39-6436-4110-ab8a-3e5b5c3d0aaf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:24.981354 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-847dfb39-6436-4110-ab8a-3e5b5c3d0aaf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:24.981811 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-847dfb39-6436-4110-ab8a-3e5b5c3d0aaf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:25.044225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-847dfb39-6436-4110-ab8a-3e5b5c3d0aaf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:25.052618 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-847dfb39-6436-4110-ab8a-3e5b5c3d0aaf tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083602 Aug 04 05:00:25.053180 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 977/1948] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:24 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:25.719895 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b3a4ae97-5d61-4081-80df-7a29f2ac088d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:25.720510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b3a4ae97-5d61-4081-80df-7a29f2ac088d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:25.724065 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6148e36b-db86-43ae-9c2e-36d6955564e1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:25.724681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6148e36b-db86-43ae-9c2e-36d6955564e1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:25.727343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b3a4ae97-5d61-4081-80df-7a29f2ac088d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:25.728186 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b3a4ae97-5d61-4081-80df-7a29f2ac088d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:25.728555 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b3a4ae97-5d61-4081-80df-7a29f2ac088d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:25.728991 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b3a4ae97-5d61-4081-80df-7a29f2ac088d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:25.731195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6148e36b-db86-43ae-9c2e-36d6955564e1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:25.731642 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6148e36b-db86-43ae-9c2e-36d6955564e1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:25.732394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6148e36b-db86-43ae-9c2e-36d6955564e1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:25.732826 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6148e36b-db86-43ae-9c2e-36d6955564e1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:25.924962 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6148e36b-db86-43ae-9c2e-36d6955564e1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:25.928211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b3a4ae97-5d61-4081-80df-7a29f2ac088d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:25.933036 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6148e36b-db86-43ae-9c2e-36d6955564e1 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.212905 Aug 04 05:00:25.933756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 978/1949] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:25 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:25.936181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b3a4ae97-5d61-4081-80df-7a29f2ac088d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.220185 Aug 04 05:00:25.936725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 972/1950] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:25 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:26.074498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fa12b008-b3fb-49a2-9886-00ae1f3a202c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:26.075120 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fa12b008-b3fb-49a2-9886-00ae1f3a202c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:26.081426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa12b008-b3fb-49a2-9886-00ae1f3a202c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:26.081899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa12b008-b3fb-49a2-9886-00ae1f3a202c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:26.082682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa12b008-b3fb-49a2-9886-00ae1f3a202c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:26.083118 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fa12b008-b3fb-49a2-9886-00ae1f3a202c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:26.146911 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fa12b008-b3fb-49a2-9886-00ae1f3a202c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:26.154799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fa12b008-b3fb-49a2-9886-00ae1f3a202c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084147 Aug 04 05:00:26.155369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 979/1951] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:26 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:26.954045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-782a3751-0fb4-4309-ba80-ae0833dd2cbe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:26.954712 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-782a3751-0fb4-4309-ba80-ae0833dd2cbe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:26.957487 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c762580a-3e55-4098-be9d-cd44a60b7fe2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:26.958144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c762580a-3e55-4098-be9d-cd44a60b7fe2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:26.962255 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-782a3751-0fb4-4309-ba80-ae0833dd2cbe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:26.962707 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-782a3751-0fb4-4309-ba80-ae0833dd2cbe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:26.963479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-782a3751-0fb4-4309-ba80-ae0833dd2cbe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:26.963914 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-782a3751-0fb4-4309-ba80-ae0833dd2cbe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:26.964554 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c762580a-3e55-4098-be9d-cd44a60b7fe2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:26.965052 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c762580a-3e55-4098-be9d-cd44a60b7fe2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:26.965857 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c762580a-3e55-4098-be9d-cd44a60b7fe2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:26.966285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c762580a-3e55-4098-be9d-cd44a60b7fe2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:27.157949 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-782a3751-0fb4-4309-ba80-ae0833dd2cbe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:27.161977 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c762580a-3e55-4098-be9d-cd44a60b7fe2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:27.166950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-782a3751-0fb4-4309-ba80-ae0833dd2cbe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.216708 Aug 04 05:00:27.167634 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 973/1952] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:26 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:27.170824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c762580a-3e55-4098-be9d-cd44a60b7fe2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.218063 Aug 04 05:00:27.171893 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 980/1953] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:26 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:27.177745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d2f63720-fabd-4a30-b440-a04371d05e7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:27.178371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d2f63720-fabd-4a30-b440-a04371d05e7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:27.184379 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2f63720-fabd-4a30-b440-a04371d05e7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:27.184825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2f63720-fabd-4a30-b440-a04371d05e7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:27.185609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2f63720-fabd-4a30-b440-a04371d05e7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:27.186051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2f63720-fabd-4a30-b440-a04371d05e7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:27.249314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d2f63720-fabd-4a30-b440-a04371d05e7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:27.258285 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d2f63720-fabd-4a30-b440-a04371d05e7a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085138 Aug 04 05:00:27.258836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 974/1954] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:27 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:28.188599 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1a1e4d4b-babb-4234-99ad-c6fb94bf62dd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:28.189134 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1a1e4d4b-babb-4234-99ad-c6fb94bf62dd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:28.194625 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-79068dcd-4be1-4a19-b822-95a63d65ac6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:28.195243 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-79068dcd-4be1-4a19-b822-95a63d65ac6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:28.195628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a1e4d4b-babb-4234-99ad-c6fb94bf62dd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:28.196071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a1e4d4b-babb-4234-99ad-c6fb94bf62dd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:28.196837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a1e4d4b-babb-4234-99ad-c6fb94bf62dd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:28.197267 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1a1e4d4b-babb-4234-99ad-c6fb94bf62dd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:28.201875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-79068dcd-4be1-4a19-b822-95a63d65ac6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:28.202359 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-79068dcd-4be1-4a19-b822-95a63d65ac6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:28.203121 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-79068dcd-4be1-4a19-b822-95a63d65ac6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:28.203560 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-79068dcd-4be1-4a19-b822-95a63d65ac6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:28.398322 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-79068dcd-4be1-4a19-b822-95a63d65ac6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:28.401190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1a1e4d4b-babb-4234-99ad-c6fb94bf62dd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:28.406821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-79068dcd-4be1-4a19-b822-95a63d65ac6b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215934 Aug 04 05:00:28.407382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 975/1955] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:28 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:28.409448 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1a1e4d4b-babb-4234-99ad-c6fb94bf62dd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.224778 Aug 04 05:00:28.410317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 981/1956] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:28 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:28.412491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b111f969-6da2-48f2-833c-9630ef20d6a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:28.413102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b111f969-6da2-48f2-833c-9630ef20d6a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:28.419025 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b111f969-6da2-48f2-833c-9630ef20d6a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:28.419473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b111f969-6da2-48f2-833c-9630ef20d6a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:28.420278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b111f969-6da2-48f2-833c-9630ef20d6a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:28.420706 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b111f969-6da2-48f2-833c-9630ef20d6a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:28.482343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b111f969-6da2-48f2-833c-9630ef20d6a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:28.491674 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b111f969-6da2-48f2-833c-9630ef20d6a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083349 Aug 04 05:00:28.492230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 976/1957] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:28 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:29.428736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c489ca8d-e877-4b84-ba98-c51e510e51c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:29.429356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c489ca8d-e877-4b84-ba98-c51e510e51c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:29.430560 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d9af6881-30db-4bac-8056-78ae673b0da3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:29.431188 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d9af6881-30db-4bac-8056-78ae673b0da3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:29.432760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=84 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:29.433619 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=74 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:29.436740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c489ca8d-e877-4b84-ba98-c51e510e51c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:29.437273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c489ca8d-e877-4b84-ba98-c51e510e51c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:29.438104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c489ca8d-e877-4b84-ba98-c51e510e51c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:29.438543 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c489ca8d-e877-4b84-ba98-c51e510e51c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:29.439053 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9af6881-30db-4bac-8056-78ae673b0da3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:29.439580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9af6881-30db-4bac-8056-78ae673b0da3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:29.440300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9af6881-30db-4bac-8056-78ae673b0da3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:29.440739 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9af6881-30db-4bac-8056-78ae673b0da3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:29.443520 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:29.636340 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d9af6881-30db-4bac-8056-78ae673b0da3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:29.643774 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c489ca8d-e877-4b84-ba98-c51e510e51c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:29.645114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d9af6881-30db-4bac-8056-78ae673b0da3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.218429 Aug 04 05:00:29.645722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 977/1958] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:29 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:29.650157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-97183da7-08e0-458d-a878-77929c31fac2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:29.650883 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-97183da7-08e0-458d-a878-77929c31fac2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:29.652006 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c489ca8d-e877-4b84-ba98-c51e510e51c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.227448 Aug 04 05:00:29.652717 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 982/1959] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:29 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:29.656614 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97183da7-08e0-458d-a878-77929c31fac2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:29.657793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97183da7-08e0-458d-a878-77929c31fac2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:29.658650 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97183da7-08e0-458d-a878-77929c31fac2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:29.659282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97183da7-08e0-458d-a878-77929c31fac2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:29.723245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-97183da7-08e0-458d-a878-77929c31fac2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:29.731138 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-97183da7-08e0-458d-a878-77929c31fac2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084477 Aug 04 05:00:29.731707 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 978/1960] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:29 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:30.666669 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-891e4f97-949f-4b6e-8a57-d9e4d2df80d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:30.667365 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-891e4f97-949f-4b6e-8a57-d9e4d2df80d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:30.672776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-44b1f27b-d063-4bdb-9319-8ff4b06f65d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:30.673397 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-44b1f27b-d063-4bdb-9319-8ff4b06f65d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:30.674735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-891e4f97-949f-4b6e-8a57-d9e4d2df80d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:30.675192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-891e4f97-949f-4b6e-8a57-d9e4d2df80d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:30.675970 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-891e4f97-949f-4b6e-8a57-d9e4d2df80d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:30.676411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-891e4f97-949f-4b6e-8a57-d9e4d2df80d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:30.680503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-44b1f27b-d063-4bdb-9319-8ff4b06f65d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:30.681014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-44b1f27b-d063-4bdb-9319-8ff4b06f65d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:30.681834 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-44b1f27b-d063-4bdb-9319-8ff4b06f65d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:30.682278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-44b1f27b-d063-4bdb-9319-8ff4b06f65d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:30.870255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-891e4f97-949f-4b6e-8a57-d9e4d2df80d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:30.876950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-44b1f27b-d063-4bdb-9319-8ff4b06f65d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:30.878418 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-891e4f97-949f-4b6e-8a57-d9e4d2df80d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.215662 Aug 04 05:00:30.879189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 983/1961] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:30 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:30.883621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-98374c52-f547-4b5e-92ee-eecc2d2df06a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:30.884248 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-98374c52-f547-4b5e-92ee-eecc2d2df06a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:30.884983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-44b1f27b-d063-4bdb-9319-8ff4b06f65d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.216203 Aug 04 05:00:30.885705 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 979/1962] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:30 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:30.890104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98374c52-f547-4b5e-92ee-eecc2d2df06a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:30.890558 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98374c52-f547-4b5e-92ee-eecc2d2df06a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:30.891325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98374c52-f547-4b5e-92ee-eecc2d2df06a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:30.891770 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-98374c52-f547-4b5e-92ee-eecc2d2df06a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:30.952773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-98374c52-f547-4b5e-92ee-eecc2d2df06a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:30.961228 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-98374c52-f547-4b5e-92ee-eecc2d2df06a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081212 Aug 04 05:00:30.961823 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 984/1963] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:30 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:31.899927 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2571b0ee-7c83-4188-b53e-2707b577359a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:31.902784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2571b0ee-7c83-4188-b53e-2707b577359a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:31.906309 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f8d444ca-8250-42e8-a5e6-e989e10b0c69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:31.907325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f8d444ca-8250-42e8-a5e6-e989e10b0c69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:31.907422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2571b0ee-7c83-4188-b53e-2707b577359a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:31.907761 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2571b0ee-7c83-4188-b53e-2707b577359a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:31.908588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2571b0ee-7c83-4188-b53e-2707b577359a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:31.909045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2571b0ee-7c83-4188-b53e-2707b577359a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:31.913407 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8d444ca-8250-42e8-a5e6-e989e10b0c69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:31.913878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8d444ca-8250-42e8-a5e6-e989e10b0c69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:31.914642 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8d444ca-8250-42e8-a5e6-e989e10b0c69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:31.915076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8d444ca-8250-42e8-a5e6-e989e10b0c69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:32.101622 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2571b0ee-7c83-4188-b53e-2707b577359a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:32.108479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f8d444ca-8250-42e8-a5e6-e989e10b0c69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:32.109497 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2571b0ee-7c83-4188-b53e-2707b577359a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.213433 Aug 04 05:00:32.110093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 980/1964] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:31 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:32.115205 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5ad2a5ae-6490-4e02-96e7-bbd3815d57d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:32.115819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5ad2a5ae-6490-4e02-96e7-bbd3815d57d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:32.117154 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f8d444ca-8250-42e8-a5e6-e989e10b0c69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.214746 Aug 04 05:00:32.122396 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ad2a5ae-6490-4e02-96e7-bbd3815d57d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:32.122942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ad2a5ae-6490-4e02-96e7-bbd3815d57d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:32.123788 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ad2a5ae-6490-4e02-96e7-bbd3815d57d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:32.124302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ad2a5ae-6490-4e02-96e7-bbd3815d57d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:32.128194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 985/1965] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:31 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:32.189022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5ad2a5ae-6490-4e02-96e7-bbd3815d57d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:32.197611 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5ad2a5ae-6490-4e02-96e7-bbd3815d57d0 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086543 Aug 04 05:00:32.198165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 981/1966] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:32 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:33.131888 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f325840c-535e-43f1-82fe-94540b4e2e11 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:33.132442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f325840c-535e-43f1-82fe-94540b4e2e11 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:33.138664 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-41a05168-51a6-42ad-8df9-352cd1426b3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:33.139154 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f325840c-535e-43f1-82fe-94540b4e2e11 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:33.139414 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-41a05168-51a6-42ad-8df9-352cd1426b3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:33.139568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f325840c-535e-43f1-82fe-94540b4e2e11 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:33.141797 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f325840c-535e-43f1-82fe-94540b4e2e11 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:33.142812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f325840c-535e-43f1-82fe-94540b4e2e11 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:33.146721 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-41a05168-51a6-42ad-8df9-352cd1426b3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:33.147181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-41a05168-51a6-42ad-8df9-352cd1426b3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:33.147956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-41a05168-51a6-42ad-8df9-352cd1426b3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:33.148394 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-41a05168-51a6-42ad-8df9-352cd1426b3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:33.343690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f325840c-535e-43f1-82fe-94540b4e2e11 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:33.346739 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-41a05168-51a6-42ad-8df9-352cd1426b3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:33.351899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f325840c-535e-43f1-82fe-94540b4e2e11 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.223995 Aug 04 05:00:33.352483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 986/1967] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:33 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:33.354750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-41a05168-51a6-42ad-8df9-352cd1426b3b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.219912 Aug 04 05:00:33.355446 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 982/1968] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:33 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:33.357572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f4c0830d-3241-4bc8-80f2-526905606c97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:33.358187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f4c0830d-3241-4bc8-80f2-526905606c97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:33.364011 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4c0830d-3241-4bc8-80f2-526905606c97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:33.364463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4c0830d-3241-4bc8-80f2-526905606c97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:33.365224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4c0830d-3241-4bc8-80f2-526905606c97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:33.365691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4c0830d-3241-4bc8-80f2-526905606c97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:33.426227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f4c0830d-3241-4bc8-80f2-526905606c97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:33.434163 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f4c0830d-3241-4bc8-80f2-526905606c97 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080742 Aug 04 05:00:33.434725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 987/1969] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:33 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:34.373472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-acbbad77-49d6-480d-b668-e1a16264d5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:34.374197 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-acbbad77-49d6-480d-b668-e1a16264d5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:34.375853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-22229d36-3f66-4c48-810b-a2874807a3de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:34.376496 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-22229d36-3f66-4c48-810b-a2874807a3de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:34.380806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-acbbad77-49d6-480d-b668-e1a16264d5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:34.381257 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-acbbad77-49d6-480d-b668-e1a16264d5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:34.382047 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-acbbad77-49d6-480d-b668-e1a16264d5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:34.382489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-acbbad77-49d6-480d-b668-e1a16264d5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:34.382999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-22229d36-3f66-4c48-810b-a2874807a3de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:34.383442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-22229d36-3f66-4c48-810b-a2874807a3de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:34.384200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-22229d36-3f66-4c48-810b-a2874807a3de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:34.384630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-22229d36-3f66-4c48-810b-a2874807a3de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:34.577881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-acbbad77-49d6-480d-b668-e1a16264d5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:34.582643 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-22229d36-3f66-4c48-810b-a2874807a3de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:34.586570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-acbbad77-49d6-480d-b668-e1a16264d5dc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.216930 Aug 04 05:00:34.587143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 983/1970] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:34 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:34.591558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5de2f4ff-7c60-499a-a01b-6db912de2cb9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:34.591830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-22229d36-3f66-4c48-810b-a2874807a3de tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.219821 Aug 04 05:00:34.592165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5de2f4ff-7c60-499a-a01b-6db912de2cb9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:34.593084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 988/1971] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:34 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:34.599530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5de2f4ff-7c60-499a-a01b-6db912de2cb9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:34.599978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5de2f4ff-7c60-499a-a01b-6db912de2cb9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:34.600737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5de2f4ff-7c60-499a-a01b-6db912de2cb9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:34.601172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5de2f4ff-7c60-499a-a01b-6db912de2cb9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:34.603764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:34.663597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5de2f4ff-7c60-499a-a01b-6db912de2cb9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:34.671723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5de2f4ff-7c60-499a-a01b-6db912de2cb9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083374 Aug 04 05:00:34.672286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 984/1972] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:34 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:35.608843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-601d80a0-5fa8-4f0c-9511-b9c972e91833 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:35.609441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-601d80a0-5fa8-4f0c-9511-b9c972e91833 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:35.613654 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f58093d8-922b-4437-94c6-aa7248b61d8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:35.614279 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f58093d8-922b-4437-94c6-aa7248b61d8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:35.616497 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-601d80a0-5fa8-4f0c-9511-b9c972e91833 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:35.616945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-601d80a0-5fa8-4f0c-9511-b9c972e91833 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:35.617754 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-601d80a0-5fa8-4f0c-9511-b9c972e91833 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:35.618169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-601d80a0-5fa8-4f0c-9511-b9c972e91833 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:35.620576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f58093d8-922b-4437-94c6-aa7248b61d8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:35.621031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f58093d8-922b-4437-94c6-aa7248b61d8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:35.621846 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f58093d8-922b-4437-94c6-aa7248b61d8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:35.622286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f58093d8-922b-4437-94c6-aa7248b61d8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:35.823889 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-601d80a0-5fa8-4f0c-9511-b9c972e91833 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:35.826885 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f58093d8-922b-4437-94c6-aa7248b61d8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:35.831788 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-601d80a0-5fa8-4f0c-9511-b9c972e91833 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.226846 Aug 04 05:00:35.832354 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 989/1973] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:35 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:35.835057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f58093d8-922b-4437-94c6-aa7248b61d8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.225782 Aug 04 05:00:35.835608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 985/1974] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:35 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:35.837207 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a2c9ed1c-dc43-4db8-80d1-28427f7ed9d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:35.838024 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a2c9ed1c-dc43-4db8-80d1-28427f7ed9d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:35.843597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2c9ed1c-dc43-4db8-80d1-28427f7ed9d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:35.844042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2c9ed1c-dc43-4db8-80d1-28427f7ed9d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:35.844792 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2c9ed1c-dc43-4db8-80d1-28427f7ed9d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:35.845769 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2c9ed1c-dc43-4db8-80d1-28427f7ed9d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:35.906059 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a2c9ed1c-dc43-4db8-80d1-28427f7ed9d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:35.914878 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a2c9ed1c-dc43-4db8-80d1-28427f7ed9d2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081373 Aug 04 05:00:35.915463 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 990/1975] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:35 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:36.852416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-aab84a62-f6d7-481e-930c-b3c37b20b672 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:36.853042 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-aab84a62-f6d7-481e-930c-b3c37b20b672 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:36.857998 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e636d98d-5da5-4a72-b8b1-b2d1a823e3f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:36.858610 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e636d98d-5da5-4a72-b8b1-b2d1a823e3f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:36.859697 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aab84a62-f6d7-481e-930c-b3c37b20b672 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:36.860141 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aab84a62-f6d7-481e-930c-b3c37b20b672 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:36.860954 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aab84a62-f6d7-481e-930c-b3c37b20b672 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:36.861731 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-aab84a62-f6d7-481e-930c-b3c37b20b672 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:36.865302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e636d98d-5da5-4a72-b8b1-b2d1a823e3f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:36.865787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e636d98d-5da5-4a72-b8b1-b2d1a823e3f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:36.866548 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e636d98d-5da5-4a72-b8b1-b2d1a823e3f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:36.867009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e636d98d-5da5-4a72-b8b1-b2d1a823e3f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:37.057400 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-aab84a62-f6d7-481e-930c-b3c37b20b672 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:37.060391 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e636d98d-5da5-4a72-b8b1-b2d1a823e3f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:37.066014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-aab84a62-f6d7-481e-930c-b3c37b20b672 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.217402 Aug 04 05:00:37.066666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 986/1976] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:36 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:37.069524 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e636d98d-5da5-4a72-b8b1-b2d1a823e3f9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215256 Aug 04 05:00:37.070261 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 991/1977] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:36 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:37.071324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d726572b-385c-4601-8cd9-3993499ef139 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:37.071943 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d726572b-385c-4601-8cd9-3993499ef139 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:37.078130 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d726572b-385c-4601-8cd9-3993499ef139 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:37.078585 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d726572b-385c-4601-8cd9-3993499ef139 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:37.079375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d726572b-385c-4601-8cd9-3993499ef139 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:37.080442 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d726572b-385c-4601-8cd9-3993499ef139 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:37.145021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d726572b-385c-4601-8cd9-3993499ef139 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:37.152902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d726572b-385c-4601-8cd9-3993499ef139 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085301 Aug 04 05:00:37.153457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 987/1978] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:37 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:38.087940 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4ae20f8d-ad04-44a7-8844-e56c4e62fbff tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:38.088584 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4ae20f8d-ad04-44a7-8844-e56c4e62fbff tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:38.095017 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4ae20f8d-ad04-44a7-8844-e56c4e62fbff tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:38.096047 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4ae20f8d-ad04-44a7-8844-e56c4e62fbff tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:38.096955 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4ae20f8d-ad04-44a7-8844-e56c4e62fbff tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:38.097387 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4ae20f8d-ad04-44a7-8844-e56c4e62fbff tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:38.148827 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5b84b5a0-1e95-4334-ba8f-e16db47afce3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:38.149425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5b84b5a0-1e95-4334-ba8f-e16db47afce3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:38.155938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b84b5a0-1e95-4334-ba8f-e16db47afce3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:38.156398 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b84b5a0-1e95-4334-ba8f-e16db47afce3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:38.157163 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b84b5a0-1e95-4334-ba8f-e16db47afce3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:38.157707 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5b84b5a0-1e95-4334-ba8f-e16db47afce3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:38.268237 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4ae20f8d-ad04-44a7-8844-e56c4e62fbff tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:38.276455 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4ae20f8d-ad04-44a7-8844-e56c4e62fbff tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.192326 Aug 04 05:00:38.277027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 992/1979] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:38 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:38.281641 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-667e016d-4f97-464f-b440-018afa6252df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:38.282311 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-667e016d-4f97-464f-b440-018afa6252df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:38.288804 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-667e016d-4f97-464f-b440-018afa6252df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:38.289479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-667e016d-4f97-464f-b440-018afa6252df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:38.290293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-667e016d-4f97-464f-b440-018afa6252df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:38.290735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-667e016d-4f97-464f-b440-018afa6252df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:38.314617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5b84b5a0-1e95-4334-ba8f-e16db47afce3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:38.322571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5b84b5a0-1e95-4334-ba8f-e16db47afce3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.177587 Aug 04 05:00:38.323139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 988/1980] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:38 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:38.352528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-667e016d-4f97-464f-b440-018afa6252df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:38.360379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-667e016d-4f97-464f-b440-018afa6252df tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082421 Aug 04 05:00:38.360980 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 993/1981] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:38 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:39.299137 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-86724b31-22c4-4059-b93d-b49639180c8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:39.299747 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-86724b31-22c4-4059-b93d-b49639180c8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:39.306319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86724b31-22c4-4059-b93d-b49639180c8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:39.306767 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86724b31-22c4-4059-b93d-b49639180c8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:39.307556 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86724b31-22c4-4059-b93d-b49639180c8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:39.307997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86724b31-22c4-4059-b93d-b49639180c8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:39.343831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-369a8f19-543c-4228-b45a-cf6ca1e7c91f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:39.344455 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-369a8f19-543c-4228-b45a-cf6ca1e7c91f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:39.351741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-369a8f19-543c-4228-b45a-cf6ca1e7c91f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:39.352208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-369a8f19-543c-4228-b45a-cf6ca1e7c91f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:39.352990 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-369a8f19-543c-4228-b45a-cf6ca1e7c91f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:39.353428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-369a8f19-543c-4228-b45a-cf6ca1e7c91f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:39.489886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-86724b31-22c4-4059-b93d-b49639180c8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:39.497799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-86724b31-22c4-4059-b93d-b49639180c8d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.203361 Aug 04 05:00:39.498362 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 989/1982] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:39 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:39.508820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2087c9fb-a566-4888-bb16-fd0b0194a5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:39.510093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2087c9fb-a566-4888-bb16-fd0b0194a5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:39.516621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-369a8f19-543c-4228-b45a-cf6ca1e7c91f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:39.516803 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2087c9fb-a566-4888-bb16-fd0b0194a5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:39.517929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2087c9fb-a566-4888-bb16-fd0b0194a5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:39.518833 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2087c9fb-a566-4888-bb16-fd0b0194a5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:39.519274 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2087c9fb-a566-4888-bb16-fd0b0194a5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:39.525752 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-369a8f19-543c-4228-b45a-cf6ca1e7c91f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.185682 Aug 04 05:00:39.526405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 994/1983] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:39 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:39.581302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2087c9fb-a566-4888-bb16-fd0b0194a5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:39.589233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2087c9fb-a566-4888-bb16-fd0b0194a5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.089927 Aug 04 05:00:39.589825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 990/1984] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:40.520237 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ecfec889-7ddf-468a-bfbe-715d2f4d343a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:40.520859 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ecfec889-7ddf-468a-bfbe-715d2f4d343a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:40.527364 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ecfec889-7ddf-468a-bfbe-715d2f4d343a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:40.527814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ecfec889-7ddf-468a-bfbe-715d2f4d343a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:40.528579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ecfec889-7ddf-468a-bfbe-715d2f4d343a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:40.529016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ecfec889-7ddf-468a-bfbe-715d2f4d343a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:40.547512 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-25a2a4b8-ef84-4288-94db-e971d2079964 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:40.548624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-25a2a4b8-ef84-4288-94db-e971d2079964 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:40.555412 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25a2a4b8-ef84-4288-94db-e971d2079964 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:40.555869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25a2a4b8-ef84-4288-94db-e971d2079964 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:40.556645 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25a2a4b8-ef84-4288-94db-e971d2079964 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:40.557097 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-25a2a4b8-ef84-4288-94db-e971d2079964 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:40.729261 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ecfec889-7ddf-468a-bfbe-715d2f4d343a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:40.733485 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-25a2a4b8-ef84-4288-94db-e971d2079964 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:40.737828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ecfec889-7ddf-468a-bfbe-715d2f4d343a tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.221559 Aug 04 05:00:40.738400 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 995/1985] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:40 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:40.742384 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-25a2a4b8-ef84-4288-94db-e971d2079964 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.199054 Aug 04 05:00:40.742820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b1afe524-571a-4f05-8af4-88b76f588b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:40.743196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 991/1986] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:40 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:40.743431 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b1afe524-571a-4f05-8af4-88b76f588b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:40.749246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1afe524-571a-4f05-8af4-88b76f588b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:40.749712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1afe524-571a-4f05-8af4-88b76f588b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:40.750478 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1afe524-571a-4f05-8af4-88b76f588b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:40.750922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1afe524-571a-4f05-8af4-88b76f588b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:40.817393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b1afe524-571a-4f05-8af4-88b76f588b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:40.825283 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b1afe524-571a-4f05-8af4-88b76f588b21 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085949 Aug 04 05:00:40.826000 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 996/1987] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:40 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:41.760057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7a60500b-48b1-4fc1-83a3-05c08f4eac4e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:41.760608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7a60500b-48b1-4fc1-83a3-05c08f4eac4e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:41.763888 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0356b674-391a-4649-a282-c765f8085331 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:41.764505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0356b674-391a-4649-a282-c765f8085331 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:41.768164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7a60500b-48b1-4fc1-83a3-05c08f4eac4e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:41.768611 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7a60500b-48b1-4fc1-83a3-05c08f4eac4e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:41.769372 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7a60500b-48b1-4fc1-83a3-05c08f4eac4e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:41.769835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7a60500b-48b1-4fc1-83a3-05c08f4eac4e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:41.771644 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0356b674-391a-4649-a282-c765f8085331 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:41.772095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0356b674-391a-4649-a282-c765f8085331 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:41.772850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0356b674-391a-4649-a282-c765f8085331 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:41.773285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0356b674-391a-4649-a282-c765f8085331 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:41.966359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0356b674-391a-4649-a282-c765f8085331 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:41.971277 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7a60500b-48b1-4fc1-83a3-05c08f4eac4e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:41.975335 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0356b674-391a-4649-a282-c765f8085331 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215282 Aug 04 05:00:41.975917 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 997/1988] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:41 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:41.979278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7a60500b-48b1-4fc1-83a3-05c08f4eac4e tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.223094 Aug 04 05:00:41.981650 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 992/1989] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:41 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:41.981805 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-107ba19c-13c3-4f19-9355-0b53e38da057 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:41.981805 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-107ba19c-13c3-4f19-9355-0b53e38da057 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:41.987432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-107ba19c-13c3-4f19-9355-0b53e38da057 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:41.987884 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-107ba19c-13c3-4f19-9355-0b53e38da057 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:41.988651 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-107ba19c-13c3-4f19-9355-0b53e38da057 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:41.989096 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-107ba19c-13c3-4f19-9355-0b53e38da057 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:42.053394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-107ba19c-13c3-4f19-9355-0b53e38da057 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:42.055544 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:42.062486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-107ba19c-13c3-4f19-9355-0b53e38da057 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085627 Aug 04 05:00:42.063046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 998/1990] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:41 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:42.996128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3c614cbb-0e00-4eeb-bbc4-7df62b5619d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:42.996751 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3c614cbb-0e00-4eeb-bbc4-7df62b5619d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:43.000043 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e6840ffd-66c8-4b6f-9dd8-ea904bf8eacd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:43.000653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e6840ffd-66c8-4b6f-9dd8-ea904bf8eacd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:43.004433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3c614cbb-0e00-4eeb-bbc4-7df62b5619d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:43.004884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3c614cbb-0e00-4eeb-bbc4-7df62b5619d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:43.005683 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3c614cbb-0e00-4eeb-bbc4-7df62b5619d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:43.006126 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3c614cbb-0e00-4eeb-bbc4-7df62b5619d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:43.007646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e6840ffd-66c8-4b6f-9dd8-ea904bf8eacd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:43.008085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e6840ffd-66c8-4b6f-9dd8-ea904bf8eacd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:43.008843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e6840ffd-66c8-4b6f-9dd8-ea904bf8eacd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:43.009274 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e6840ffd-66c8-4b6f-9dd8-ea904bf8eacd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:43.199119 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3c614cbb-0e00-4eeb-bbc4-7df62b5619d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:43.203297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e6840ffd-66c8-4b6f-9dd8-ea904bf8eacd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:43.207656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3c614cbb-0e00-4eeb-bbc4-7df62b5619d8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215393 Aug 04 05:00:43.208218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 993/1991] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:42 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:43.212129 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e6840ffd-66c8-4b6f-9dd8-ea904bf8eacd tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.216048 Aug 04 05:00:43.212896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a14f5a59-4474-4805-8852-6daefe4d38af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:43.213032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 999/1992] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:42 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:43.213309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a14f5a59-4474-4805-8852-6daefe4d38af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:43.219164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a14f5a59-4474-4805-8852-6daefe4d38af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:43.219621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a14f5a59-4474-4805-8852-6daefe4d38af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:43.221245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a14f5a59-4474-4805-8852-6daefe4d38af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:43.221807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a14f5a59-4474-4805-8852-6daefe4d38af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:43.281868 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a14f5a59-4474-4805-8852-6daefe4d38af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:43.290643 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a14f5a59-4474-4805-8852-6daefe4d38af tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081480 Aug 04 05:00:43.291203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 994/1993] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:43 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:44.228973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-935988ff-bfa2-4dd9-9c82-9ed9359c69a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:44.229675 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-935988ff-bfa2-4dd9-9c82-9ed9359c69a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:44.233898 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eac8af24-85da-4090-a9a6-6e4e3c7ce0b8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:44.234526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eac8af24-85da-4090-a9a6-6e4e3c7ce0b8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:44.237040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-935988ff-bfa2-4dd9-9c82-9ed9359c69a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:44.237492 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-935988ff-bfa2-4dd9-9c82-9ed9359c69a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:44.238302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-935988ff-bfa2-4dd9-9c82-9ed9359c69a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:44.238804 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-935988ff-bfa2-4dd9-9c82-9ed9359c69a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:44.242013 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eac8af24-85da-4090-a9a6-6e4e3c7ce0b8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:44.242473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eac8af24-85da-4090-a9a6-6e4e3c7ce0b8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:44.243240 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eac8af24-85da-4090-a9a6-6e4e3c7ce0b8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:44.243681 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eac8af24-85da-4090-a9a6-6e4e3c7ce0b8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:44.434194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-935988ff-bfa2-4dd9-9c82-9ed9359c69a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:44.437526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-eac8af24-85da-4090-a9a6-6e4e3c7ce0b8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:44.442944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-935988ff-bfa2-4dd9-9c82-9ed9359c69a6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.217946 Aug 04 05:00:44.443510 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1000/1994] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:44 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:44.447102 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eac8af24-85da-4090-a9a6-6e4e3c7ce0b8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.216988 Aug 04 05:00:44.447892 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 995/1995] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:44 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:44.448019 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d47e4eca-f7e6-422e-b99f-2cd8074acdc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:44.448714 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d47e4eca-f7e6-422e-b99f-2cd8074acdc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:44.454691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d47e4eca-f7e6-422e-b99f-2cd8074acdc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:44.455123 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d47e4eca-f7e6-422e-b99f-2cd8074acdc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:44.455882 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d47e4eca-f7e6-422e-b99f-2cd8074acdc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:44.456316 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d47e4eca-f7e6-422e-b99f-2cd8074acdc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:44.516652 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d47e4eca-f7e6-422e-b99f-2cd8074acdc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:44.524742 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d47e4eca-f7e6-422e-b99f-2cd8074acdc6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080287 Aug 04 05:00:44.525298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1001/1996] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:44 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:44.643977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:00:44.644164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:00:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:00:45.464425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dfe50fe6-52f3-4ca7-a71b-eaef1b73ddc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:45.465131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dfe50fe6-52f3-4ca7-a71b-eaef1b73ddc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:45.468036 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2d94bb50-b481-4210-bd54-3ba7fd9e9f70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:45.468659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2d94bb50-b481-4210-bd54-3ba7fd9e9f70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:45.472697 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dfe50fe6-52f3-4ca7-a71b-eaef1b73ddc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:45.473152 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dfe50fe6-52f3-4ca7-a71b-eaef1b73ddc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:45.473971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dfe50fe6-52f3-4ca7-a71b-eaef1b73ddc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:45.474414 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dfe50fe6-52f3-4ca7-a71b-eaef1b73ddc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:45.475296 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d94bb50-b481-4210-bd54-3ba7fd9e9f70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:45.475749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d94bb50-b481-4210-bd54-3ba7fd9e9f70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:45.476528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d94bb50-b481-4210-bd54-3ba7fd9e9f70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:45.476971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2d94bb50-b481-4210-bd54-3ba7fd9e9f70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:45.668377 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dfe50fe6-52f3-4ca7-a71b-eaef1b73ddc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:45.671664 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2d94bb50-b481-4210-bd54-3ba7fd9e9f70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:45.677133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dfe50fe6-52f3-4ca7-a71b-eaef1b73ddc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.216721 Aug 04 05:00:45.677721 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 996/1997] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:45 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:45.682185 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-91928675-a6b8-4bc6-92f9-0d9535d0c5e5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:45.682784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-91928675-a6b8-4bc6-92f9-0d9535d0c5e5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:45.687750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2d94bb50-b481-4210-bd54-3ba7fd9e9f70 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.223528 Aug 04 05:00:45.688612 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91928675-a6b8-4bc6-92f9-0d9535d0c5e5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:45.689421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1002/1998] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:45 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:45.689746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91928675-a6b8-4bc6-92f9-0d9535d0c5e5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:45.690635 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91928675-a6b8-4bc6-92f9-0d9535d0c5e5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:45.691239 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91928675-a6b8-4bc6-92f9-0d9535d0c5e5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:45.750378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-91928675-a6b8-4bc6-92f9-0d9535d0c5e5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:45.758811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-91928675-a6b8-4bc6-92f9-0d9535d0c5e5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080154 Aug 04 05:00:45.759364 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 997/1999] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:45 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:46.699099 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-69d0aa52-8f2c-4229-b6d2-6c42a6d050be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:46.699632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-69d0aa52-8f2c-4229-b6d2-6c42a6d050be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:46.706341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-69d0aa52-8f2c-4229-b6d2-6c42a6d050be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:46.706802 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-69d0aa52-8f2c-4229-b6d2-6c42a6d050be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:46.707570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-69d0aa52-8f2c-4229-b6d2-6c42a6d050be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:46.708045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-69d0aa52-8f2c-4229-b6d2-6c42a6d050be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:46.709422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6e6671a9-ce95-416d-a3a1-41c0aa6ebbb9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:46.710072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6e6671a9-ce95-416d-a3a1-41c0aa6ebbb9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:46.717282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6e6671a9-ce95-416d-a3a1-41c0aa6ebbb9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:46.717769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6e6671a9-ce95-416d-a3a1-41c0aa6ebbb9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:46.718540 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6e6671a9-ce95-416d-a3a1-41c0aa6ebbb9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:46.718971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6e6671a9-ce95-416d-a3a1-41c0aa6ebbb9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:46.908902 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-69d0aa52-8f2c-4229-b6d2-6c42a6d050be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:46.912626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6e6671a9-ce95-416d-a3a1-41c0aa6ebbb9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:46.916945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-69d0aa52-8f2c-4229-b6d2-6c42a6d050be tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.221776 Aug 04 05:00:46.917511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1003/2000] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:46 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:46.920825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6e6671a9-ce95-416d-a3a1-41c0aa6ebbb9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.215508 Aug 04 05:00:46.922048 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 998/2001] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:46 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:46.922208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3c86b1f9-bc4a-4054-8d6e-542bf4da91a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:46.922802 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3c86b1f9-bc4a-4054-8d6e-542bf4da91a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:46.928883 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3c86b1f9-bc4a-4054-8d6e-542bf4da91a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:46.929334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3c86b1f9-bc4a-4054-8d6e-542bf4da91a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:46.930139 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3c86b1f9-bc4a-4054-8d6e-542bf4da91a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:46.930577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3c86b1f9-bc4a-4054-8d6e-542bf4da91a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:46.995074 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3c86b1f9-bc4a-4054-8d6e-542bf4da91a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:47.003421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3c86b1f9-bc4a-4054-8d6e-542bf4da91a8 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084958 Aug 04 05:00:47.003980 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1004/2002] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:46 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:47.939812 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-454096bc-f586-4bfb-9b05-408e9ad157b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:47.940425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-454096bc-f586-4bfb-9b05-408e9ad157b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:47.943277 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ab4865d2-794f-4fb3-9484-766a9c77e909 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:47.943899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ab4865d2-794f-4fb3-9484-766a9c77e909 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:47.947066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-454096bc-f586-4bfb-9b05-408e9ad157b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:47.947512 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-454096bc-f586-4bfb-9b05-408e9ad157b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:47.948275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-454096bc-f586-4bfb-9b05-408e9ad157b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:47.948707 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-454096bc-f586-4bfb-9b05-408e9ad157b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:47.950584 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ab4865d2-794f-4fb3-9484-766a9c77e909 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:47.951039 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ab4865d2-794f-4fb3-9484-766a9c77e909 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:47.951801 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ab4865d2-794f-4fb3-9484-766a9c77e909 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:47.952236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ab4865d2-794f-4fb3-9484-766a9c77e909 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:48.136631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-454096bc-f586-4bfb-9b05-408e9ad157b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:48.145300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-454096bc-f586-4bfb-9b05-408e9ad157b5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.210007 Aug 04 05:00:48.145898 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 999/2003] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:47 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:48.147942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ab4865d2-794f-4fb3-9484-766a9c77e909 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:48.150300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-260fab3c-18cf-45fd-a917-d55830462f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:48.150905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-260fab3c-18cf-45fd-a917-d55830462f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:48.156308 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ab4865d2-794f-4fb3-9484-766a9c77e909 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.218019 Aug 04 05:00:48.156722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-260fab3c-18cf-45fd-a917-d55830462f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:48.158077 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-260fab3c-18cf-45fd-a917-d55830462f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:48.158280 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1005/2004] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:47 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:48.158579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-260fab3c-18cf-45fd-a917-d55830462f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:48.159112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-260fab3c-18cf-45fd-a917-d55830462f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:48.219462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-260fab3c-18cf-45fd-a917-d55830462f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:48.222419 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:48.229497 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-260fab3c-18cf-45fd-a917-d55830462f09 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082649 Aug 04 05:00:48.230256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1000/2005] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:48 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:48.249689 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:00:48.249846 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:00:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:00:49.166770 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1ff16e62-a21b-4bec-ba5c-7cad76cd8dc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:49.167426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1ff16e62-a21b-4bec-ba5c-7cad76cd8dc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:49.174830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ff16e62-a21b-4bec-ba5c-7cad76cd8dc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:49.175273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ff16e62-a21b-4bec-ba5c-7cad76cd8dc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:49.176031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ff16e62-a21b-4bec-ba5c-7cad76cd8dc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:49.176462 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ff16e62-a21b-4bec-ba5c-7cad76cd8dc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:49.178851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-af414af8-b0a4-4776-ad1f-9c798db3c9d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:49.179478 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-af414af8-b0a4-4776-ad1f-9c798db3c9d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:49.185942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-af414af8-b0a4-4776-ad1f-9c798db3c9d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:49.186402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-af414af8-b0a4-4776-ad1f-9c798db3c9d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:49.187176 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-af414af8-b0a4-4776-ad1f-9c798db3c9d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:49.187623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-af414af8-b0a4-4776-ad1f-9c798db3c9d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:49.606509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1ff16e62-a21b-4bec-ba5c-7cad76cd8dc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:49.611280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-af414af8-b0a4-4776-ad1f-9c798db3c9d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:49.615954 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1ff16e62-a21b-4bec-ba5c-7cad76cd8dc7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.452976 Aug 04 05:00:49.616526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1006/2006] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:49 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:49.619506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-af414af8-b0a4-4776-ad1f-9c798db3c9d8 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.444500 Aug 04 05:00:49.620246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1001/2007] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:49 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:49.621829 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-14f04b8f-7dbc-45bd-9858-d27239d6b724 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:49.622445 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-14f04b8f-7dbc-45bd-9858-d27239d6b724 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:49.628950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-14f04b8f-7dbc-45bd-9858-d27239d6b724 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:49.629398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-14f04b8f-7dbc-45bd-9858-d27239d6b724 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:49.630194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-14f04b8f-7dbc-45bd-9858-d27239d6b724 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:49.630760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-14f04b8f-7dbc-45bd-9858-d27239d6b724 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:49.691039 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-14f04b8f-7dbc-45bd-9858-d27239d6b724 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:49.698828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-14f04b8f-7dbc-45bd-9858-d27239d6b724 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081359 Aug 04 05:00:49.699380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1007/2008] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:49 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:50.638242 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1cd2c994-8572-46b2-9af7-f3822d04f8df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:50.638886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1cd2c994-8572-46b2-9af7-f3822d04f8df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:50.640034 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-77a3b25b-a939-4958-bbe7-1de939a9957d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:50.640691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-77a3b25b-a939-4958-bbe7-1de939a9957d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:50.645617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1cd2c994-8572-46b2-9af7-f3822d04f8df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:50.646067 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1cd2c994-8572-46b2-9af7-f3822d04f8df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:50.646832 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1cd2c994-8572-46b2-9af7-f3822d04f8df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:50.647266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1cd2c994-8572-46b2-9af7-f3822d04f8df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:50.647384 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77a3b25b-a939-4958-bbe7-1de939a9957d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:50.647747 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77a3b25b-a939-4958-bbe7-1de939a9957d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:50.648516 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77a3b25b-a939-4958-bbe7-1de939a9957d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:50.648959 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77a3b25b-a939-4958-bbe7-1de939a9957d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:50.840031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1cd2c994-8572-46b2-9af7-f3822d04f8df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:50.843322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-77a3b25b-a939-4958-bbe7-1de939a9957d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:50.848673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1cd2c994-8572-46b2-9af7-f3822d04f8df tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.214269 Aug 04 05:00:50.849605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1002/2009] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:50 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:50.852296 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-77a3b25b-a939-4958-bbe7-1de939a9957d tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.215989 Aug 04 05:00:50.858863 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1008/2010] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:50 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:50.859037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e06e6ce4-2c28-4c3f-8836-d6c7ce425e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:50.859037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e06e6ce4-2c28-4c3f-8836-d6c7ce425e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:50.860978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e06e6ce4-2c28-4c3f-8836-d6c7ce425e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:50.861609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e06e6ce4-2c28-4c3f-8836-d6c7ce425e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:50.862375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e06e6ce4-2c28-4c3f-8836-d6c7ce425e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:50.862809 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e06e6ce4-2c28-4c3f-8836-d6c7ce425e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:50.925951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e06e6ce4-2c28-4c3f-8836-d6c7ce425e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:50.933766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e06e6ce4-2c28-4c3f-8836-d6c7ce425e67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083302 Aug 04 05:00:50.934320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1003/2011] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:50 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:51.869661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-73d94af2-7698-4c13-ac9c-afa7ae5c6b38 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:51.870286 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-73d94af2-7698-4c13-ac9c-afa7ae5c6b38 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:51.873727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-70b10fc8-c109-4c47-9fed-d7d3c087c005 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:51.874498 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-70b10fc8-c109-4c47-9fed-d7d3c087c005 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:51.877400 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-73d94af2-7698-4c13-ac9c-afa7ae5c6b38 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:51.877872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-73d94af2-7698-4c13-ac9c-afa7ae5c6b38 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:51.878637 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-73d94af2-7698-4c13-ac9c-afa7ae5c6b38 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:51.879069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-73d94af2-7698-4c13-ac9c-afa7ae5c6b38 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:51.881832 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-70b10fc8-c109-4c47-9fed-d7d3c087c005 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:51.882283 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-70b10fc8-c109-4c47-9fed-d7d3c087c005 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:51.883052 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-70b10fc8-c109-4c47-9fed-d7d3c087c005 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:51.883492 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-70b10fc8-c109-4c47-9fed-d7d3c087c005 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:52.075230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-73d94af2-7698-4c13-ac9c-afa7ae5c6b38 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:52.078366 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-70b10fc8-c109-4c47-9fed-d7d3c087c005 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:52.083684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-73d94af2-7698-4c13-ac9c-afa7ae5c6b38 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.217950 Aug 04 05:00:52.084254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1009/2012] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:51 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:52.086918 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-70b10fc8-c109-4c47-9fed-d7d3c087c005 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.217078 Aug 04 05:00:52.087697 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1004/2013] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:51 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:52.088889 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-26a7832e-a09b-4ba5-a1cf-9e401e0849b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:52.089504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-26a7832e-a09b-4ba5-a1cf-9e401e0849b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:52.096023 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-26a7832e-a09b-4ba5-a1cf-9e401e0849b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:52.096471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-26a7832e-a09b-4ba5-a1cf-9e401e0849b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:52.097486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-26a7832e-a09b-4ba5-a1cf-9e401e0849b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:52.097970 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-26a7832e-a09b-4ba5-a1cf-9e401e0849b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:52.159110 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-26a7832e-a09b-4ba5-a1cf-9e401e0849b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:52.167153 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-26a7832e-a09b-4ba5-a1cf-9e401e0849b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081967 Aug 04 05:00:52.167712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1010/2014] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:52 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:53.106194 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b045b0e5-ada8-4622-bd91-b4b71f8ef0bd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:53.106811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b045b0e5-ada8-4622-bd91-b4b71f8ef0bd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:53.107290 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-74737e41-4015-4202-ae53-c7748b8b1150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:53.107929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-74737e41-4015-4202-ae53-c7748b8b1150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:53.114537 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b045b0e5-ada8-4622-bd91-b4b71f8ef0bd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:53.114738 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-74737e41-4015-4202-ae53-c7748b8b1150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:53.114986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b045b0e5-ada8-4622-bd91-b4b71f8ef0bd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:53.115167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-74737e41-4015-4202-ae53-c7748b8b1150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:53.115756 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b045b0e5-ada8-4622-bd91-b4b71f8ef0bd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:53.115877 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-74737e41-4015-4202-ae53-c7748b8b1150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:53.116191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b045b0e5-ada8-4622-bd91-b4b71f8ef0bd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:53.116321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-74737e41-4015-4202-ae53-c7748b8b1150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:53.310324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b045b0e5-ada8-4622-bd91-b4b71f8ef0bd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:53.312489 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-74737e41-4015-4202-ae53-c7748b8b1150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:53.318753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b045b0e5-ada8-4622-bd91-b4b71f8ef0bd tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.216302 Aug 04 05:00:53.319328 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1005/2015] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:53 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:53.320469 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-74737e41-4015-4202-ae53-c7748b8b1150 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.217005 Aug 04 05:00:53.321154 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1011/2016] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:53 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:53.324063 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-10db04b0-7bcf-4501-97b9-53bb1e9510ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:53.324681 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-10db04b0-7bcf-4501-97b9-53bb1e9510ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:53.331260 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-10db04b0-7bcf-4501-97b9-53bb1e9510ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:53.331720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-10db04b0-7bcf-4501-97b9-53bb1e9510ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:53.332488 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-10db04b0-7bcf-4501-97b9-53bb1e9510ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:53.332932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-10db04b0-7bcf-4501-97b9-53bb1e9510ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:53.396078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-10db04b0-7bcf-4501-97b9-53bb1e9510ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:53.403942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-10db04b0-7bcf-4501-97b9-53bb1e9510ff tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083661 Aug 04 05:00:53.404496 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1006/2017] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:53 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:54.340013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f548d908-1b55-4779-b613-2932cf0d853d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:54.340639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f548d908-1b55-4779-b613-2932cf0d853d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:54.341595 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d2018e37-59b4-42a4-bc47-5caf8843e7c9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:54.342215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d2018e37-59b4-42a4-bc47-5caf8843e7c9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:54.348190 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f548d908-1b55-4779-b613-2932cf0d853d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:54.348638 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f548d908-1b55-4779-b613-2932cf0d853d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:54.349367 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2018e37-59b4-42a4-bc47-5caf8843e7c9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:54.349523 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f548d908-1b55-4779-b613-2932cf0d853d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:54.349852 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f548d908-1b55-4779-b613-2932cf0d853d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:54.349990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2018e37-59b4-42a4-bc47-5caf8843e7c9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:54.350677 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2018e37-59b4-42a4-bc47-5caf8843e7c9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:54.351096 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d2018e37-59b4-42a4-bc47-5caf8843e7c9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:54.540158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f548d908-1b55-4779-b613-2932cf0d853d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:54.549236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d2018e37-59b4-42a4-bc47-5caf8843e7c9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:54.549477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f548d908-1b55-4779-b613-2932cf0d853d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.213197 Aug 04 05:00:54.550085 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1012/2018] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:54 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:54.557518 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d2018e37-59b4-42a4-bc47-5caf8843e7c9 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.219774 Aug 04 05:00:54.558101 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1007/2019] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:54 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:54.600650 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-eb7c8c6f-124d-43c3-8dcf-4fb0c430288e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:54.601274 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-eb7c8c6f-124d-43c3-8dcf-4fb0c430288e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:54.607380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-eb7c8c6f-124d-43c3-8dcf-4fb0c430288e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:54.607836 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-eb7c8c6f-124d-43c3-8dcf-4fb0c430288e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:54.608598 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-eb7c8c6f-124d-43c3-8dcf-4fb0c430288e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:54.609035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-eb7c8c6f-124d-43c3-8dcf-4fb0c430288e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:54.673403 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-eb7c8c6f-124d-43c3-8dcf-4fb0c430288e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:54.681534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-eb7c8c6f-124d-43c3-8dcf-4fb0c430288e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.130510 Aug 04 05:00:54.682122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1013/2020] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:54 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:55.570615 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ac7c021d-5d9a-4326-a7e3-8bac8b86ae83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:55.571265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ac7c021d-5d9a-4326-a7e3-8bac8b86ae83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:55.577848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ac7c021d-5d9a-4326-a7e3-8bac8b86ae83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:55.578308 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ac7c021d-5d9a-4326-a7e3-8bac8b86ae83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:55.579137 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ac7c021d-5d9a-4326-a7e3-8bac8b86ae83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:55.579333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-485baa8d-64eb-466d-8caa-8f03eefdfb87 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:55.579955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ac7c021d-5d9a-4326-a7e3-8bac8b86ae83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:55.580064 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-485baa8d-64eb-466d-8caa-8f03eefdfb87 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:55.586502 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-485baa8d-64eb-466d-8caa-8f03eefdfb87 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:55.586967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-485baa8d-64eb-466d-8caa-8f03eefdfb87 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:55.587707 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-485baa8d-64eb-466d-8caa-8f03eefdfb87 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:55.588135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-485baa8d-64eb-466d-8caa-8f03eefdfb87 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:55.776227 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ac7c021d-5d9a-4326-a7e3-8bac8b86ae83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:55.779219 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-485baa8d-64eb-466d-8caa-8f03eefdfb87 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:55.784951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ac7c021d-5d9a-4326-a7e3-8bac8b86ae83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.218168 Aug 04 05:00:55.785518 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1008/2021] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:55 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:55.787806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-485baa8d-64eb-466d-8caa-8f03eefdfb87 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.212356 Aug 04 05:00:55.788521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1014/2022] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:55 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:55.789911 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0403b873-6034-433a-aec2-16cbe141a696 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:55.790510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0403b873-6034-433a-aec2-16cbe141a696 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:55.796490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0403b873-6034-433a-aec2-16cbe141a696 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:55.796942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0403b873-6034-433a-aec2-16cbe141a696 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:55.798341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0403b873-6034-433a-aec2-16cbe141a696 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:55.798828 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0403b873-6034-433a-aec2-16cbe141a696 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:55.858502 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0403b873-6034-433a-aec2-16cbe141a696 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:55.866959 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0403b873-6034-433a-aec2-16cbe141a696 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080484 Aug 04 05:00:55.867509 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1009/2023] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:55 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:56.807881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5882ac2c-630a-4c1c-b8c9-6c9ec9635fd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:56.808501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5882ac2c-630a-4c1c-b8c9-6c9ec9635fd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:56.809448 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9d032bfb-3575-40e0-a24c-9e09fc4bbe23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:56.810130 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9d032bfb-3575-40e0-a24c-9e09fc4bbe23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:56.816881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5882ac2c-630a-4c1c-b8c9-6c9ec9635fd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:56.817270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d032bfb-3575-40e0-a24c-9e09fc4bbe23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:56.817397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5882ac2c-630a-4c1c-b8c9-6c9ec9635fd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:56.817756 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d032bfb-3575-40e0-a24c-9e09fc4bbe23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:56.818221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5882ac2c-630a-4c1c-b8c9-6c9ec9635fd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:56.818525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d032bfb-3575-40e0-a24c-9e09fc4bbe23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:56.818646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5882ac2c-630a-4c1c-b8c9-6c9ec9635fd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:56.818948 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9d032bfb-3575-40e0-a24c-9e09fc4bbe23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:56.834929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:57.015392 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9d032bfb-3575-40e0-a24c-9e09fc4bbe23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:57.019364 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5882ac2c-630a-4c1c-b8c9-6c9ec9635fd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:57.024159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9d032bfb-3575-40e0-a24c-9e09fc4bbe23 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.218606 Aug 04 05:00:57.024822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1010/2024] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:56 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:57.027438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5882ac2c-630a-4c1c-b8c9-6c9ec9635fd0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.223435 Aug 04 05:00:57.028202 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1015/2025] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:56 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:57.029256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ce814049-9085-40fa-8265-f3d0e27033bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:57.029888 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ce814049-9085-40fa-8265-f3d0e27033bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:57.036028 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ce814049-9085-40fa-8265-f3d0e27033bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:57.036482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ce814049-9085-40fa-8265-f3d0e27033bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:57.037245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ce814049-9085-40fa-8265-f3d0e27033bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:57.037722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ce814049-9085-40fa-8265-f3d0e27033bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:57.098030 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ce814049-9085-40fa-8265-f3d0e27033bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:57.105812 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ce814049-9085-40fa-8265-f3d0e27033bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080025 Aug 04 05:00:57.106373 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1011/2026] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:57 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:58.045387 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-69de47ac-a743-460d-a1f4-864ebc45f556 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:58.046025 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-69de47ac-a743-460d-a1f4-864ebc45f556 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:58.049403 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-744f950d-5b03-4c59-b7fd-694220461b6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:58.050063 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-744f950d-5b03-4c59-b7fd-694220461b6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:58.053799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-69de47ac-a743-460d-a1f4-864ebc45f556 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:58.054281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-69de47ac-a743-460d-a1f4-864ebc45f556 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:58.055049 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-69de47ac-a743-460d-a1f4-864ebc45f556 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:58.055481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-69de47ac-a743-460d-a1f4-864ebc45f556 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:58.056470 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-744f950d-5b03-4c59-b7fd-694220461b6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:58.056924 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-744f950d-5b03-4c59-b7fd-694220461b6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:58.057716 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-744f950d-5b03-4c59-b7fd-694220461b6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:58.058158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-744f950d-5b03-4c59-b7fd-694220461b6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:58.245868 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-69de47ac-a743-460d-a1f4-864ebc45f556 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:58.250642 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-744f950d-5b03-4c59-b7fd-694220461b6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:58.254257 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-69de47ac-a743-460d-a1f4-864ebc45f556 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.212722 Aug 04 05:00:58.254835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1016/2027] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:58 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:58.259289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-481fba68-953b-44c5-a56a-c554edfcc2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:58.259904 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-481fba68-953b-44c5-a56a-c554edfcc2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:58.260412 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-744f950d-5b03-4c59-b7fd-694220461b6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.216237 Aug 04 05:00:58.261103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1012/2028] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:58 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:58.267116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-481fba68-953b-44c5-a56a-c554edfcc2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:58.267579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-481fba68-953b-44c5-a56a-c554edfcc2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:58.268356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-481fba68-953b-44c5-a56a-c554edfcc2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:58.268800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-481fba68-953b-44c5-a56a-c554edfcc2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:58.330042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-481fba68-953b-44c5-a56a-c554edfcc2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:58.337936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-481fba68-953b-44c5-a56a-c554edfcc2e3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082131 Aug 04 05:00:58.338498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1017/2029] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:58 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:58.569307 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:00:58.569570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:00:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:00:59.275755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9459f92d-15c2-4368-8d97-16538dfd0401 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:59.276372 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9459f92d-15c2-4368-8d97-16538dfd0401 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:59.280904 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1d66d5ba-168f-4ebe-baa6-418775c354bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:59.281564 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1d66d5ba-168f-4ebe-baa6-418775c354bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:59.283167 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9459f92d-15c2-4368-8d97-16538dfd0401 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:59.283621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9459f92d-15c2-4368-8d97-16538dfd0401 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:59.284416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9459f92d-15c2-4368-8d97-16538dfd0401 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:59.284859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9459f92d-15c2-4368-8d97-16538dfd0401 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:59.288320 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1d66d5ba-168f-4ebe-baa6-418775c354bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:59.288776 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1d66d5ba-168f-4ebe-baa6-418775c354bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:59.289572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1d66d5ba-168f-4ebe-baa6-418775c354bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:59.290039 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1d66d5ba-168f-4ebe-baa6-418775c354bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:59.480500 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9459f92d-15c2-4368-8d97-16538dfd0401 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:59.483532 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1d66d5ba-168f-4ebe-baa6-418775c354bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:59.489077 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9459f92d-15c2-4368-8d97-16538dfd0401 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.217283 Aug 04 05:00:59.489668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1013/2030] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:59 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:00:59.492613 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1d66d5ba-168f-4ebe-baa6-418775c354bc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215482 Aug 04 05:00:59.493342 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1018/2031] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:59 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:00:59.494082 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-754e2d0d-7f3d-4d73-bfdb-29af5787a2aa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:00:59.494686 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-754e2d0d-7f3d-4d73-bfdb-29af5787a2aa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:00:59.496388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=74 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:00:59.503755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-754e2d0d-7f3d-4d73-bfdb-29af5787a2aa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:59.503755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-754e2d0d-7f3d-4d73-bfdb-29af5787a2aa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:59.504043 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-754e2d0d-7f3d-4d73-bfdb-29af5787a2aa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:00:59.504300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-754e2d0d-7f3d-4d73-bfdb-29af5787a2aa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:00:59.570865 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-754e2d0d-7f3d-4d73-bfdb-29af5787a2aa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:00:59.579379 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-754e2d0d-7f3d-4d73-bfdb-29af5787a2aa tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.088290 Aug 04 05:00:59.580149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1014/2032] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:00:59 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:00.276197 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:01:00.276835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:01:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:01:00.511048 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dd782aa6-9ac5-40cd-a828-37424a4fbabb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:00.511667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dd782aa6-9ac5-40cd-a828-37424a4fbabb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:00.514618 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e243fead-a0cb-441f-a6d5-cecd6694770d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:00.515314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e243fead-a0cb-441f-a6d5-cecd6694770d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:00.515550 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=74 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:00.520756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd782aa6-9ac5-40cd-a828-37424a4fbabb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:00.521208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd782aa6-9ac5-40cd-a828-37424a4fbabb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:00.522172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd782aa6-9ac5-40cd-a828-37424a4fbabb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:00.522448 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dd782aa6-9ac5-40cd-a828-37424a4fbabb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:00.522579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e243fead-a0cb-441f-a6d5-cecd6694770d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:00.523017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e243fead-a0cb-441f-a6d5-cecd6694770d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:00.523816 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e243fead-a0cb-441f-a6d5-cecd6694770d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:00.524248 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e243fead-a0cb-441f-a6d5-cecd6694770d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:00.718622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-dd782aa6-9ac5-40cd-a828-37424a4fbabb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:00.722965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e243fead-a0cb-441f-a6d5-cecd6694770d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:00.727775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dd782aa6-9ac5-40cd-a828-37424a4fbabb tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.220712 Aug 04 05:01:00.728355 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1019/2033] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:00 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:00.731033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e243fead-a0cb-441f-a6d5-cecd6694770d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.220368 Aug 04 05:01:00.733668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1015/2034] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:00 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:00.733821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-591e573c-3d16-43a4-b5da-77a0e92ee5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:00.733821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-591e573c-3d16-43a4-b5da-77a0e92ee5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:00.740088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-591e573c-3d16-43a4-b5da-77a0e92ee5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:00.740540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-591e573c-3d16-43a4-b5da-77a0e92ee5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:00.741383 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-591e573c-3d16-43a4-b5da-77a0e92ee5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:00.741784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-591e573c-3d16-43a4-b5da-77a0e92ee5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:00.803487 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-591e573c-3d16-43a4-b5da-77a0e92ee5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:00.811269 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-591e573c-3d16-43a4-b5da-77a0e92ee5ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081995 Aug 04 05:01:00.811824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1020/2035] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:00 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:01.748818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9ead0070-5252-4ed0-9697-6944effc1e2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:01.749463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9ead0070-5252-4ed0-9697-6944effc1e2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:01.752479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ebad7e52-b37c-435d-975c-4f5e9ee0ec58 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:01.753099 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ebad7e52-b37c-435d-975c-4f5e9ee0ec58 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:01.756683 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9ead0070-5252-4ed0-9697-6944effc1e2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:01.757076 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9ead0070-5252-4ed0-9697-6944effc1e2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:01.757882 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9ead0070-5252-4ed0-9697-6944effc1e2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:01.758301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9ead0070-5252-4ed0-9697-6944effc1e2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:01.759509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ebad7e52-b37c-435d-975c-4f5e9ee0ec58 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:01.759954 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ebad7e52-b37c-435d-975c-4f5e9ee0ec58 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:01.760709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ebad7e52-b37c-435d-975c-4f5e9ee0ec58 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:01.761142 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ebad7e52-b37c-435d-975c-4f5e9ee0ec58 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:01.954799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9ead0070-5252-4ed0-9697-6944effc1e2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:01.959450 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ebad7e52-b37c-435d-975c-4f5e9ee0ec58 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:01.963003 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9ead0070-5252-4ed0-9697-6944effc1e2f tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.218003 Aug 04 05:01:01.963573 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1016/2036] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:01 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:01.967477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ebad7e52-b37c-435d-975c-4f5e9ee0ec58 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.219627 Aug 04 05:01:01.968194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1021/2037] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:01 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:01.970592 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-64e2dfde-7110-4569-b975-9a7a31f20166 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:01.971254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-64e2dfde-7110-4569-b975-9a7a31f20166 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:01.977308 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-64e2dfde-7110-4569-b975-9a7a31f20166 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:01.977857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-64e2dfde-7110-4569-b975-9a7a31f20166 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:01.978735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-64e2dfde-7110-4569-b975-9a7a31f20166 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:01.979235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-64e2dfde-7110-4569-b975-9a7a31f20166 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:01.996548 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:02.050423 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-64e2dfde-7110-4569-b975-9a7a31f20166 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:02.058284 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-64e2dfde-7110-4569-b975-9a7a31f20166 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.093769 Aug 04 05:01:02.058837 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1017/2038] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:01 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:02.985326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-893df7ae-0e95-4d07-a2d7-7b8877cbedd7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:02.985970 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-893df7ae-0e95-4d07-a2d7-7b8877cbedd7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:02.989539 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2f197944-1ead-4095-9b30-55e4a95e7405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:02.990241 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2f197944-1ead-4095-9b30-55e4a95e7405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:02.992441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-893df7ae-0e95-4d07-a2d7-7b8877cbedd7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:02.992888 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-893df7ae-0e95-4d07-a2d7-7b8877cbedd7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:02.993672 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-893df7ae-0e95-4d07-a2d7-7b8877cbedd7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:02.994105 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-893df7ae-0e95-4d07-a2d7-7b8877cbedd7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:02.996577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2f197944-1ead-4095-9b30-55e4a95e7405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:02.997029 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2f197944-1ead-4095-9b30-55e4a95e7405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:02.997818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2f197944-1ead-4095-9b30-55e4a95e7405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:02.998261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2f197944-1ead-4095-9b30-55e4a95e7405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:03.187469 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-893df7ae-0e95-4d07-a2d7-7b8877cbedd7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:03.191250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2f197944-1ead-4095-9b30-55e4a95e7405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:03.196400 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-893df7ae-0e95-4d07-a2d7-7b8877cbedd7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.215463 Aug 04 05:01:03.196970 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1022/2039] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:02 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:03.199444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2f197944-1ead-4095-9b30-55e4a95e7405 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.214458 Aug 04 05:01:03.200139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1018/2040] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:02 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:03.201360 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2953e320-8df5-4532-9f2b-ef5a7f36d8a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:03.201992 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2953e320-8df5-4532-9f2b-ef5a7f36d8a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:03.208005 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2953e320-8df5-4532-9f2b-ef5a7f36d8a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:03.208452 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2953e320-8df5-4532-9f2b-ef5a7f36d8a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:03.209251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2953e320-8df5-4532-9f2b-ef5a7f36d8a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:03.209714 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2953e320-8df5-4532-9f2b-ef5a7f36d8a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:03.270619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2953e320-8df5-4532-9f2b-ef5a7f36d8a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:03.278688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2953e320-8df5-4532-9f2b-ef5a7f36d8a6 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080742 Aug 04 05:01:03.279254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1023/2041] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:03 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:04.216806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b4570484-83b5-4157-b80b-5a5edb8f67b4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:04.217418 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b4570484-83b5-4157-b80b-5a5edb8f67b4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:04.220090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b3242d82-0ba0-406e-90fe-907e41ea7e6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:04.220703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b3242d82-0ba0-406e-90fe-907e41ea7e6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:04.224135 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b4570484-83b5-4157-b80b-5a5edb8f67b4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:04.224594 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b4570484-83b5-4157-b80b-5a5edb8f67b4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:04.225367 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b4570484-83b5-4157-b80b-5a5edb8f67b4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:04.225829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b4570484-83b5-4157-b80b-5a5edb8f67b4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:04.227054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b3242d82-0ba0-406e-90fe-907e41ea7e6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:04.227502 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b3242d82-0ba0-406e-90fe-907e41ea7e6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:04.228260 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b3242d82-0ba0-406e-90fe-907e41ea7e6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:04.228688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b3242d82-0ba0-406e-90fe-907e41ea7e6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:04.426987 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b4570484-83b5-4157-b80b-5a5edb8f67b4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:04.429381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b3242d82-0ba0-406e-90fe-907e41ea7e6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:04.434949 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b4570484-83b5-4157-b80b-5a5edb8f67b4 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.222047 Aug 04 05:01:04.435507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1019/2042] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:04 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:04.437527 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b3242d82-0ba0-406e-90fe-907e41ea7e6d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.221372 Aug 04 05:01:04.440268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-96b9f321-4361-4910-9f95-98b2c74e0c67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:04.440929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-96b9f321-4361-4910-9f95-98b2c74e0c67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:04.446652 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-96b9f321-4361-4910-9f95-98b2c74e0c67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:04.447104 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-96b9f321-4361-4910-9f95-98b2c74e0c67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:04.447858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-96b9f321-4361-4910-9f95-98b2c74e0c67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:04.448289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-96b9f321-4361-4910-9f95-98b2c74e0c67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:04.449817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1024/2043] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:04 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:04.512570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-96b9f321-4361-4910-9f95-98b2c74e0c67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:04.521211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-96b9f321-4361-4910-9f95-98b2c74e0c67 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084746 Aug 04 05:01:04.521818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1020/2044] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:04 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:05.457339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a88f9cb6-96ec-4f47-93b5-d7eab3d328e3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:05.457985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a88f9cb6-96ec-4f47-93b5-d7eab3d328e3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:05.458808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-854d2a74-c552-4835-abd3-f88f7053da61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:05.459431 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-854d2a74-c552-4835-abd3-f88f7053da61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:05.464511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a88f9cb6-96ec-4f47-93b5-d7eab3d328e3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:05.464963 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a88f9cb6-96ec-4f47-93b5-d7eab3d328e3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:05.465793 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a88f9cb6-96ec-4f47-93b5-d7eab3d328e3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:05.466022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-854d2a74-c552-4835-abd3-f88f7053da61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:05.466216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a88f9cb6-96ec-4f47-93b5-d7eab3d328e3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:05.466474 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-854d2a74-c552-4835-abd3-f88f7053da61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:05.467235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-854d2a74-c552-4835-abd3-f88f7053da61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:05.467682 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-854d2a74-c552-4835-abd3-f88f7053da61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:05.660226 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-854d2a74-c552-4835-abd3-f88f7053da61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:05.663950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a88f9cb6-96ec-4f47-93b5-d7eab3d328e3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:05.668428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-854d2a74-c552-4835-abd3-f88f7053da61 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.213406 Aug 04 05:01:05.668998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1021/2045] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:05 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:05.672191 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a88f9cb6-96ec-4f47-93b5-d7eab3d328e3 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.219759 Aug 04 05:01:05.673061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1025/2046] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:05 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:05.674103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ff342fc3-775d-4918-9c39-a4f9b3d58799 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:05.674801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ff342fc3-775d-4918-9c39-a4f9b3d58799 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:05.680761 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff342fc3-775d-4918-9c39-a4f9b3d58799 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:05.681217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff342fc3-775d-4918-9c39-a4f9b3d58799 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:05.682002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff342fc3-775d-4918-9c39-a4f9b3d58799 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:05.682436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff342fc3-775d-4918-9c39-a4f9b3d58799 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:05.742475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ff342fc3-775d-4918-9c39-a4f9b3d58799 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:05.750187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ff342fc3-775d-4918-9c39-a4f9b3d58799 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080262 Aug 04 05:01:05.751296 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1022/2047] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:05 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:06.692401 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3ec02108-8723-449b-9c66-994ab68b947a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:06.693266 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3ec02108-8723-449b-9c66-994ab68b947a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:06.695468 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1f581f9a-e1f6-4de8-85ad-d16b8ccf7c69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:06.696082 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1f581f9a-e1f6-4de8-85ad-d16b8ccf7c69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:06.700814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ec02108-8723-449b-9c66-994ab68b947a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:06.701341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ec02108-8723-449b-9c66-994ab68b947a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:06.702227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ec02108-8723-449b-9c66-994ab68b947a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:06.702652 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1f581f9a-e1f6-4de8-85ad-d16b8ccf7c69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:06.703053 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ec02108-8723-449b-9c66-994ab68b947a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:06.703176 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1f581f9a-e1f6-4de8-85ad-d16b8ccf7c69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:06.703885 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1f581f9a-e1f6-4de8-85ad-d16b8ccf7c69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:06.704362 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1f581f9a-e1f6-4de8-85ad-d16b8ccf7c69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:06.904235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1f581f9a-e1f6-4de8-85ad-d16b8ccf7c69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:06.907763 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3ec02108-8723-449b-9c66-994ab68b947a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:06.912664 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1f581f9a-e1f6-4de8-85ad-d16b8ccf7c69 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.221067 Aug 04 05:01:06.913245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1023/2048] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:06 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:06.917227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3ec02108-8723-449b-9c66-994ab68b947a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.230529 Aug 04 05:01:06.917227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1026/2049] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:06 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:06.917912 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-661c7702-f679-43cc-b631-496b36405aa3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:06.918533 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-661c7702-f679-43cc-b631-496b36405aa3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:06.925237 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-661c7702-f679-43cc-b631-496b36405aa3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:06.925723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-661c7702-f679-43cc-b631-496b36405aa3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:06.926489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-661c7702-f679-43cc-b631-496b36405aa3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:06.926928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-661c7702-f679-43cc-b631-496b36405aa3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:06.987751 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-661c7702-f679-43cc-b631-496b36405aa3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:06.995781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-661c7702-f679-43cc-b631-496b36405aa3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081554 Aug 04 05:01:06.996350 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1024/2050] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:06 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:07.935681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a2d086f5-b879-40d1-ba6a-33de3fb618fe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:07.935681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a2d086f5-b879-40d1-ba6a-33de3fb618fe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:07.937086 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4e015153-b553-4f90-a857-e6437f314b55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:07.937762 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4e015153-b553-4f90-a857-e6437f314b55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:07.942223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2d086f5-b879-40d1-ba6a-33de3fb618fe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:07.942746 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2d086f5-b879-40d1-ba6a-33de3fb618fe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:07.943582 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2d086f5-b879-40d1-ba6a-33de3fb618fe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:07.943861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a2d086f5-b879-40d1-ba6a-33de3fb618fe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:07.944272 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e015153-b553-4f90-a857-e6437f314b55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:07.944735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e015153-b553-4f90-a857-e6437f314b55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:07.945644 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e015153-b553-4f90-a857-e6437f314b55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:07.946090 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4e015153-b553-4f90-a857-e6437f314b55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:08.145617 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a2d086f5-b879-40d1-ba6a-33de3fb618fe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:08.152171 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4e015153-b553-4f90-a857-e6437f314b55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:08.153725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a2d086f5-b879-40d1-ba6a-33de3fb618fe tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.222490 Aug 04 05:01:08.154293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1027/2051] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:07 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:08.159971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f88221f5-069b-44ad-ad43-74ed10f32455 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:08.160587 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f88221f5-069b-44ad-ad43-74ed10f32455 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:08.160913 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4e015153-b553-4f90-a857-e6437f314b55 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.227581 Aug 04 05:01:08.161634 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1025/2052] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:07 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:08.166537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f88221f5-069b-44ad-ad43-74ed10f32455 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:08.166991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f88221f5-069b-44ad-ad43-74ed10f32455 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:08.167752 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f88221f5-069b-44ad-ad43-74ed10f32455 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:08.168188 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f88221f5-069b-44ad-ad43-74ed10f32455 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:08.232844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f88221f5-069b-44ad-ad43-74ed10f32455 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:08.240930 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f88221f5-069b-44ad-ad43-74ed10f32455 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085705 Aug 04 05:01:08.241483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1028/2053] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:08 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:09.175952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0921fdea-17d4-4070-a8fc-7948660086e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:09.176565 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0921fdea-17d4-4070-a8fc-7948660086e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:09.180959 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-985e7720-dd7d-45c9-a8bb-4efc66b792f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:09.181612 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-985e7720-dd7d-45c9-a8bb-4efc66b792f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:09.183118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0921fdea-17d4-4070-a8fc-7948660086e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:09.183566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0921fdea-17d4-4070-a8fc-7948660086e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:09.184324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0921fdea-17d4-4070-a8fc-7948660086e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:09.184759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0921fdea-17d4-4070-a8fc-7948660086e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:09.188162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-985e7720-dd7d-45c9-a8bb-4efc66b792f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:09.188620 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-985e7720-dd7d-45c9-a8bb-4efc66b792f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:09.189385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-985e7720-dd7d-45c9-a8bb-4efc66b792f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:09.189901 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-985e7720-dd7d-45c9-a8bb-4efc66b792f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:09.378711 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0921fdea-17d4-4070-a8fc-7948660086e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:09.382035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-985e7720-dd7d-45c9-a8bb-4efc66b792f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:09.386792 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0921fdea-17d4-4070-a8fc-7948660086e0 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.214890 Aug 04 05:01:09.387574 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1026/2054] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:09 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:09.391848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-985e7720-dd7d-45c9-a8bb-4efc66b792f5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.214057 Aug 04 05:01:09.392679 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1029/2055] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:09 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:09.392830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-561cda02-a9b5-4ca1-bbaa-813021b17094 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:09.393180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-561cda02-a9b5-4ca1-bbaa-813021b17094 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:09.399140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-561cda02-a9b5-4ca1-bbaa-813021b17094 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:09.399590 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-561cda02-a9b5-4ca1-bbaa-813021b17094 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:09.400345 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-561cda02-a9b5-4ca1-bbaa-813021b17094 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:09.400772 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-561cda02-a9b5-4ca1-bbaa-813021b17094 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:09.462413 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-561cda02-a9b5-4ca1-bbaa-813021b17094 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:09.470159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-561cda02-a9b5-4ca1-bbaa-813021b17094 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081872 Aug 04 05:01:09.470713 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1027/2056] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:09 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:10.408362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b23d1662-d87a-4d1e-9eda-35db44525eed tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:10.408993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b23d1662-d87a-4d1e-9eda-35db44525eed tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:10.412989 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7c949921-39b3-4364-a158-c66d7d1a5641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:10.413422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7c949921-39b3-4364-a158-c66d7d1a5641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:10.415594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b23d1662-d87a-4d1e-9eda-35db44525eed tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:10.416668 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b23d1662-d87a-4d1e-9eda-35db44525eed tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:10.417453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b23d1662-d87a-4d1e-9eda-35db44525eed tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:10.417926 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b23d1662-d87a-4d1e-9eda-35db44525eed tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:10.419831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7c949921-39b3-4364-a158-c66d7d1a5641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:10.420287 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7c949921-39b3-4364-a158-c66d7d1a5641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:10.421049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7c949921-39b3-4364-a158-c66d7d1a5641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:10.421795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7c949921-39b3-4364-a158-c66d7d1a5641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:10.612908 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7c949921-39b3-4364-a158-c66d7d1a5641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:10.615880 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b23d1662-d87a-4d1e-9eda-35db44525eed tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:10.621062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7c949921-39b3-4364-a158-c66d7d1a5641 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.212283 Aug 04 05:01:10.621642 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1028/2057] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:10 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:10.624187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b23d1662-d87a-4d1e-9eda-35db44525eed tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.220397 Aug 04 05:01:10.624879 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1030/2058] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:10 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:10.626989 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cd97944e-f841-4d31-9890-182e485bc6b3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:10.627605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cd97944e-f841-4d31-9890-182e485bc6b3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:10.633514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd97944e-f841-4d31-9890-182e485bc6b3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:10.634008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd97944e-f841-4d31-9890-182e485bc6b3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:10.634770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd97944e-f841-4d31-9890-182e485bc6b3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:10.635208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cd97944e-f841-4d31-9890-182e485bc6b3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:10.696723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-cd97944e-f841-4d31-9890-182e485bc6b3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:10.705176 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cd97944e-f841-4d31-9890-182e485bc6b3 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082566 Aug 04 05:01:10.705758 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1029/2059] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:10 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:11.642175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e03e48e9-7c46-4c13-b735-79141aac02a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:11.642894 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e03e48e9-7c46-4c13-b735-79141aac02a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:11.644131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8710f15d-6012-424e-9aff-bbd1b86dc9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:11.644759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8710f15d-6012-424e-9aff-bbd1b86dc9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:11.649500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e03e48e9-7c46-4c13-b735-79141aac02a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:11.649980 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e03e48e9-7c46-4c13-b735-79141aac02a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:11.650739 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e03e48e9-7c46-4c13-b735-79141aac02a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:11.651169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e03e48e9-7c46-4c13-b735-79141aac02a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:11.651300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8710f15d-6012-424e-9aff-bbd1b86dc9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:11.651718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8710f15d-6012-424e-9aff-bbd1b86dc9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:11.652513 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8710f15d-6012-424e-9aff-bbd1b86dc9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:11.652952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8710f15d-6012-424e-9aff-bbd1b86dc9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:11.843316 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e03e48e9-7c46-4c13-b735-79141aac02a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:11.847020 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8710f15d-6012-424e-9aff-bbd1b86dc9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:11.853418 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e03e48e9-7c46-4c13-b735-79141aac02a9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.215667 Aug 04 05:01:11.854157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1031/2060] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:11 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:11.855075 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8710f15d-6012-424e-9aff-bbd1b86dc9f5 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.214654 Aug 04 05:01:11.855734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1030/2061] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:11 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:11.860009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3f5d8b7c-f568-45dd-9db1-9419d1f75113 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:11.860645 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3f5d8b7c-f568-45dd-9db1-9419d1f75113 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:11.866594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3f5d8b7c-f568-45dd-9db1-9419d1f75113 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:11.867053 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3f5d8b7c-f568-45dd-9db1-9419d1f75113 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:11.867830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3f5d8b7c-f568-45dd-9db1-9419d1f75113 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:11.868274 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3f5d8b7c-f568-45dd-9db1-9419d1f75113 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:11.870828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:11.929170 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3f5d8b7c-f568-45dd-9db1-9419d1f75113 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:11.937826 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3f5d8b7c-f568-45dd-9db1-9419d1f75113 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081920 Aug 04 05:01:11.937826 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1032/2062] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:11 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:12.876643 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0ed33a36-05aa-4c09-95cb-e4fa2335da70 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:12.877266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0ed33a36-05aa-4c09-95cb-e4fa2335da70 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:12.883795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ed33a36-05aa-4c09-95cb-e4fa2335da70 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:12.884070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4f5635c6-785f-467f-9efc-06ad21754482 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:12.884543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ed33a36-05aa-4c09-95cb-e4fa2335da70 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:12.885008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ed33a36-05aa-4c09-95cb-e4fa2335da70 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:12.885331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4f5635c6-785f-467f-9efc-06ad21754482 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:12.885463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ed33a36-05aa-4c09-95cb-e4fa2335da70 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:12.892219 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4f5635c6-785f-467f-9efc-06ad21754482 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:12.892927 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4f5635c6-785f-467f-9efc-06ad21754482 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:12.893722 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4f5635c6-785f-467f-9efc-06ad21754482 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:12.894158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4f5635c6-785f-467f-9efc-06ad21754482 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:13.052812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:01:13.053044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:01:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 (ip 10.222.0.47) !!! Aug 04 05:01:13.080194 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0ed33a36-05aa-4c09-95cb-e4fa2335da70 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:13.086616 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4f5635c6-785f-467f-9efc-06ad21754482 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:13.088156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0ed33a36-05aa-4c09-95cb-e4fa2335da70 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.216364 Aug 04 05:01:13.088726 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1031/2063] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:13.093141 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-486ae43f-dbae-4de4-9b5f-6cb940d6a47b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:13.094320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-486ae43f-dbae-4de4-9b5f-6cb940d6a47b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:13.095608 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4f5635c6-785f-467f-9efc-06ad21754482 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.215595 Aug 04 05:01:13.096159 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1033/2064] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:12 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:13.100238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-486ae43f-dbae-4de4-9b5f-6cb940d6a47b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:13.100692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-486ae43f-dbae-4de4-9b5f-6cb940d6a47b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:13.101468 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-486ae43f-dbae-4de4-9b5f-6cb940d6a47b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:13.101937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-486ae43f-dbae-4de4-9b5f-6cb940d6a47b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:13.162428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-486ae43f-dbae-4de4-9b5f-6cb940d6a47b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:13.170247 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-486ae43f-dbae-4de4-9b5f-6cb940d6a47b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080558 Aug 04 05:01:13.170801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1032/2065] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:13 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:14.110800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ddab3af2-8c0b-47a9-9b2c-7ffe550d88c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:14.111514 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ddab3af2-8c0b-47a9-9b2c-7ffe550d88c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:14.116327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-76fbabd3-ce27-4e90-be59-f05beace49d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:14.117198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-76fbabd3-ce27-4e90-be59-f05beace49d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:14.120367 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ddab3af2-8c0b-47a9-9b2c-7ffe550d88c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:14.120823 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ddab3af2-8c0b-47a9-9b2c-7ffe550d88c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:14.121621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ddab3af2-8c0b-47a9-9b2c-7ffe550d88c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:14.122069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ddab3af2-8c0b-47a9-9b2c-7ffe550d88c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:14.125612 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-76fbabd3-ce27-4e90-be59-f05beace49d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:14.126080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-76fbabd3-ce27-4e90-be59-f05beace49d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:14.127388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-76fbabd3-ce27-4e90-be59-f05beace49d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:14.127388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-76fbabd3-ce27-4e90-be59-f05beace49d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:14.320743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ddab3af2-8c0b-47a9-9b2c-7ffe550d88c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:14.324886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-76fbabd3-ce27-4e90-be59-f05beace49d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:14.329364 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ddab3af2-8c0b-47a9-9b2c-7ffe550d88c6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.223459 Aug 04 05:01:14.329956 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1034/2066] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:14 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:14.333962 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-76fbabd3-ce27-4e90-be59-f05beace49d7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.221458 Aug 04 05:01:14.334437 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-255c4fe0-6c61-4fd2-804e-1ed48d303a3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:14.335034 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1033/2067] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:14 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:14.335183 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-255c4fe0-6c61-4fd2-804e-1ed48d303a3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:14.341013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-255c4fe0-6c61-4fd2-804e-1ed48d303a3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:14.341469 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-255c4fe0-6c61-4fd2-804e-1ed48d303a3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:14.342371 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-255c4fe0-6c61-4fd2-804e-1ed48d303a3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:14.342770 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-255c4fe0-6c61-4fd2-804e-1ed48d303a3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:14.404146 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-255c4fe0-6c61-4fd2-804e-1ed48d303a3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:14.412612 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-255c4fe0-6c61-4fd2-804e-1ed48d303a3e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081707 Aug 04 05:01:14.413172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1035/2068] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:14 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:15.350828 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b69cbf0e-28a9-4578-a819-da733f16680f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:15.351448 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b69cbf0e-28a9-4578-a819-da733f16680f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:15.356539 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-060478ab-21e2-4c90-8ddc-325fc194939c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:15.357160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-060478ab-21e2-4c90-8ddc-325fc194939c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:15.358043 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b69cbf0e-28a9-4578-a819-da733f16680f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:15.358658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b69cbf0e-28a9-4578-a819-da733f16680f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:15.360219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b69cbf0e-28a9-4578-a819-da733f16680f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:15.360648 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b69cbf0e-28a9-4578-a819-da733f16680f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:15.363397 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:15.364455 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-060478ab-21e2-4c90-8ddc-325fc194939c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:15.364883 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-060478ab-21e2-4c90-8ddc-325fc194939c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:15.365730 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-060478ab-21e2-4c90-8ddc-325fc194939c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:15.366164 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-060478ab-21e2-4c90-8ddc-325fc194939c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:15.563181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b69cbf0e-28a9-4578-a819-da733f16680f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:15.567592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-060478ab-21e2-4c90-8ddc-325fc194939c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:15.571469 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b69cbf0e-28a9-4578-a819-da733f16680f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.224584 Aug 04 05:01:15.572038 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1034/2069] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:15 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:15.575592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-060478ab-21e2-4c90-8ddc-325fc194939c tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.222755 Aug 04 05:01:15.576292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1036/2070] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:15 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:15.576962 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5d3f262e-2dc9-442a-a515-0738dae27c01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:15.577659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5d3f262e-2dc9-442a-a515-0738dae27c01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:15.584645 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5d3f262e-2dc9-442a-a515-0738dae27c01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:15.585096 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5d3f262e-2dc9-442a-a515-0738dae27c01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:15.586025 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5d3f262e-2dc9-442a-a515-0738dae27c01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:15.586463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5d3f262e-2dc9-442a-a515-0738dae27c01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:15.649896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5d3f262e-2dc9-442a-a515-0738dae27c01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:15.658488 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5d3f262e-2dc9-442a-a515-0738dae27c01 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085515 Aug 04 05:01:15.659045 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1035/2071] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:15 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:16.594602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-21d85b64-2ffc-4bd9-869b-78a60a013a7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:16.595209 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-21d85b64-2ffc-4bd9-869b-78a60a013a7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:16.597256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e181051a-21a9-4e87-92bd-f364c7208b97 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:16.597909 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e181051a-21a9-4e87-92bd-f364c7208b97 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:16.601817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21d85b64-2ffc-4bd9-869b-78a60a013a7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:16.602269 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21d85b64-2ffc-4bd9-869b-78a60a013a7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:16.603029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21d85b64-2ffc-4bd9-869b-78a60a013a7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:16.603460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-21d85b64-2ffc-4bd9-869b-78a60a013a7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:16.604575 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e181051a-21a9-4e87-92bd-f364c7208b97 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:16.605034 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e181051a-21a9-4e87-92bd-f364c7208b97 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:16.605975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e181051a-21a9-4e87-92bd-f364c7208b97 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:16.606416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e181051a-21a9-4e87-92bd-f364c7208b97 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:16.798764 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-21d85b64-2ffc-4bd9-869b-78a60a013a7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:16.801917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e181051a-21a9-4e87-92bd-f364c7208b97 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:16.806754 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-21d85b64-2ffc-4bd9-869b-78a60a013a7e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.216572 Aug 04 05:01:16.807337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1037/2072] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:16.810523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e181051a-21a9-4e87-92bd-f364c7208b97 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.217815 Aug 04 05:01:16.811210 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1036/2073] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:16 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:16.811810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7d363530-53a0-425a-8d40-86839986b8b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:16.812914 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7d363530-53a0-425a-8d40-86839986b8b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:16.818870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d363530-53a0-425a-8d40-86839986b8b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:16.819313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d363530-53a0-425a-8d40-86839986b8b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:16.820075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d363530-53a0-425a-8d40-86839986b8b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:16.820506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7d363530-53a0-425a-8d40-86839986b8b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:16.883232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7d363530-53a0-425a-8d40-86839986b8b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:16.891909 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7d363530-53a0-425a-8d40-86839986b8b7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083575 Aug 04 05:01:16.892467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1038/2074] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:16 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:17.827666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6e471a63-87fa-4086-a129-0be3e129e23d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:17.828329 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6e471a63-87fa-4086-a129-0be3e129e23d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:17.832631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4b4d3145-0348-481c-8146-0a21bd4a1ccc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:17.833491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4b4d3145-0348-481c-8146-0a21bd4a1ccc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:17.835062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6e471a63-87fa-4086-a129-0be3e129e23d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:17.835379 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6e471a63-87fa-4086-a129-0be3e129e23d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:17.836143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6e471a63-87fa-4086-a129-0be3e129e23d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:17.836587 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6e471a63-87fa-4086-a129-0be3e129e23d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:17.839924 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b4d3145-0348-481c-8146-0a21bd4a1ccc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:17.840382 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b4d3145-0348-481c-8146-0a21bd4a1ccc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:17.841157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b4d3145-0348-481c-8146-0a21bd4a1ccc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:17.841623 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b4d3145-0348-481c-8146-0a21bd4a1ccc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:18.029364 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6e471a63-87fa-4086-a129-0be3e129e23d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:18.032925 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4b4d3145-0348-481c-8146-0a21bd4a1ccc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:18.038219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6e471a63-87fa-4086-a129-0be3e129e23d tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.214493 Aug 04 05:01:18.038802 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1037/2075] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:17 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:18.041070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4b4d3145-0348-481c-8146-0a21bd4a1ccc tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.212884 Aug 04 05:01:18.043884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5dc93460-7e1d-44a9-a6ba-e1a1b7459f9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:18.044494 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5dc93460-7e1d-44a9-a6ba-e1a1b7459f9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:18.050929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5dc93460-7e1d-44a9-a6ba-e1a1b7459f9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:18.051382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5dc93460-7e1d-44a9-a6ba-e1a1b7459f9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:18.052134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5dc93460-7e1d-44a9-a6ba-e1a1b7459f9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:18.052671 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1039/2076] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:17 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:18.052814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5dc93460-7e1d-44a9-a6ba-e1a1b7459f9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:18.112005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5dc93460-7e1d-44a9-a6ba-e1a1b7459f9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:18.119830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5dc93460-7e1d-44a9-a6ba-e1a1b7459f9e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080097 Aug 04 05:01:18.120380 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1038/2077] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:18 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:19.059971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-87ef1684-e102-4d94-9c40-41a051b7f9a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:19.060643 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-87ef1684-e102-4d94-9c40-41a051b7f9a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:19.063018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5c3c2a7b-2b2d-481b-8b9a-70f93c70ce50 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:19.063680 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5c3c2a7b-2b2d-481b-8b9a-70f93c70ce50 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:19.068298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-87ef1684-e102-4d94-9c40-41a051b7f9a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:19.068748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-87ef1684-e102-4d94-9c40-41a051b7f9a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:19.069521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-87ef1684-e102-4d94-9c40-41a051b7f9a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:19.069994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-87ef1684-e102-4d94-9c40-41a051b7f9a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:19.070191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c3c2a7b-2b2d-481b-8b9a-70f93c70ce50 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:19.070643 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c3c2a7b-2b2d-481b-8b9a-70f93c70ce50 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:19.071439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c3c2a7b-2b2d-481b-8b9a-70f93c70ce50 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:19.071872 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5c3c2a7b-2b2d-481b-8b9a-70f93c70ce50 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:19.262668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5c3c2a7b-2b2d-481b-8b9a-70f93c70ce50 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:19.267802 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-87ef1684-e102-4d94-9c40-41a051b7f9a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:19.271391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5c3c2a7b-2b2d-481b-8b9a-70f93c70ce50 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.212834 Aug 04 05:01:19.271963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1039/2078] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:19 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:19.276078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-87ef1684-e102-4d94-9c40-41a051b7f9a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.220000 Aug 04 05:01:19.276355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eacc8e02-1185-4169-b836-dc0330febb70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:19.276645 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1040/2079] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:19.277224 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eacc8e02-1185-4169-b836-dc0330febb70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:19.290543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eacc8e02-1185-4169-b836-dc0330febb70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:19.290991 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eacc8e02-1185-4169-b836-dc0330febb70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:19.291752 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eacc8e02-1185-4169-b836-dc0330febb70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:19.292185 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eacc8e02-1185-4169-b836-dc0330febb70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:19.352712 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-eacc8e02-1185-4169-b836-dc0330febb70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:19.361302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eacc8e02-1185-4169-b836-dc0330febb70 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.088388 Aug 04 05:01:19.361902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1040/2080] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:19 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:20.297612 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ea73ee47-a118-45dd-963d-a016f3c7ae82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:20.298397 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ea73ee47-a118-45dd-963d-a016f3c7ae82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:20.298584 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e57d0fce-4737-4d1e-a1a4-72cbc477e6a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:20.299086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e57d0fce-4737-4d1e-a1a4-72cbc477e6a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:20.305023 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea73ee47-a118-45dd-963d-a016f3c7ae82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:20.305472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea73ee47-a118-45dd-963d-a016f3c7ae82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:20.305642 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e57d0fce-4737-4d1e-a1a4-72cbc477e6a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:20.306027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e57d0fce-4737-4d1e-a1a4-72cbc477e6a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:20.306274 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea73ee47-a118-45dd-963d-a016f3c7ae82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:20.306704 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea73ee47-a118-45dd-963d-a016f3c7ae82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:20.306834 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e57d0fce-4737-4d1e-a1a4-72cbc477e6a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:20.307300 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e57d0fce-4737-4d1e-a1a4-72cbc477e6a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:20.516656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ea73ee47-a118-45dd-963d-a016f3c7ae82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:20.520829 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e57d0fce-4737-4d1e-a1a4-72cbc477e6a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:20.524697 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ea73ee47-a118-45dd-963d-a016f3c7ae82 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.232183 Aug 04 05:01:20.525258 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1041/2081] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:20.529979 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-69fd7bed-c1f8-413a-9d2e-712626ae1d7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:20.530580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-69fd7bed-c1f8-413a-9d2e-712626ae1d7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:20.532192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e57d0fce-4737-4d1e-a1a4-72cbc477e6a7 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.239597 Aug 04 05:01:20.532948 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1041/2082] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:20 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:20.537396 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-69fd7bed-c1f8-413a-9d2e-712626ae1d7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:20.537884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-69fd7bed-c1f8-413a-9d2e-712626ae1d7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:20.538641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-69fd7bed-c1f8-413a-9d2e-712626ae1d7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:20.539071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-69fd7bed-c1f8-413a-9d2e-712626ae1d7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:20.603496 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-69fd7bed-c1f8-413a-9d2e-712626ae1d7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:20.612368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-69fd7bed-c1f8-413a-9d2e-712626ae1d7e tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086064 Aug 04 05:01:20.612938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1042/2083] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:20 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:21.547874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f6668963-17ee-4492-b59e-3a015083f7d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:21.548488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f6668963-17ee-4492-b59e-3a015083f7d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:21.553667 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-17147cfe-0b1d-4011-8765-3c4d6ce73dc2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:21.554285 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-17147cfe-0b1d-4011-8765-3c4d6ce73dc2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] [instance: dbf81135-dc56-4991-b7a5-0ed62f3fc2a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:21.555078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f6668963-17ee-4492-b59e-3a015083f7d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:21.555533 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f6668963-17ee-4492-b59e-3a015083f7d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:21.556300 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f6668963-17ee-4492-b59e-3a015083f7d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:21.556736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f6668963-17ee-4492-b59e-3a015083f7d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:21.560669 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-17147cfe-0b1d-4011-8765-3c4d6ce73dc2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:21.561134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-17147cfe-0b1d-4011-8765-3c4d6ce73dc2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:21.561930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-17147cfe-0b1d-4011-8765-3c4d6ce73dc2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:21.562879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-17147cfe-0b1d-4011-8765-3c4d6ce73dc2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:21.993229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f6668963-17ee-4492-b59e-3a015083f7d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:22.000465 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-17147cfe-0b1d-4011-8765-3c4d6ce73dc2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd604afd3c4234473ac1f2fcff2501743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58d8f4b47019401ab6e953bbbbd801fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:22.001979 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f6668963-17ee-4492-b59e-3a015083f7d9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.458733 Aug 04 05:01:22.002554 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1042/2084] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:21 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:22.007205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-37455659-291c-4796-aaa4-1eaee5b15446 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:22.007807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-37455659-291c-4796-aaa4-1eaee5b15446 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:22.008390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-17147cfe-0b1d-4011-8765-3c4d6ce73dc2 tempest-VolumesSnapshotTestJSON-1570130459 tempest-VolumesSnapshotTestJSON-1570130459-project] 10.222.0.47 "GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6" status: 200 len: 1560 microversion: 2.1 time: 0.458603 Aug 04 05:01:22.009106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1043/2085] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:21 2022] GET /compute/v2.1/servers/dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 => generated 1560 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:22.013862 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-37455659-291c-4796-aaa4-1eaee5b15446 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:22.014313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-37455659-291c-4796-aaa4-1eaee5b15446 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:22.015076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-37455659-291c-4796-aaa4-1eaee5b15446 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:22.016146 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-37455659-291c-4796-aaa4-1eaee5b15446 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:22.081537 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-37455659-291c-4796-aaa4-1eaee5b15446 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:22.089750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-37455659-291c-4796-aaa4-1eaee5b15446 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086198 Aug 04 05:01:22.090636 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1043/2086] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:22 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:23.024238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f8a2b7d3-704b-4ae7-964d-cc3e3736a39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:23.024856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f8a2b7d3-704b-4ae7-964d-cc3e3736a39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:23.032101 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8a2b7d3-704b-4ae7-964d-cc3e3736a39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:23.032555 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8a2b7d3-704b-4ae7-964d-cc3e3736a39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:23.033316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8a2b7d3-704b-4ae7-964d-cc3e3736a39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:23.033790 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8a2b7d3-704b-4ae7-964d-cc3e3736a39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:23.111289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c8c93792-f055-44ea-8b9f-a0f6f9118b1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:23.111912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c8c93792-f055-44ea-8b9f-a0f6f9118b1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:23.117992 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c8c93792-f055-44ea-8b9f-a0f6f9118b1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:23.118439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c8c93792-f055-44ea-8b9f-a0f6f9118b1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:23.119204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c8c93792-f055-44ea-8b9f-a0f6f9118b1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:23.119637 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c8c93792-f055-44ea-8b9f-a0f6f9118b1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:23.170661 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f8a2b7d3-704b-4ae7-964d-cc3e3736a39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:23.179759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f8a2b7d3-704b-4ae7-964d-cc3e3736a39c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.159330 Aug 04 05:01:23.180331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1044/2087] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:23 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:23.186886 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c8c93792-f055-44ea-8b9f-a0f6f9118b1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:23.195073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c8c93792-f055-44ea-8b9f-a0f6f9118b1f tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.088512 Aug 04 05:01:23.195625 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1044/2088] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:23 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:24.200188 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6212b6f7-1911-4e2a-869f-5f648917136e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:24.200739 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6212b6f7-1911-4e2a-869f-5f648917136e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:24.208051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6212b6f7-1911-4e2a-869f-5f648917136e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:24.208503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6212b6f7-1911-4e2a-869f-5f648917136e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:24.209266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6212b6f7-1911-4e2a-869f-5f648917136e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:24.209744 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6212b6f7-1911-4e2a-869f-5f648917136e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:24.216045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-826a9016-a07a-4f3c-9ce3-8e6014b47d5c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:24.216656 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-826a9016-a07a-4f3c-9ce3-8e6014b47d5c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:24.223911 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-826a9016-a07a-4f3c-9ce3-8e6014b47d5c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:24.224351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-826a9016-a07a-4f3c-9ce3-8e6014b47d5c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:24.225184 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-826a9016-a07a-4f3c-9ce3-8e6014b47d5c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:24.225928 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-826a9016-a07a-4f3c-9ce3-8e6014b47d5c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:24.307195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-826a9016-a07a-4f3c-9ce3-8e6014b47d5c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:24.316235 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-826a9016-a07a-4f3c-9ce3-8e6014b47d5c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.103993 Aug 04 05:01:24.316815 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1045/2089] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:24 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:24.367668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6212b6f7-1911-4e2a-869f-5f648917136e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:24.376052 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6212b6f7-1911-4e2a-869f-5f648917136e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.179779 Aug 04 05:01:24.376602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1045/2090] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:24 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:25.337829 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-66b229a5-d82a-4673-a77b-5cc61b02066d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:25.338432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-66b229a5-d82a-4673-a77b-5cc61b02066d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:25.345289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66b229a5-d82a-4673-a77b-5cc61b02066d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:25.345775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66b229a5-d82a-4673-a77b-5cc61b02066d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:25.346591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66b229a5-d82a-4673-a77b-5cc61b02066d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:25.347027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66b229a5-d82a-4673-a77b-5cc61b02066d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:25.396266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-86a8b349-b8ff-4e4a-b05b-b6352ec8fd18 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:25.396878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-86a8b349-b8ff-4e4a-b05b-b6352ec8fd18 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:25.403398 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86a8b349-b8ff-4e4a-b05b-b6352ec8fd18 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:25.403853 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86a8b349-b8ff-4e4a-b05b-b6352ec8fd18 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:25.404653 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86a8b349-b8ff-4e4a-b05b-b6352ec8fd18 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:25.405087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86a8b349-b8ff-4e4a-b05b-b6352ec8fd18 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:25.409276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-66b229a5-d82a-4673-a77b-5cc61b02066d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:25.417075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-66b229a5-d82a-4673-a77b-5cc61b02066d tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083169 Aug 04 05:01:25.417657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1046/2091] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:25 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:25.535477 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-86a8b349-b8ff-4e4a-b05b-b6352ec8fd18 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:25.543464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-86a8b349-b8ff-4e4a-b05b-b6352ec8fd18 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151004 Aug 04 05:01:25.544022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1046/2092] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:25 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:26.439664 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e5eb08bd-6bcd-4309-b1a9-45df650b7756 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:26.440266 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e5eb08bd-6bcd-4309-b1a9-45df650b7756 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:26.446712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5eb08bd-6bcd-4309-b1a9-45df650b7756 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:26.447156 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5eb08bd-6bcd-4309-b1a9-45df650b7756 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:26.447908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5eb08bd-6bcd-4309-b1a9-45df650b7756 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:26.448336 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e5eb08bd-6bcd-4309-b1a9-45df650b7756 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:26.509147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e5eb08bd-6bcd-4309-b1a9-45df650b7756 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:26.517201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e5eb08bd-6bcd-4309-b1a9-45df650b7756 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082165 Aug 04 05:01:26.517787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1047/2093] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:26 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:26.564061 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-572e4542-0a68-4553-a77f-814b6b2e4cbc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:26.564667 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-572e4542-0a68-4553-a77f-814b6b2e4cbc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:26.571165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-572e4542-0a68-4553-a77f-814b6b2e4cbc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:26.571612 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-572e4542-0a68-4553-a77f-814b6b2e4cbc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:26.572358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-572e4542-0a68-4553-a77f-814b6b2e4cbc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:26.572792 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-572e4542-0a68-4553-a77f-814b6b2e4cbc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:26.701980 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-572e4542-0a68-4553-a77f-814b6b2e4cbc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:26.709967 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-572e4542-0a68-4553-a77f-814b6b2e4cbc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149760 Aug 04 05:01:26.710528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1047/2094] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:26 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:27.538107 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2df6d21a-3c05-4b58-8d97-7908f67ad19b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:27.538728 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2df6d21a-3c05-4b58-8d97-7908f67ad19b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:27.545483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2df6d21a-3c05-4b58-8d97-7908f67ad19b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:27.545966 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2df6d21a-3c05-4b58-8d97-7908f67ad19b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:27.547712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2df6d21a-3c05-4b58-8d97-7908f67ad19b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:27.548177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2df6d21a-3c05-4b58-8d97-7908f67ad19b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:27.611903 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2df6d21a-3c05-4b58-8d97-7908f67ad19b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:27.614257 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:27.621296 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2df6d21a-3c05-4b58-8d97-7908f67ad19b tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.087105 Aug 04 05:01:27.621906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1048/2095] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:27 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:27.730900 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-24326588-db0d-42b9-a4ef-026be985acb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:27.731514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-24326588-db0d-42b9-a4ef-026be985acb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:27.739082 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24326588-db0d-42b9-a4ef-026be985acb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:27.739531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24326588-db0d-42b9-a4ef-026be985acb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:27.740288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24326588-db0d-42b9-a4ef-026be985acb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:27.740724 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-24326588-db0d-42b9-a4ef-026be985acb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:27.868128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-24326588-db0d-42b9-a4ef-026be985acb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:27.876766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-24326588-db0d-42b9-a4ef-026be985acb3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149642 Aug 04 05:01:27.877332 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1048/2096] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:27 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:28.643076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1f23df64-2a4f-45da-b149-636450b2a2a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:28.643684 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1f23df64-2a4f-45da-b149-636450b2a2a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:28.650208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1f23df64-2a4f-45da-b149-636450b2a2a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:28.650661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1f23df64-2a4f-45da-b149-636450b2a2a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:28.651424 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1f23df64-2a4f-45da-b149-636450b2a2a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:28.651862 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1f23df64-2a4f-45da-b149-636450b2a2a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:28.718103 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1f23df64-2a4f-45da-b149-636450b2a2a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:28.727001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1f23df64-2a4f-45da-b149-636450b2a2a2 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.088376 Aug 04 05:01:28.727565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1049/2097] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:28 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:28.897612 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0dd7f708-0eac-4655-8e4a-508ce31e05ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:28.898222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0dd7f708-0eac-4655-8e4a-508ce31e05ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:28.904632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0dd7f708-0eac-4655-8e4a-508ce31e05ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:28.905078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0dd7f708-0eac-4655-8e4a-508ce31e05ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:28.905856 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0dd7f708-0eac-4655-8e4a-508ce31e05ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:28.906281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0dd7f708-0eac-4655-8e4a-508ce31e05ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:29.038420 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0dd7f708-0eac-4655-8e4a-508ce31e05ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:29.046727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0dd7f708-0eac-4655-8e4a-508ce31e05ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152690 Aug 04 05:01:29.047435 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1049/2098] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:28 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:29.748965 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-99e5ccf2-65c9-4a4c-b210-21534f053f03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:29.749579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-99e5ccf2-65c9-4a4c-b210-21534f053f03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:29.756305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99e5ccf2-65c9-4a4c-b210-21534f053f03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:29.756697 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99e5ccf2-65c9-4a4c-b210-21534f053f03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:29.757462 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99e5ccf2-65c9-4a4c-b210-21534f053f03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:29.757922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-99e5ccf2-65c9-4a4c-b210-21534f053f03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:29.818270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-99e5ccf2-65c9-4a4c-b210-21534f053f03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:29.826055 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-99e5ccf2-65c9-4a4c-b210-21534f053f03 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080991 Aug 04 05:01:29.826616 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1050/2099] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:29 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:30.067789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ab565fdc-07ea-42e8-9786-00f3e0b31682 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:30.068429 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ab565fdc-07ea-42e8-9786-00f3e0b31682 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:30.070858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=72 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:30.076391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab565fdc-07ea-42e8-9786-00f3e0b31682 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:30.076840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab565fdc-07ea-42e8-9786-00f3e0b31682 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:30.078180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab565fdc-07ea-42e8-9786-00f3e0b31682 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:30.078641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ab565fdc-07ea-42e8-9786-00f3e0b31682 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:30.208342 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ab565fdc-07ea-42e8-9786-00f3e0b31682 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:30.210592 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:30.217396 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ab565fdc-07ea-42e8-9786-00f3e0b31682 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153430 Aug 04 05:01:30.218218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1050/2100] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:30 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:30.847201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c6d8c4c2-e553-44e5-be66-3d7c25858fbe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:30.847853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c6d8c4c2-e553-44e5-be66-3d7c25858fbe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:30.850160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=64 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:30.855544 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6d8c4c2-e553-44e5-be66-3d7c25858fbe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:30.855997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6d8c4c2-e553-44e5-be66-3d7c25858fbe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:30.856766 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6d8c4c2-e553-44e5-be66-3d7c25858fbe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:30.857204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c6d8c4c2-e553-44e5-be66-3d7c25858fbe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:30.921013 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c6d8c4c2-e553-44e5-be66-3d7c25858fbe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:30.929921 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c6d8c4c2-e553-44e5-be66-3d7c25858fbe tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.087033 Aug 04 05:01:30.930481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1051/2101] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:30 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:31.239299 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-111dd113-8b84-47a5-9d8e-af787ab62781 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:31.239918 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-111dd113-8b84-47a5-9d8e-af787ab62781 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:31.246486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-111dd113-8b84-47a5-9d8e-af787ab62781 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:31.246941 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-111dd113-8b84-47a5-9d8e-af787ab62781 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:31.247733 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-111dd113-8b84-47a5-9d8e-af787ab62781 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:31.248213 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-111dd113-8b84-47a5-9d8e-af787ab62781 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:31.375720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-111dd113-8b84-47a5-9d8e-af787ab62781 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:31.383646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-111dd113-8b84-47a5-9d8e-af787ab62781 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148815 Aug 04 05:01:31.384198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1051/2102] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:31 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:31.951178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ec47778f-5708-4294-b14f-3acc81630538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:31.951796 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ec47778f-5708-4294-b14f-3acc81630538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:31.958570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ec47778f-5708-4294-b14f-3acc81630538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:31.959015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ec47778f-5708-4294-b14f-3acc81630538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:31.959768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ec47778f-5708-4294-b14f-3acc81630538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:31.960198 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ec47778f-5708-4294-b14f-3acc81630538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:32.021621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ec47778f-5708-4294-b14f-3acc81630538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:32.029433 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ec47778f-5708-4294-b14f-3acc81630538 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082167 Aug 04 05:01:32.030019 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1052/2103] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:31 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:32.405446 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7e0a53dd-9960-42c1-a62b-97dce48cf9d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:32.406096 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7e0a53dd-9960-42c1-a62b-97dce48cf9d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:32.413380 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7e0a53dd-9960-42c1-a62b-97dce48cf9d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:32.413857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7e0a53dd-9960-42c1-a62b-97dce48cf9d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:32.414610 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7e0a53dd-9960-42c1-a62b-97dce48cf9d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:32.415040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7e0a53dd-9960-42c1-a62b-97dce48cf9d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:32.548567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7e0a53dd-9960-42c1-a62b-97dce48cf9d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:32.556480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7e0a53dd-9960-42c1-a62b-97dce48cf9d6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.154877 Aug 04 05:01:32.557042 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1052/2104] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:32 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:33.050372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c872f272-3c41-47a6-b3c0-6e44ab97ddca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:33.051009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c872f272-3c41-47a6-b3c0-6e44ab97ddca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:33.057373 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c872f272-3c41-47a6-b3c0-6e44ab97ddca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:33.057853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c872f272-3c41-47a6-b3c0-6e44ab97ddca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:33.058610 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c872f272-3c41-47a6-b3c0-6e44ab97ddca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:33.059043 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c872f272-3c41-47a6-b3c0-6e44ab97ddca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:33.120292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c872f272-3c41-47a6-b3c0-6e44ab97ddca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:33.128284 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c872f272-3c41-47a6-b3c0-6e44ab97ddca tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082064 Aug 04 05:01:33.128842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1053/2105] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:33 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:33.577307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-42651486-e070-48ed-b8b0-c0fd42657b69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:33.577939 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-42651486-e070-48ed-b8b0-c0fd42657b69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:33.584946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-42651486-e070-48ed-b8b0-c0fd42657b69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:33.585387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-42651486-e070-48ed-b8b0-c0fd42657b69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:33.586172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-42651486-e070-48ed-b8b0-c0fd42657b69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:33.586610 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-42651486-e070-48ed-b8b0-c0fd42657b69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:33.713275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-42651486-e070-48ed-b8b0-c0fd42657b69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:33.721389 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-42651486-e070-48ed-b8b0-c0fd42657b69 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.147983 Aug 04 05:01:33.722060 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1053/2106] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:33 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:34.148985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b1786e71-b366-4ed3-8a95-e33d05f75f20 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:34.149634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b1786e71-b366-4ed3-8a95-e33d05f75f20 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:34.156089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1786e71-b366-4ed3-8a95-e33d05f75f20 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:34.157094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1786e71-b366-4ed3-8a95-e33d05f75f20 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:34.157963 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1786e71-b366-4ed3-8a95-e33d05f75f20 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:34.158397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b1786e71-b366-4ed3-8a95-e33d05f75f20 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:34.221217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b1786e71-b366-4ed3-8a95-e33d05f75f20 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:34.229098 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b1786e71-b366-4ed3-8a95-e33d05f75f20 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084060 Aug 04 05:01:34.229682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1054/2107] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:34 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:34.743188 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b427ae3c-f8fb-4af9-9357-6ea965d331ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:34.743879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b427ae3c-f8fb-4af9-9357-6ea965d331ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:34.751875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b427ae3c-f8fb-4af9-9357-6ea965d331ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:34.752324 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b427ae3c-f8fb-4af9-9357-6ea965d331ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:34.753079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b427ae3c-f8fb-4af9-9357-6ea965d331ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:34.753514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b427ae3c-f8fb-4af9-9357-6ea965d331ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:34.881079 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b427ae3c-f8fb-4af9-9357-6ea965d331ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:34.889052 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b427ae3c-f8fb-4af9-9357-6ea965d331ee tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150182 Aug 04 05:01:34.889629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1054/2108] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:34 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:35.250940 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6378341b-ebe5-4c68-aa9a-253e45a49e90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:35.251511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6378341b-ebe5-4c68-aa9a-253e45a49e90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:35.258154 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6378341b-ebe5-4c68-aa9a-253e45a49e90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:35.258610 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6378341b-ebe5-4c68-aa9a-253e45a49e90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:35.259374 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6378341b-ebe5-4c68-aa9a-253e45a49e90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:35.259814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6378341b-ebe5-4c68-aa9a-253e45a49e90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:35.321634 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6378341b-ebe5-4c68-aa9a-253e45a49e90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:35.330588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6378341b-ebe5-4c68-aa9a-253e45a49e90 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083827 Aug 04 05:01:35.331157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1055/2109] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:35 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:35.910158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f8b1e183-95f7-4911-a6bb-1f5e681ad491 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:35.910776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f8b1e183-95f7-4911-a6bb-1f5e681ad491 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:35.917282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8b1e183-95f7-4911-a6bb-1f5e681ad491 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:35.917766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8b1e183-95f7-4911-a6bb-1f5e681ad491 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:35.918525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8b1e183-95f7-4911-a6bb-1f5e681ad491 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:35.918963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8b1e183-95f7-4911-a6bb-1f5e681ad491 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:36.052837 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f8b1e183-95f7-4911-a6bb-1f5e681ad491 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:36.060769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f8b1e183-95f7-4911-a6bb-1f5e681ad491 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.154590 Aug 04 05:01:36.061330 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1055/2110] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:35 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:36.352242 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4fa2d8f5-f0c1-499b-abd9-dd3df9a47906 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:36.352866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4fa2d8f5-f0c1-499b-abd9-dd3df9a47906 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:36.359457 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4fa2d8f5-f0c1-499b-abd9-dd3df9a47906 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:36.360017 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4fa2d8f5-f0c1-499b-abd9-dd3df9a47906 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:36.360821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4fa2d8f5-f0c1-499b-abd9-dd3df9a47906 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:36.361260 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4fa2d8f5-f0c1-499b-abd9-dd3df9a47906 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:36.422196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4fa2d8f5-f0c1-499b-abd9-dd3df9a47906 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:36.430385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4fa2d8f5-f0c1-499b-abd9-dd3df9a47906 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081955 Aug 04 05:01:36.430885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1056/2111] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:36 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:37.081382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e5e44d01-c6cf-4bea-a918-f58e13f1c58f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:37.081956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e5e44d01-c6cf-4bea-a918-f58e13f1c58f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:37.088526 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e5e44d01-c6cf-4bea-a918-f58e13f1c58f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:37.088972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e5e44d01-c6cf-4bea-a918-f58e13f1c58f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:37.089763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e5e44d01-c6cf-4bea-a918-f58e13f1c58f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:37.090201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e5e44d01-c6cf-4bea-a918-f58e13f1c58f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:37.223365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e5e44d01-c6cf-4bea-a918-f58e13f1c58f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:37.231186 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e5e44d01-c6cf-4bea-a918-f58e13f1c58f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153763 Aug 04 05:01:37.231740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1056/2112] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:37 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:37.451397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-af2caef7-4c74-488a-b3d1-76010264e3cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:37.451942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-af2caef7-4c74-488a-b3d1-76010264e3cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:37.458937 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af2caef7-4c74-488a-b3d1-76010264e3cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:37.459399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af2caef7-4c74-488a-b3d1-76010264e3cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:37.460134 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af2caef7-4c74-488a-b3d1-76010264e3cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:37.460562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-af2caef7-4c74-488a-b3d1-76010264e3cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:37.525021 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-af2caef7-4c74-488a-b3d1-76010264e3cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:37.533913 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-af2caef7-4c74-488a-b3d1-76010264e3cb tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.086364 Aug 04 05:01:37.534477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1057/2113] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:37 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:38.252825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-642f120f-c7d2-4b1c-a70d-dbf0c4a359cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:38.253358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-642f120f-c7d2-4b1c-a70d-dbf0c4a359cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:38.259837 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-642f120f-c7d2-4b1c-a70d-dbf0c4a359cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:38.260287 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-642f120f-c7d2-4b1c-a70d-dbf0c4a359cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:38.261043 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-642f120f-c7d2-4b1c-a70d-dbf0c4a359cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:38.261478 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-642f120f-c7d2-4b1c-a70d-dbf0c4a359cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:38.393594 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-642f120f-c7d2-4b1c-a70d-dbf0c4a359cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:38.401424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-642f120f-c7d2-4b1c-a70d-dbf0c4a359cc tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153161 Aug 04 05:01:38.402009 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1057/2114] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:38 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:38.555278 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-46284cf9-ad23-4025-9c5c-0802adbb27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:38.555892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-46284cf9-ad23-4025-9c5c-0802adbb27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:38.562440 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46284cf9-ad23-4025-9c5c-0802adbb27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:38.562956 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46284cf9-ad23-4025-9c5c-0802adbb27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:38.563709 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46284cf9-ad23-4025-9c5c-0802adbb27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:38.564141 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46284cf9-ad23-4025-9c5c-0802adbb27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:38.626131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-46284cf9-ad23-4025-9c5c-0802adbb27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:38.633902 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-46284cf9-ad23-4025-9c5c-0802adbb27bc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082420 Aug 04 05:01:38.634460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1058/2115] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:38 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:39.423131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1fd9c462-c949-4a21-a669-90e55d115e8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:39.423748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1fd9c462-c949-4a21-a669-90e55d115e8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:39.430221 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1fd9c462-c949-4a21-a669-90e55d115e8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:39.430665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1fd9c462-c949-4a21-a669-90e55d115e8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:39.431411 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1fd9c462-c949-4a21-a669-90e55d115e8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:39.431843 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1fd9c462-c949-4a21-a669-90e55d115e8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:39.564115 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1fd9c462-c949-4a21-a669-90e55d115e8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:39.571974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1fd9c462-c949-4a21-a669-90e55d115e8c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153277 Aug 04 05:01:39.572537 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1058/2116] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:39 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:39.654387 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4d954a70-8e47-4aaa-9ec8-0360caa9ef72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:39.654996 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4d954a70-8e47-4aaa-9ec8-0360caa9ef72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:39.662003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4d954a70-8e47-4aaa-9ec8-0360caa9ef72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:39.662448 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4d954a70-8e47-4aaa-9ec8-0360caa9ef72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:39.663205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4d954a70-8e47-4aaa-9ec8-0360caa9ef72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:39.663640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4d954a70-8e47-4aaa-9ec8-0360caa9ef72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:39.725237 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4d954a70-8e47-4aaa-9ec8-0360caa9ef72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:39.733045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4d954a70-8e47-4aaa-9ec8-0360caa9ef72 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082519 Aug 04 05:01:39.733613 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1059/2117] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:39 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:40.593405 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-be56fce0-4dde-4077-8d94-2508ab635114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:40.594644 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-be56fce0-4dde-4077-8d94-2508ab635114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:40.601028 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be56fce0-4dde-4077-8d94-2508ab635114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:40.601475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be56fce0-4dde-4077-8d94-2508ab635114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:40.602250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be56fce0-4dde-4077-8d94-2508ab635114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:40.602691 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be56fce0-4dde-4077-8d94-2508ab635114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:40.729833 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-be56fce0-4dde-4077-8d94-2508ab635114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:40.737722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-be56fce0-4dde-4077-8d94-2508ab635114 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148100 Aug 04 05:01:40.738286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1059/2118] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:40 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:40.754955 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ea367abc-4892-4630-83b8-823a5fa0b1dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:40.755596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ea367abc-4892-4630-83b8-823a5fa0b1dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:40.762044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ea367abc-4892-4630-83b8-823a5fa0b1dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:40.762523 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ea367abc-4892-4630-83b8-823a5fa0b1dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:40.763282 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ea367abc-4892-4630-83b8-823a5fa0b1dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:40.763722 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ea367abc-4892-4630-83b8-823a5fa0b1dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:40.827592 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ea367abc-4892-4630-83b8-823a5fa0b1dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:40.836086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ea367abc-4892-4630-83b8-823a5fa0b1dc tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084950 Aug 04 05:01:40.836649 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1060/2119] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:40 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:41.760539 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-98be422e-8706-418c-88ad-c9e7fdc2b4f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:41.761071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-98be422e-8706-418c-88ad-c9e7fdc2b4f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:41.767740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-98be422e-8706-418c-88ad-c9e7fdc2b4f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:41.768191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-98be422e-8706-418c-88ad-c9e7fdc2b4f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:41.768952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-98be422e-8706-418c-88ad-c9e7fdc2b4f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:41.769485 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-98be422e-8706-418c-88ad-c9e7fdc2b4f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:41.856250 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f6dc1e35-2a22-484c-9802-ed5f3c423a46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:41.856870 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f6dc1e35-2a22-484c-9802-ed5f3c423a46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:41.863647 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f6dc1e35-2a22-484c-9802-ed5f3c423a46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:41.864098 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f6dc1e35-2a22-484c-9802-ed5f3c423a46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:41.864900 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f6dc1e35-2a22-484c-9802-ed5f3c423a46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:41.865337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f6dc1e35-2a22-484c-9802-ed5f3c423a46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:41.900906 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-98be422e-8706-418c-88ad-c9e7fdc2b4f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:41.909600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-98be422e-8706-418c-88ad-c9e7fdc2b4f6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152971 Aug 04 05:01:41.910198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1060/2120] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:41 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:41.930003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f6dc1e35-2a22-484c-9802-ed5f3c423a46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:41.938214 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f6dc1e35-2a22-484c-9802-ed5f3c423a46 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085761 Aug 04 05:01:41.938791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1061/2121] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:41 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:42.931334 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2cbeea35-3a3a-4f41-85d1-83c57a66d807 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:42.931953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2cbeea35-3a3a-4f41-85d1-83c57a66d807 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:42.939485 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2cbeea35-3a3a-4f41-85d1-83c57a66d807 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:42.939937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2cbeea35-3a3a-4f41-85d1-83c57a66d807 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:42.940725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2cbeea35-3a3a-4f41-85d1-83c57a66d807 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:42.941163 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2cbeea35-3a3a-4f41-85d1-83c57a66d807 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:42.958922 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2c5dc55c-b33d-4241-a059-8c73a57c419a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:42.959568 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2c5dc55c-b33d-4241-a059-8c73a57c419a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:42.965973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2c5dc55c-b33d-4241-a059-8c73a57c419a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:42.966429 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2c5dc55c-b33d-4241-a059-8c73a57c419a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:42.967192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2c5dc55c-b33d-4241-a059-8c73a57c419a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:42.967628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2c5dc55c-b33d-4241-a059-8c73a57c419a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:43.038429 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2c5dc55c-b33d-4241-a059-8c73a57c419a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:43.046606 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2c5dc55c-b33d-4241-a059-8c73a57c419a tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.091221 Aug 04 05:01:43.047737 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1062/2122] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:42 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:43.095448 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2cbeea35-3a3a-4f41-85d1-83c57a66d807 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:43.103465 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2cbeea35-3a3a-4f41-85d1-83c57a66d807 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.176124 Aug 04 05:01:43.104030 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1061/2123] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:42 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:44.068543 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f050d3f2-7f1d-47f3-ba3d-5d5441434d33 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:44.069163 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f050d3f2-7f1d-47f3-ba3d-5d5441434d33 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:44.075727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f050d3f2-7f1d-47f3-ba3d-5d5441434d33 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:44.076183 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f050d3f2-7f1d-47f3-ba3d-5d5441434d33 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:44.076945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f050d3f2-7f1d-47f3-ba3d-5d5441434d33 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:44.077392 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f050d3f2-7f1d-47f3-ba3d-5d5441434d33 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:44.124159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c2ac2125-0100-4b0f-af3c-2ccffedca987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:44.124764 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c2ac2125-0100-4b0f-af3c-2ccffedca987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:44.131912 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c2ac2125-0100-4b0f-af3c-2ccffedca987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:44.132371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c2ac2125-0100-4b0f-af3c-2ccffedca987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:44.133139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c2ac2125-0100-4b0f-af3c-2ccffedca987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:44.133599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c2ac2125-0100-4b0f-af3c-2ccffedca987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:44.140590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f050d3f2-7f1d-47f3-ba3d-5d5441434d33 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:44.148655 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f050d3f2-7f1d-47f3-ba3d-5d5441434d33 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083952 Aug 04 05:01:44.149212 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1063/2124] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:44 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:44.266330 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c2ac2125-0100-4b0f-af3c-2ccffedca987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:44.274217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c2ac2125-0100-4b0f-af3c-2ccffedca987 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153942 Aug 04 05:01:44.274792 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1062/2125] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:44 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:01:45.169947 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8bce2f44-c2f3-4531-92fe-07fa3f2ac359 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:45.170565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8bce2f44-c2f3-4531-92fe-07fa3f2ac359 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:45.177454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8bce2f44-c2f3-4531-92fe-07fa3f2ac359 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:45.177928 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8bce2f44-c2f3-4531-92fe-07fa3f2ac359 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:45.178978 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8bce2f44-c2f3-4531-92fe-07fa3f2ac359 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:45.178978 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8bce2f44-c2f3-4531-92fe-07fa3f2ac359 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:45.238992 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8bce2f44-c2f3-4531-92fe-07fa3f2ac359 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:45.246755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8bce2f44-c2f3-4531-92fe-07fa3f2ac359 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.080645 Aug 04 05:01:45.247305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1064/2126] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:45 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:45.296331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-803df1ff-6cff-43c6-801f-75971affc7f7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:45.297188 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-803df1ff-6cff-43c6-801f-75971affc7f7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:45.303771 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-803df1ff-6cff-43c6-801f-75971affc7f7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:45.304226 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-803df1ff-6cff-43c6-801f-75971affc7f7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:45.304979 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-803df1ff-6cff-43c6-801f-75971affc7f7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:45.305415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-803df1ff-6cff-43c6-801f-75971affc7f7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:45.433313 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-803df1ff-6cff-43c6-801f-75971affc7f7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:45.442368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-803df1ff-6cff-43c6-801f-75971affc7f7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150157 Aug 04 05:01:45.442930 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1063/2127] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:45 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:46.268554 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f1f61fa8-5418-47cd-8379-f284c64d3985 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:46.269113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f1f61fa8-5418-47cd-8379-f284c64d3985 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:46.275663 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1f61fa8-5418-47cd-8379-f284c64d3985 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:46.276114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1f61fa8-5418-47cd-8379-f284c64d3985 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:46.276875 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1f61fa8-5418-47cd-8379-f284c64d3985 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:46.277310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f1f61fa8-5418-47cd-8379-f284c64d3985 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:46.292527 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:46.340675 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f1f61fa8-5418-47cd-8379-f284c64d3985 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:46.349428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f1f61fa8-5418-47cd-8379-f284c64d3985 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.085410 Aug 04 05:01:46.350015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1065/2128] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:46 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:46.464071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c457361e-fcd5-42e4-9b7e-d8703dbaf79b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:46.464692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c457361e-fcd5-42e4-9b7e-d8703dbaf79b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:46.471971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c457361e-fcd5-42e4-9b7e-d8703dbaf79b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:46.472428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c457361e-fcd5-42e4-9b7e-d8703dbaf79b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:46.473191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c457361e-fcd5-42e4-9b7e-d8703dbaf79b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:46.473669 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c457361e-fcd5-42e4-9b7e-d8703dbaf79b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:46.603298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c457361e-fcd5-42e4-9b7e-d8703dbaf79b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:46.611418 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c457361e-fcd5-42e4-9b7e-d8703dbaf79b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151160 Aug 04 05:01:46.611979 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1064/2129] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:46 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:47.370182 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-46295c74-432d-4525-86fc-d8c81c6fa2ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:47.370747 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-46295c74-432d-4525-86fc-d8c81c6fa2ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:47.378165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46295c74-432d-4525-86fc-d8c81c6fa2ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:47.378614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46295c74-432d-4525-86fc-d8c81c6fa2ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:47.379366 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46295c74-432d-4525-86fc-d8c81c6fa2ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:47.379799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46295c74-432d-4525-86fc-d8c81c6fa2ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:47.440908 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-46295c74-432d-4525-86fc-d8c81c6fa2ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:47.448749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-46295c74-432d-4525-86fc-d8c81c6fa2ce tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.082587 Aug 04 05:01:47.449297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1066/2130] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:47 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:47.632217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cf45c03b-d535-4445-a947-7cfd8d4f9bca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:47.632753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cf45c03b-d535-4445-a947-7cfd8d4f9bca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:47.639297 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cf45c03b-d535-4445-a947-7cfd8d4f9bca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:47.639742 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cf45c03b-d535-4445-a947-7cfd8d4f9bca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:47.640545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cf45c03b-d535-4445-a947-7cfd8d4f9bca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:47.640975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-cf45c03b-d535-4445-a947-7cfd8d4f9bca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:47.770234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-cf45c03b-d535-4445-a947-7cfd8d4f9bca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:47.778165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cf45c03b-d535-4445-a947-7cfd8d4f9bca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149905 Aug 04 05:01:47.778721 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1065/2131] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:47 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:48.469157 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-32f32d07-aefe-4800-bc7f-01a6da768cc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:48.469808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-32f32d07-aefe-4800-bc7f-01a6da768cc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:48.476332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-32f32d07-aefe-4800-bc7f-01a6da768cc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:48.476784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-32f32d07-aefe-4800-bc7f-01a6da768cc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:48.477628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-32f32d07-aefe-4800-bc7f-01a6da768cc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:48.478007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-32f32d07-aefe-4800-bc7f-01a6da768cc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:48.540273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-32f32d07-aefe-4800-bc7f-01a6da768cc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:48.549048 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-32f32d07-aefe-4800-bc7f-01a6da768cc9 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083833 Aug 04 05:01:48.549623 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1067/2132] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:48 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:48.800802 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8b5a9805-d0aa-4127-82ea-0b0295d96e13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:48.801398 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8b5a9805-d0aa-4127-82ea-0b0295d96e13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:48.808050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8b5a9805-d0aa-4127-82ea-0b0295d96e13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:48.808495 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8b5a9805-d0aa-4127-82ea-0b0295d96e13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:48.809236 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8b5a9805-d0aa-4127-82ea-0b0295d96e13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:48.809703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8b5a9805-d0aa-4127-82ea-0b0295d96e13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:48.937052 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8b5a9805-d0aa-4127-82ea-0b0295d96e13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:48.945832 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8b5a9805-d0aa-4127-82ea-0b0295d96e13 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149846 Aug 04 05:01:48.946397 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1066/2133] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:48 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:49.570507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c8c03428-3ec5-4203-98d4-84a95dcfe8c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:49.571125 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c8c03428-3ec5-4203-98d4-84a95dcfe8c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:49.578497 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c8c03428-3ec5-4203-98d4-84a95dcfe8c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:49.579042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c8c03428-3ec5-4203-98d4-84a95dcfe8c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:49.579806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c8c03428-3ec5-4203-98d4-84a95dcfe8c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:49.580237 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c8c03428-3ec5-4203-98d4-84a95dcfe8c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:49.642469 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c8c03428-3ec5-4203-98d4-84a95dcfe8c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:49.650449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c8c03428-3ec5-4203-98d4-84a95dcfe8c7 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083618 Aug 04 05:01:49.651003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1068/2134] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:49 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:49.967131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-58d83472-8610-4d40-ac36-1a405312f631 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:49.967755 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-58d83472-8610-4d40-ac36-1a405312f631 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:49.974436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-58d83472-8610-4d40-ac36-1a405312f631 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:49.974917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-58d83472-8610-4d40-ac36-1a405312f631 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:49.975676 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-58d83472-8610-4d40-ac36-1a405312f631 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:49.976116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-58d83472-8610-4d40-ac36-1a405312f631 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:49.991257 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=100 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:01:50.107349 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-58d83472-8610-4d40-ac36-1a405312f631 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:50.115835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-58d83472-8610-4d40-ac36-1a405312f631 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152576 Aug 04 05:01:50.116396 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1067/2135] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:49 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:50.671729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9ac35532-92be-4915-8fc1-b13b525c9ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:50.672468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9ac35532-92be-4915-8fc1-b13b525c9ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:50.680167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ac35532-92be-4915-8fc1-b13b525c9ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:50.680617 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ac35532-92be-4915-8fc1-b13b525c9ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:50.681468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ac35532-92be-4915-8fc1-b13b525c9ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:50.682009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ac35532-92be-4915-8fc1-b13b525c9ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:50.743195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9ac35532-92be-4915-8fc1-b13b525c9ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:50.752353 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9ac35532-92be-4915-8fc1-b13b525c9ef4 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.084710 Aug 04 05:01:50.752911 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1069/2136] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:50 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:51.137605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-939a3dcd-bb64-4d6c-bd46-c0cf197d0a23 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:51.138215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-939a3dcd-bb64-4d6c-bd46-c0cf197d0a23 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:51.144795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-939a3dcd-bb64-4d6c-bd46-c0cf197d0a23 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:51.145255 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-939a3dcd-bb64-4d6c-bd46-c0cf197d0a23 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:51.146044 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-939a3dcd-bb64-4d6c-bd46-c0cf197d0a23 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:51.146486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-939a3dcd-bb64-4d6c-bd46-c0cf197d0a23 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:51.280593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-939a3dcd-bb64-4d6c-bd46-c0cf197d0a23 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:51.289064 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-939a3dcd-bb64-4d6c-bd46-c0cf197d0a23 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.155338 Aug 04 05:01:51.289654 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1068/2137] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:51 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:51.773796 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2c902e69-1a05-465f-b8a9-38faa957baa1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:51.774327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2c902e69-1a05-465f-b8a9-38faa957baa1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:51.780848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2c902e69-1a05-465f-b8a9-38faa957baa1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:51.781293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2c902e69-1a05-465f-b8a9-38faa957baa1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:51.782909 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2c902e69-1a05-465f-b8a9-38faa957baa1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:51.783343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2c902e69-1a05-465f-b8a9-38faa957baa1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:51.842334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2c902e69-1a05-465f-b8a9-38faa957baa1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:51.850766 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2c902e69-1a05-465f-b8a9-38faa957baa1 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.081098 Aug 04 05:01:51.851303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1070/2138] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:51 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:52.310980 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8a9fce8b-f2ab-4214-86c5-b1e1fde8ccca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:52.311587 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8a9fce8b-f2ab-4214-86c5-b1e1fde8ccca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:52.319004 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a9fce8b-f2ab-4214-86c5-b1e1fde8ccca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:52.319452 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a9fce8b-f2ab-4214-86c5-b1e1fde8ccca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:52.320200 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a9fce8b-f2ab-4214-86c5-b1e1fde8ccca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:52.320631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a9fce8b-f2ab-4214-86c5-b1e1fde8ccca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:52.451631 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8a9fce8b-f2ab-4214-86c5-b1e1fde8ccca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:52.464549 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8a9fce8b-f2ab-4214-86c5-b1e1fde8ccca tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.157450 Aug 04 05:01:52.465121 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1069/2139] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:52 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:52.871193 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6689a3d5-3309-4b18-a6ad-3b1ecb67c0c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:52.871823 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6689a3d5-3309-4b18-a6ad-3b1ecb67c0c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:52.879339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6689a3d5-3309-4b18-a6ad-3b1ecb67c0c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:52.879791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6689a3d5-3309-4b18-a6ad-3b1ecb67c0c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:52.880686 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6689a3d5-3309-4b18-a6ad-3b1ecb67c0c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:52.881196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6689a3d5-3309-4b18-a6ad-3b1ecb67c0c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:52.943331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6689a3d5-3309-4b18-a6ad-3b1ecb67c0c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:52.951045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6689a3d5-3309-4b18-a6ad-3b1ecb67c0c5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083852 Aug 04 05:01:52.951611 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1071/2140] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:52 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:53.484766 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6523fc88-734d-40e4-9cf7-167527e6383e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:53.485664 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6523fc88-734d-40e4-9cf7-167527e6383e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:53.492301 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6523fc88-734d-40e4-9cf7-167527e6383e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:53.492760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6523fc88-734d-40e4-9cf7-167527e6383e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:53.493523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6523fc88-734d-40e4-9cf7-167527e6383e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:53.493997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6523fc88-734d-40e4-9cf7-167527e6383e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:53.628084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6523fc88-734d-40e4-9cf7-167527e6383e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:53.636145 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6523fc88-734d-40e4-9cf7-167527e6383e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.155266 Aug 04 05:01:53.636725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1070/2141] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:53 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:53.971492 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a835f9b5-dd9f-4f0e-94e2-a3c26da1467c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:53.972104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a835f9b5-dd9f-4f0e-94e2-a3c26da1467c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] [instance: af1762cb-4b08-41db-8302-59f56c67370a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:53.978830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a835f9b5-dd9f-4f0e-94e2-a3c26da1467c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:53.979309 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a835f9b5-dd9f-4f0e-94e2-a3c26da1467c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:53.980074 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a835f9b5-dd9f-4f0e-94e2-a3c26da1467c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:53.980511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a835f9b5-dd9f-4f0e-94e2-a3c26da1467c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:54.041902 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a835f9b5-dd9f-4f0e-94e2-a3c26da1467c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2949f24248034487ada1e11bc9a9e4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7fc43776684ea99eb660966ed97695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:54.051034 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a835f9b5-dd9f-4f0e-94e2-a3c26da1467c tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a" status: 200 len: 1387 microversion: 2.1 time: 0.083344 Aug 04 05:01:54.051597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1072/2142] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:53 2022] GET /compute/v2.1/servers/af1762cb-4b08-41db-8302-59f56c67370a => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:54.071247 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c502caf3-19bb-4d6c-9b2a-b9ecdb61caf5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] Calling method '.version_select at 0x7fc9424f5310>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:54.092815 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c502caf3-19bb-4d6c-9b2a-b9ecdb61caf5 tempest-TestMinimumBasicScenario-2001821501 tempest-TestMinimumBasicScenario-2001821501-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-3372200" status: 202 len: 0 microversion: 2.1 time: 0.025268 Aug 04 05:01:54.093517 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1071/2143] 10.222.0.47 () {58 vars in 1263 bytes} [Thu Aug 4 05:01:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-3372200 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:01:54.658377 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c7200933-e598-4ca7-82c4-c6c2e445876b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:54.658993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c7200933-e598-4ca7-82c4-c6c2e445876b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:54.665102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c7200933-e598-4ca7-82c4-c6c2e445876b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:54.665563 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c7200933-e598-4ca7-82c4-c6c2e445876b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:54.666329 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c7200933-e598-4ca7-82c4-c6c2e445876b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:54.666760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c7200933-e598-4ca7-82c4-c6c2e445876b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:54.800793 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c7200933-e598-4ca7-82c4-c6c2e445876b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:54.808919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c7200933-e598-4ca7-82c4-c6c2e445876b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.155041 Aug 04 05:01:54.809482 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1073/2144] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:54 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:55.830587 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-160b539e-9169-4012-babf-f82f91b2df02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:55.831200 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-160b539e-9169-4012-babf-f82f91b2df02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:55.837383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-160b539e-9169-4012-babf-f82f91b2df02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:55.838877 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-160b539e-9169-4012-babf-f82f91b2df02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:55.839699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-160b539e-9169-4012-babf-f82f91b2df02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:55.840181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-160b539e-9169-4012-babf-f82f91b2df02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:55.991692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-160b539e-9169-4012-babf-f82f91b2df02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:56.003016 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-160b539e-9169-4012-babf-f82f91b2df02 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.177131 Aug 04 05:01:56.003692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1072/2145] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:55 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:57.025284 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4eba0d07-87f9-4135-a28b-09f53ef126a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:57.026682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4eba0d07-87f9-4135-a28b-09f53ef126a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:57.034302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4eba0d07-87f9-4135-a28b-09f53ef126a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:57.035002 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4eba0d07-87f9-4135-a28b-09f53ef126a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:57.035955 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4eba0d07-87f9-4135-a28b-09f53ef126a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:57.036553 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4eba0d07-87f9-4135-a28b-09f53ef126a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:57.172673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4eba0d07-87f9-4135-a28b-09f53ef126a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:57.181448 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4eba0d07-87f9-4135-a28b-09f53ef126a0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.159760 Aug 04 05:01:57.182175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1074/2146] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:57 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:58.204313 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-590367eb-02f9-485b-b84c-2285684ff1e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:58.205253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-590367eb-02f9-485b-b84c-2285684ff1e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:58.212083 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-590367eb-02f9-485b-b84c-2285684ff1e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:58.212799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-590367eb-02f9-485b-b84c-2285684ff1e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:58.213821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-590367eb-02f9-485b-b84c-2285684ff1e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:58.214472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-590367eb-02f9-485b-b84c-2285684ff1e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:58.377153 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-590367eb-02f9-485b-b84c-2285684ff1e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:58.389499 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-590367eb-02f9-485b-b84c-2285684ff1e1 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.189277 Aug 04 05:01:58.430564 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1073/2147] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:58 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:01:59.436295 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b2534542-f2f0-48cc-ae21-605921b95af6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:01:59.437816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b2534542-f2f0-48cc-ae21-605921b95af6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:01:59.445376 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b2534542-f2f0-48cc-ae21-605921b95af6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:59.446048 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b2534542-f2f0-48cc-ae21-605921b95af6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:59.446823 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b2534542-f2f0-48cc-ae21-605921b95af6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:01:59.447399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b2534542-f2f0-48cc-ae21-605921b95af6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:01:59.925146 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b2534542-f2f0-48cc-ae21-605921b95af6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:01:59.933128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b2534542-f2f0-48cc-ae21-605921b95af6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.500711 Aug 04 05:01:59.933726 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1075/2148] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:01:59 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:00.954951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b1a06b4b-cdf8-4360-8781-583f809c9629 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:00.955548 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b1a06b4b-cdf8-4360-8781-583f809c9629 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:00.957887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:00.963381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b1a06b4b-cdf8-4360-8781-583f809c9629 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:00.963830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b1a06b4b-cdf8-4360-8781-583f809c9629 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:00.964588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b1a06b4b-cdf8-4360-8781-583f809c9629 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:00.965021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b1a06b4b-cdf8-4360-8781-583f809c9629 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:01.186167 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b1a06b4b-cdf8-4360-8781-583f809c9629 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:01.195133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b1a06b4b-cdf8-4360-8781-583f809c9629 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.243985 Aug 04 05:02:01.195903 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1074/2149] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:00 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:02.220259 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d175406f-afcc-48fd-9c79-8ca989e76607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:02.220871 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d175406f-afcc-48fd-9c79-8ca989e76607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:02.223486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=50 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:02.229373 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d175406f-afcc-48fd-9c79-8ca989e76607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:02.229858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d175406f-afcc-48fd-9c79-8ca989e76607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:02.230749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d175406f-afcc-48fd-9c79-8ca989e76607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:02.231192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d175406f-afcc-48fd-9c79-8ca989e76607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:02.372850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d175406f-afcc-48fd-9c79-8ca989e76607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:02.381331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d175406f-afcc-48fd-9c79-8ca989e76607 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.165691 Aug 04 05:02:02.381936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1076/2150] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:02 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:03.404111 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1229fccb-9d6a-4b22-bd02-38f0e4ecf5bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:03.404740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1229fccb-9d6a-4b22-bd02-38f0e4ecf5bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:03.411480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1229fccb-9d6a-4b22-bd02-38f0e4ecf5bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:03.411932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1229fccb-9d6a-4b22-bd02-38f0e4ecf5bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:03.412689 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1229fccb-9d6a-4b22-bd02-38f0e4ecf5bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:03.413127 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1229fccb-9d6a-4b22-bd02-38f0e4ecf5bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:03.542452 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1229fccb-9d6a-4b22-bd02-38f0e4ecf5bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:03.551162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1229fccb-9d6a-4b22-bd02-38f0e4ecf5bb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150901 Aug 04 05:02:03.551728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1075/2151] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:03 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:04.572791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c9c7d8e5-14f5-4eac-a73c-d0ba5f4902eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:04.573409 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c9c7d8e5-14f5-4eac-a73c-d0ba5f4902eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:04.581769 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c9c7d8e5-14f5-4eac-a73c-d0ba5f4902eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:04.582225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c9c7d8e5-14f5-4eac-a73c-d0ba5f4902eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:04.582989 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c9c7d8e5-14f5-4eac-a73c-d0ba5f4902eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:04.583456 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c9c7d8e5-14f5-4eac-a73c-d0ba5f4902eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:04.713333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c9c7d8e5-14f5-4eac-a73c-d0ba5f4902eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:04.721861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c9c7d8e5-14f5-4eac-a73c-d0ba5f4902eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152933 Aug 04 05:02:04.722431 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1077/2152] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:04 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:05.742732 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ec184c58-89dc-428a-9c28-cabec34f140a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:05.743353 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ec184c58-89dc-428a-9c28-cabec34f140a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:05.749938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ec184c58-89dc-428a-9c28-cabec34f140a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:05.750393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ec184c58-89dc-428a-9c28-cabec34f140a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:05.751238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ec184c58-89dc-428a-9c28-cabec34f140a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:05.751687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ec184c58-89dc-428a-9c28-cabec34f140a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:05.885847 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ec184c58-89dc-428a-9c28-cabec34f140a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:05.894109 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ec184c58-89dc-428a-9c28-cabec34f140a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.155200 Aug 04 05:02:05.894669 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1076/2153] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:05 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:06.915234 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a54be1c3-2ff3-4510-a89e-a2697ccc9432 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:06.915843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a54be1c3-2ff3-4510-a89e-a2697ccc9432 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:06.922772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a54be1c3-2ff3-4510-a89e-a2697ccc9432 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:06.923222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a54be1c3-2ff3-4510-a89e-a2697ccc9432 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:06.924185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a54be1c3-2ff3-4510-a89e-a2697ccc9432 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:06.924613 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a54be1c3-2ff3-4510-a89e-a2697ccc9432 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:07.056430 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a54be1c3-2ff3-4510-a89e-a2697ccc9432 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:07.064505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a54be1c3-2ff3-4510-a89e-a2697ccc9432 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153160 Aug 04 05:02:07.065072 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1078/2154] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:06 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:08.085404 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-02bf91de-dd3d-4523-bd94-4d9681baf0c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:08.086052 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-02bf91de-dd3d-4523-bd94-4d9681baf0c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:08.092599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-02bf91de-dd3d-4523-bd94-4d9681baf0c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:08.093052 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-02bf91de-dd3d-4523-bd94-4d9681baf0c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:08.093839 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-02bf91de-dd3d-4523-bd94-4d9681baf0c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:08.094274 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-02bf91de-dd3d-4523-bd94-4d9681baf0c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:08.225784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-02bf91de-dd3d-4523-bd94-4d9681baf0c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:08.233629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-02bf91de-dd3d-4523-bd94-4d9681baf0c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152040 Aug 04 05:02:08.234191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1077/2155] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:08 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:09.254872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1ef8070d-fed4-4599-92d6-61882b40d5ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:09.255499 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1ef8070d-fed4-4599-92d6-61882b40d5ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:09.262142 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ef8070d-fed4-4599-92d6-61882b40d5ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:09.262590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ef8070d-fed4-4599-92d6-61882b40d5ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:09.263342 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ef8070d-fed4-4599-92d6-61882b40d5ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:09.263807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ef8070d-fed4-4599-92d6-61882b40d5ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:09.392544 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1ef8070d-fed4-4599-92d6-61882b40d5ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:09.400346 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1ef8070d-fed4-4599-92d6-61882b40d5ac tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149950 Aug 04 05:02:09.400899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1079/2156] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:09 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:10.422028 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e8c77730-40fc-4a67-9f73-72bd157132b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:10.423305 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e8c77730-40fc-4a67-9f73-72bd157132b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:10.429871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8c77730-40fc-4a67-9f73-72bd157132b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:10.430322 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8c77730-40fc-4a67-9f73-72bd157132b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:10.431078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8c77730-40fc-4a67-9f73-72bd157132b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:10.431514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8c77730-40fc-4a67-9f73-72bd157132b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:10.560843 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e8c77730-40fc-4a67-9f73-72bd157132b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:10.570069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e8c77730-40fc-4a67-9f73-72bd157132b8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152187 Aug 04 05:02:10.570639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1078/2157] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:10 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:11.591469 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-67c46f33-cbfd-4aa5-b4ac-8a225d84b95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:11.592088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-67c46f33-cbfd-4aa5-b4ac-8a225d84b95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:11.599690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67c46f33-cbfd-4aa5-b4ac-8a225d84b95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:11.600142 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67c46f33-cbfd-4aa5-b4ac-8a225d84b95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:11.600906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67c46f33-cbfd-4aa5-b4ac-8a225d84b95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:11.601340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-67c46f33-cbfd-4aa5-b4ac-8a225d84b95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:11.731706 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-67c46f33-cbfd-4aa5-b4ac-8a225d84b95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:11.740445 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-67c46f33-cbfd-4aa5-b4ac-8a225d84b95c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152912 Aug 04 05:02:11.741005 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1080/2158] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:11 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:12.761441 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ce5bcf37-74d9-4892-a3cc-dc9307891d21 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:12.762072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ce5bcf37-74d9-4892-a3cc-dc9307891d21 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:12.769049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ce5bcf37-74d9-4892-a3cc-dc9307891d21 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:12.769504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ce5bcf37-74d9-4892-a3cc-dc9307891d21 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:12.770294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ce5bcf37-74d9-4892-a3cc-dc9307891d21 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:12.770735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ce5bcf37-74d9-4892-a3cc-dc9307891d21 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:12.900819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ce5bcf37-74d9-4892-a3cc-dc9307891d21 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:12.909485 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ce5bcf37-74d9-4892-a3cc-dc9307891d21 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151970 Aug 04 05:02:12.910087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1079/2159] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:13.930507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d01e3f88-066b-4e84-848b-c59483596350 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:13.931122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d01e3f88-066b-4e84-848b-c59483596350 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:13.937850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d01e3f88-066b-4e84-848b-c59483596350 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:13.938302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d01e3f88-066b-4e84-848b-c59483596350 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:13.939071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d01e3f88-066b-4e84-848b-c59483596350 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:13.939510 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d01e3f88-066b-4e84-848b-c59483596350 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:14.070382 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d01e3f88-066b-4e84-848b-c59483596350 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:14.078230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d01e3f88-066b-4e84-848b-c59483596350 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151715 Aug 04 05:02:14.079321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1081/2160] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:13 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:15.098885 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4fca65f6-2511-4e8c-8099-30415376b88a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:15.099552 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4fca65f6-2511-4e8c-8099-30415376b88a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:15.106257 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fca65f6-2511-4e8c-8099-30415376b88a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:15.106703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fca65f6-2511-4e8c-8099-30415376b88a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:15.107459 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fca65f6-2511-4e8c-8099-30415376b88a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:15.107896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4fca65f6-2511-4e8c-8099-30415376b88a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:15.236113 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4fca65f6-2511-4e8c-8099-30415376b88a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:15.243907 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4fca65f6-2511-4e8c-8099-30415376b88a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149065 Aug 04 05:02:15.244465 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1080/2161] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:15 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:16.264706 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8b4c6c27-8937-4c6c-a4f1-0cee960a48f0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:16.265229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8b4c6c27-8937-4c6c-a4f1-0cee960a48f0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:16.272435 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b4c6c27-8937-4c6c-a4f1-0cee960a48f0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:16.272890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b4c6c27-8937-4c6c-a4f1-0cee960a48f0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:16.273685 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b4c6c27-8937-4c6c-a4f1-0cee960a48f0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:16.274122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8b4c6c27-8937-4c6c-a4f1-0cee960a48f0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:16.276618 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:16.407531 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8b4c6c27-8937-4c6c-a4f1-0cee960a48f0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:16.415824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8b4c6c27-8937-4c6c-a4f1-0cee960a48f0 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.155026 Aug 04 05:02:16.416385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1082/2162] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:17.438103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b2c2d2ae-18e8-4ca1-aa0c-e57c97156e2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:17.438716 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b2c2d2ae-18e8-4ca1-aa0c-e57c97156e2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:17.445832 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b2c2d2ae-18e8-4ca1-aa0c-e57c97156e2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:17.446281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b2c2d2ae-18e8-4ca1-aa0c-e57c97156e2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:17.447026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b2c2d2ae-18e8-4ca1-aa0c-e57c97156e2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:17.447458 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b2c2d2ae-18e8-4ca1-aa0c-e57c97156e2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:17.574812 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b2c2d2ae-18e8-4ca1-aa0c-e57c97156e2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:17.583058 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b2c2d2ae-18e8-4ca1-aa0c-e57c97156e2e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149630 Aug 04 05:02:17.583617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1081/2163] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:17 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:18.604159 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-08c231dd-9ff3-48fb-bf7c-3266a734b422 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:18.604772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-08c231dd-9ff3-48fb-bf7c-3266a734b422 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:18.611830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-08c231dd-9ff3-48fb-bf7c-3266a734b422 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:18.612590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-08c231dd-9ff3-48fb-bf7c-3266a734b422 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:18.613434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-08c231dd-9ff3-48fb-bf7c-3266a734b422 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:18.613899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-08c231dd-9ff3-48fb-bf7c-3266a734b422 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:18.745103 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-08c231dd-9ff3-48fb-bf7c-3266a734b422 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:18.753605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-08c231dd-9ff3-48fb-bf7c-3266a734b422 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153278 Aug 04 05:02:18.754172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1083/2164] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:18 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:19.775022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b90fb7b2-9c88-44ed-87e8-445e63444fc3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:19.775592 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b90fb7b2-9c88-44ed-87e8-445e63444fc3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:19.782166 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b90fb7b2-9c88-44ed-87e8-445e63444fc3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:19.782624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b90fb7b2-9c88-44ed-87e8-445e63444fc3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:19.783638 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b90fb7b2-9c88-44ed-87e8-445e63444fc3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:19.784088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b90fb7b2-9c88-44ed-87e8-445e63444fc3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:19.799200 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:02:19.799458 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:02:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 (ip 10.222.0.47) !!! Aug 04 05:02:19.918455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b90fb7b2-9c88-44ed-87e8-445e63444fc3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:19.927072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b90fb7b2-9c88-44ed-87e8-445e63444fc3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.155746 Aug 04 05:02:19.927630 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1082/2165] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:20.947977 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-760b7b7a-e2bb-43f4-b960-e835b6c82ec7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:20.948585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-760b7b7a-e2bb-43f4-b960-e835b6c82ec7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:20.955541 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-760b7b7a-e2bb-43f4-b960-e835b6c82ec7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:20.956069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-760b7b7a-e2bb-43f4-b960-e835b6c82ec7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:20.956902 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-760b7b7a-e2bb-43f4-b960-e835b6c82ec7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:20.957335 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-760b7b7a-e2bb-43f4-b960-e835b6c82ec7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:21.084088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-760b7b7a-e2bb-43f4-b960-e835b6c82ec7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:21.091892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-760b7b7a-e2bb-43f4-b960-e835b6c82ec7 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.147678 Aug 04 05:02:21.092447 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1084/2166] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:22.117918 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fa915203-edae-438e-ac2e-6341242ba0cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:22.118527 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fa915203-edae-438e-ac2e-6341242ba0cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:22.125141 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fa915203-edae-438e-ac2e-6341242ba0cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:22.125725 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fa915203-edae-438e-ac2e-6341242ba0cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:22.126593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fa915203-edae-438e-ac2e-6341242ba0cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:22.128374 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fa915203-edae-438e-ac2e-6341242ba0cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:22.130993 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=88 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:22.266240 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-fa915203-edae-438e-ac2e-6341242ba0cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:22.274989 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fa915203-edae-438e-ac2e-6341242ba0cb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.164891 Aug 04 05:02:22.275561 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1083/2167] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:22 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:02:23.296743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9bede5fb-cf0a-4b55-8b0a-5c422c6c5731 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:23.297339 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9bede5fb-cf0a-4b55-8b0a-5c422c6c5731 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:23.303736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9bede5fb-cf0a-4b55-8b0a-5c422c6c5731 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:23.304178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9bede5fb-cf0a-4b55-8b0a-5c422c6c5731 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:23.304932 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9bede5fb-cf0a-4b55-8b0a-5c422c6c5731 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:23.305367 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9bede5fb-cf0a-4b55-8b0a-5c422c6c5731 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:23.434621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9bede5fb-cf0a-4b55-8b0a-5c422c6c5731 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:23.443377 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9bede5fb-cf0a-4b55-8b0a-5c422c6c5731 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151006 Aug 04 05:02:23.443938 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1085/2168] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:23 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:24.464866 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bc56ae44-9bc2-48fc-9d2b-953ba6be0967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:24.465482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-bc56ae44-9bc2-48fc-9d2b-953ba6be0967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:24.472942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bc56ae44-9bc2-48fc-9d2b-953ba6be0967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:24.473387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bc56ae44-9bc2-48fc-9d2b-953ba6be0967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:24.474211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bc56ae44-9bc2-48fc-9d2b-953ba6be0967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:24.474663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bc56ae44-9bc2-48fc-9d2b-953ba6be0967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:24.604125 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-bc56ae44-9bc2-48fc-9d2b-953ba6be0967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:24.612793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-bc56ae44-9bc2-48fc-9d2b-953ba6be0967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151836 Aug 04 05:02:24.613350 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1084/2169] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:24 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:25.633773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4b1e979e-6c5c-499a-a08f-3644e7fa0915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:25.634388 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4b1e979e-6c5c-499a-a08f-3644e7fa0915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:25.640727 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b1e979e-6c5c-499a-a08f-3644e7fa0915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:25.641169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b1e979e-6c5c-499a-a08f-3644e7fa0915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:25.641945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b1e979e-6c5c-499a-a08f-3644e7fa0915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:25.643087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4b1e979e-6c5c-499a-a08f-3644e7fa0915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:25.771789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4b1e979e-6c5c-499a-a08f-3644e7fa0915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:25.779576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4b1e979e-6c5c-499a-a08f-3644e7fa0915 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149694 Aug 04 05:02:25.780130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1086/2170] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:25 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:26.799878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c37aacf8-4aca-490f-8028-3b00e1708213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:26.800486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c37aacf8-4aca-490f-8028-3b00e1708213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:26.807268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c37aacf8-4aca-490f-8028-3b00e1708213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:26.807727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c37aacf8-4aca-490f-8028-3b00e1708213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:26.808496 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c37aacf8-4aca-490f-8028-3b00e1708213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:26.808942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c37aacf8-4aca-490f-8028-3b00e1708213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:26.941382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c37aacf8-4aca-490f-8028-3b00e1708213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:26.949261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c37aacf8-4aca-490f-8028-3b00e1708213 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153650 Aug 04 05:02:26.949852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1085/2171] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:26 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:27.971046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d9d67c14-4891-4c98-ae6d-4461bb4a0cc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:27.971650 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d9d67c14-4891-4c98-ae6d-4461bb4a0cc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:27.978189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d9d67c14-4891-4c98-ae6d-4461bb4a0cc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:27.978638 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d9d67c14-4891-4c98-ae6d-4461bb4a0cc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:27.979397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d9d67c14-4891-4c98-ae6d-4461bb4a0cc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:27.979831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d9d67c14-4891-4c98-ae6d-4461bb4a0cc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:28.109965 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d9d67c14-4891-4c98-ae6d-4461bb4a0cc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:28.117810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d9d67c14-4891-4c98-ae6d-4461bb4a0cc9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150787 Aug 04 05:02:28.118362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1087/2172] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:27 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:29.140164 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-51e4122b-3e08-46fd-b2dd-66c2767af18b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:29.140774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-51e4122b-3e08-46fd-b2dd-66c2767af18b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:29.147791 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-51e4122b-3e08-46fd-b2dd-66c2767af18b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:29.148240 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-51e4122b-3e08-46fd-b2dd-66c2767af18b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:29.148988 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-51e4122b-3e08-46fd-b2dd-66c2767af18b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:29.149424 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-51e4122b-3e08-46fd-b2dd-66c2767af18b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:29.275654 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-51e4122b-3e08-46fd-b2dd-66c2767af18b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:29.284344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-51e4122b-3e08-46fd-b2dd-66c2767af18b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148040 Aug 04 05:02:29.284908 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1086/2173] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:29 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:02:30.305129 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5e9407ef-ab98-4c4d-9a3a-734c2c8cbd34 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:30.305788 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5e9407ef-ab98-4c4d-9a3a-734c2c8cbd34 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:30.312333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5e9407ef-ab98-4c4d-9a3a-734c2c8cbd34 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:30.312781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5e9407ef-ab98-4c4d-9a3a-734c2c8cbd34 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:30.313535 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5e9407ef-ab98-4c4d-9a3a-734c2c8cbd34 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:30.314094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5e9407ef-ab98-4c4d-9a3a-734c2c8cbd34 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:30.443715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5e9407ef-ab98-4c4d-9a3a-734c2c8cbd34 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:30.451596 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5e9407ef-ab98-4c4d-9a3a-734c2c8cbd34 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150304 Aug 04 05:02:30.452439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1088/2174] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:30 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:31.473994 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ff1365a2-fdd5-4a97-b07e-fe76d0fcd18a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:31.474552 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ff1365a2-fdd5-4a97-b07e-fe76d0fcd18a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:31.476963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=26 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:31.482326 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff1365a2-fdd5-4a97-b07e-fe76d0fcd18a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:31.482778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff1365a2-fdd5-4a97-b07e-fe76d0fcd18a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:31.483536 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff1365a2-fdd5-4a97-b07e-fe76d0fcd18a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:31.483979 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff1365a2-fdd5-4a97-b07e-fe76d0fcd18a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:31.614818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ff1365a2-fdd5-4a97-b07e-fe76d0fcd18a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:31.622665 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ff1365a2-fdd5-4a97-b07e-fe76d0fcd18a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153672 Aug 04 05:02:31.623219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1087/2175] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:31 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:32.644567 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6e7e688f-207f-4461-ac40-0e6464b46581 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:32.645181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6e7e688f-207f-4461-ac40-0e6464b46581 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:32.647515 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=26 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:32.653068 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e7e688f-207f-4461-ac40-0e6464b46581 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:32.653518 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e7e688f-207f-4461-ac40-0e6464b46581 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:32.654303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e7e688f-207f-4461-ac40-0e6464b46581 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:32.654741 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e7e688f-207f-4461-ac40-0e6464b46581 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:32.784282 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6e7e688f-207f-4461-ac40-0e6464b46581 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:32.792249 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6e7e688f-207f-4461-ac40-0e6464b46581 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151811 Aug 04 05:02:32.792834 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1089/2176] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:32 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:33.814761 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5be1999f-13e5-4f4a-ab26-27b5ac89d2b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:33.815387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5be1999f-13e5-4f4a-ab26-27b5ac89d2b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:33.822019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5be1999f-13e5-4f4a-ab26-27b5ac89d2b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:33.822474 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5be1999f-13e5-4f4a-ab26-27b5ac89d2b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:33.823238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5be1999f-13e5-4f4a-ab26-27b5ac89d2b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:33.823677 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5be1999f-13e5-4f4a-ab26-27b5ac89d2b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:33.954668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5be1999f-13e5-4f4a-ab26-27b5ac89d2b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:33.962479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5be1999f-13e5-4f4a-ab26-27b5ac89d2b2 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152167 Aug 04 05:02:33.963041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1088/2177] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:33 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:34.984052 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9ea101d0-e3ee-4afb-aff8-dce94ec3d927 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:34.984688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9ea101d0-e3ee-4afb-aff8-dce94ec3d927 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:34.991589 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ea101d0-e3ee-4afb-aff8-dce94ec3d927 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:34.992035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ea101d0-e3ee-4afb-aff8-dce94ec3d927 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:34.992787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ea101d0-e3ee-4afb-aff8-dce94ec3d927 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:34.993219 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ea101d0-e3ee-4afb-aff8-dce94ec3d927 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:35.124490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9ea101d0-e3ee-4afb-aff8-dce94ec3d927 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:35.133206 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9ea101d0-e3ee-4afb-aff8-dce94ec3d927 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152944 Aug 04 05:02:35.133873 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1090/2178] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:34 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:36.154219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fd935c2a-bb8c-47c3-9a9c-adabd189602c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:36.154869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fd935c2a-bb8c-47c3-9a9c-adabd189602c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:36.162208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fd935c2a-bb8c-47c3-9a9c-adabd189602c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:36.162663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fd935c2a-bb8c-47c3-9a9c-adabd189602c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:36.163422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fd935c2a-bb8c-47c3-9a9c-adabd189602c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:36.163855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fd935c2a-bb8c-47c3-9a9c-adabd189602c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:36.297814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-fd935c2a-bb8c-47c3-9a9c-adabd189602c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:36.307159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fd935c2a-bb8c-47c3-9a9c-adabd189602c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.156757 Aug 04 05:02:36.307723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1089/2179] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:36 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:37.328149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1faf4fe4-63a1-4274-b9c2-aaa1840ec7e3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:37.328899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1faf4fe4-63a1-4274-b9c2-aaa1840ec7e3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:37.336486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1faf4fe4-63a1-4274-b9c2-aaa1840ec7e3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:37.336936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1faf4fe4-63a1-4274-b9c2-aaa1840ec7e3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:37.337743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1faf4fe4-63a1-4274-b9c2-aaa1840ec7e3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:37.338183 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1faf4fe4-63a1-4274-b9c2-aaa1840ec7e3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:37.463866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1faf4fe4-63a1-4274-b9c2-aaa1840ec7e3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:37.472589 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1faf4fe4-63a1-4274-b9c2-aaa1840ec7e3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148478 Aug 04 05:02:37.473154 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1091/2180] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:37 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:38.494391 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8d1b0d19-e3af-46bb-8634-7f3353eb526c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:38.495012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8d1b0d19-e3af-46bb-8634-7f3353eb526c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:38.501508 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d1b0d19-e3af-46bb-8634-7f3353eb526c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:38.502085 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d1b0d19-e3af-46bb-8634-7f3353eb526c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:38.503365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d1b0d19-e3af-46bb-8634-7f3353eb526c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:38.503805 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d1b0d19-e3af-46bb-8634-7f3353eb526c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:38.631874 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8d1b0d19-e3af-46bb-8634-7f3353eb526c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:38.639804 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8d1b0d19-e3af-46bb-8634-7f3353eb526c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149276 Aug 04 05:02:38.640367 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1090/2181] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:38 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:39.663169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bd6c7781-ae7b-46c7-879f-61d313965e49 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:39.664876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bd6c7781-ae7b-46c7-879f-61d313965e49 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:39.671306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd6c7781-ae7b-46c7-879f-61d313965e49 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:39.671752 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd6c7781-ae7b-46c7-879f-61d313965e49 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:39.672508 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd6c7781-ae7b-46c7-879f-61d313965e49 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:39.672937 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd6c7781-ae7b-46c7-879f-61d313965e49 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:39.804143 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bd6c7781-ae7b-46c7-879f-61d313965e49 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:39.811939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bd6c7781-ae7b-46c7-879f-61d313965e49 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152655 Aug 04 05:02:39.812488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1092/2182] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:39 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:40.834700 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e47e73cc-5183-4076-89dd-6866e89b7155 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:40.835313 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e47e73cc-5183-4076-89dd-6866e89b7155 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:40.841811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e47e73cc-5183-4076-89dd-6866e89b7155 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:40.842261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e47e73cc-5183-4076-89dd-6866e89b7155 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:40.843012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e47e73cc-5183-4076-89dd-6866e89b7155 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:40.843443 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e47e73cc-5183-4076-89dd-6866e89b7155 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:40.973112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e47e73cc-5183-4076-89dd-6866e89b7155 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:40.980980 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e47e73cc-5183-4076-89dd-6866e89b7155 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151173 Aug 04 05:02:40.981529 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1091/2183] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:40 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:42.002549 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c0034a93-a3f5-4aeb-8213-2dac6bb3e74a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:42.003204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c0034a93-a3f5-4aeb-8213-2dac6bb3e74a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:42.010447 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c0034a93-a3f5-4aeb-8213-2dac6bb3e74a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:42.010893 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c0034a93-a3f5-4aeb-8213-2dac6bb3e74a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:42.011641 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c0034a93-a3f5-4aeb-8213-2dac6bb3e74a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:42.012070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c0034a93-a3f5-4aeb-8213-2dac6bb3e74a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:42.142865 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c0034a93-a3f5-4aeb-8213-2dac6bb3e74a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:42.151380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c0034a93-a3f5-4aeb-8213-2dac6bb3e74a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152716 Aug 04 05:02:42.151929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1093/2184] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:41 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:43.171639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c28563d8-8c9a-4b6a-b007-4fd8fd61d522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:43.172242 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c28563d8-8c9a-4b6a-b007-4fd8fd61d522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:43.179594 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c28563d8-8c9a-4b6a-b007-4fd8fd61d522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:43.180038 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c28563d8-8c9a-4b6a-b007-4fd8fd61d522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:43.180796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c28563d8-8c9a-4b6a-b007-4fd8fd61d522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:43.181229 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c28563d8-8c9a-4b6a-b007-4fd8fd61d522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:43.307200 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c28563d8-8c9a-4b6a-b007-4fd8fd61d522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:43.315133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c28563d8-8c9a-4b6a-b007-4fd8fd61d522 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.147611 Aug 04 05:02:43.315696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1092/2185] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:43 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:44.337283 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-88699d9d-42fd-4ee0-a101-7ab335923708 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:44.337930 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-88699d9d-42fd-4ee0-a101-7ab335923708 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:44.344313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88699d9d-42fd-4ee0-a101-7ab335923708 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:44.344758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88699d9d-42fd-4ee0-a101-7ab335923708 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:44.345504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88699d9d-42fd-4ee0-a101-7ab335923708 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:44.345956 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88699d9d-42fd-4ee0-a101-7ab335923708 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:44.477758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-88699d9d-42fd-4ee0-a101-7ab335923708 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:44.485894 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-88699d9d-42fd-4ee0-a101-7ab335923708 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153191 Aug 04 05:02:44.486453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1094/2186] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:44 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:45.507892 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b939e675-6d47-4991-b9a4-2bce7370eb94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:45.508511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b939e675-6d47-4991-b9a4-2bce7370eb94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:45.515115 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b939e675-6d47-4991-b9a4-2bce7370eb94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:45.515566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b939e675-6d47-4991-b9a4-2bce7370eb94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:45.516325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b939e675-6d47-4991-b9a4-2bce7370eb94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:45.516762 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b939e675-6d47-4991-b9a4-2bce7370eb94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:45.643560 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b939e675-6d47-4991-b9a4-2bce7370eb94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:45.651753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b939e675-6d47-4991-b9a4-2bce7370eb94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148381 Aug 04 05:02:45.652496 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1093/2187] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:45 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:46.674036 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1092c673-f4fb-4543-921c-8c8b629f4fe3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:46.674577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1092c673-f4fb-4543-921c-8c8b629f4fe3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:46.681956 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1092c673-f4fb-4543-921c-8c8b629f4fe3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:46.682406 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1092c673-f4fb-4543-921c-8c8b629f4fe3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:46.683171 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1092c673-f4fb-4543-921c-8c8b629f4fe3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:46.683611 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1092c673-f4fb-4543-921c-8c8b629f4fe3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:46.687523 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=78 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:46.811359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1092c673-f4fb-4543-921c-8c8b629f4fe3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:46.819812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1092c673-f4fb-4543-921c-8c8b629f4fe3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150006 Aug 04 05:02:46.820379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1095/2188] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:46 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:47.841777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eba4fb72-72d3-4a56-8bd4-56544d129c56 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:47.842426 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eba4fb72-72d3-4a56-8bd4-56544d129c56 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:47.849847 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eba4fb72-72d3-4a56-8bd4-56544d129c56 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:47.850300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eba4fb72-72d3-4a56-8bd4-56544d129c56 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:47.851063 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eba4fb72-72d3-4a56-8bd4-56544d129c56 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:47.851504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eba4fb72-72d3-4a56-8bd4-56544d129c56 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:47.983173 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-eba4fb72-72d3-4a56-8bd4-56544d129c56 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:47.991390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eba4fb72-72d3-4a56-8bd4-56544d129c56 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153458 Aug 04 05:02:47.992118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1094/2189] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:47 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:49.012695 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-11bb8d9e-d53b-4e8d-b08d-6ed6e8278043 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:49.013262 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-11bb8d9e-d53b-4e8d-b08d-6ed6e8278043 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:49.020542 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-11bb8d9e-d53b-4e8d-b08d-6ed6e8278043 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:49.020993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-11bb8d9e-d53b-4e8d-b08d-6ed6e8278043 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:49.021786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-11bb8d9e-d53b-4e8d-b08d-6ed6e8278043 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:49.022231 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-11bb8d9e-d53b-4e8d-b08d-6ed6e8278043 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:49.155150 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-11bb8d9e-d53b-4e8d-b08d-6ed6e8278043 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:49.163731 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-11bb8d9e-d53b-4e8d-b08d-6ed6e8278043 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.154963 Aug 04 05:02:49.164292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1096/2190] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:49 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:50.185576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c9de46a4-c655-4256-bcc7-064e3993dff3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:50.186257 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c9de46a4-c655-4256-bcc7-064e3993dff3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:50.193062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9de46a4-c655-4256-bcc7-064e3993dff3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:50.193514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9de46a4-c655-4256-bcc7-064e3993dff3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:50.194291 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9de46a4-c655-4256-bcc7-064e3993dff3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:50.194729 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c9de46a4-c655-4256-bcc7-064e3993dff3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:50.325165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c9de46a4-c655-4256-bcc7-064e3993dff3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:50.334213 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c9de46a4-c655-4256-bcc7-064e3993dff3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152531 Aug 04 05:02:50.334772 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1095/2191] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:50 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:51.355087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a4129062-c678-456f-9961-552f0d0fb1e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:51.355699 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a4129062-c678-456f-9961-552f0d0fb1e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:51.362242 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4129062-c678-456f-9961-552f0d0fb1e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:51.362689 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4129062-c678-456f-9961-552f0d0fb1e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:51.364659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4129062-c678-456f-9961-552f0d0fb1e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:51.365099 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a4129062-c678-456f-9961-552f0d0fb1e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:51.493945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a4129062-c678-456f-9961-552f0d0fb1e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:51.501842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a4129062-c678-456f-9961-552f0d0fb1e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150602 Aug 04 05:02:51.502402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1097/2192] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:51 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:52.522815 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-78a85ae4-4c4f-4c56-8118-88bdbb860819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:52.523428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-78a85ae4-4c4f-4c56-8118-88bdbb860819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:52.529955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78a85ae4-4c4f-4c56-8118-88bdbb860819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:52.530408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78a85ae4-4c4f-4c56-8118-88bdbb860819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:52.531165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78a85ae4-4c4f-4c56-8118-88bdbb860819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:52.531602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-78a85ae4-4c4f-4c56-8118-88bdbb860819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:52.534169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=78 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:02:52.663029 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-78a85ae4-4c4f-4c56-8118-88bdbb860819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:52.671222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-78a85ae4-4c4f-4c56-8118-88bdbb860819 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152839 Aug 04 05:02:52.671781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1096/2193] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:52 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:53.693018 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d8e4e630-0540-4d1d-8a5d-3253bd2f3104 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:53.693662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d8e4e630-0540-4d1d-8a5d-3253bd2f3104 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:53.699848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d8e4e630-0540-4d1d-8a5d-3253bd2f3104 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:53.700299 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d8e4e630-0540-4d1d-8a5d-3253bd2f3104 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:53.701057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d8e4e630-0540-4d1d-8a5d-3253bd2f3104 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:53.701492 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d8e4e630-0540-4d1d-8a5d-3253bd2f3104 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:53.834985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d8e4e630-0540-4d1d-8a5d-3253bd2f3104 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:53.842824 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d8e4e630-0540-4d1d-8a5d-3253bd2f3104 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.154391 Aug 04 05:02:53.843380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1098/2194] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:53 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:54.864551 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-46eb3855-0784-4dc5-86bf-d39301a58b99 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:54.865179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-46eb3855-0784-4dc5-86bf-d39301a58b99 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:54.871329 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-46eb3855-0784-4dc5-86bf-d39301a58b99 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:54.871781 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-46eb3855-0784-4dc5-86bf-d39301a58b99 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:54.872543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-46eb3855-0784-4dc5-86bf-d39301a58b99 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:54.873009 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-46eb3855-0784-4dc5-86bf-d39301a58b99 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:55.002849 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-46eb3855-0784-4dc5-86bf-d39301a58b99 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:55.011815 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-46eb3855-0784-4dc5-86bf-d39301a58b99 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152302 Aug 04 05:02:55.012370 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1097/2195] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:54 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:56.033695 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-31859d29-0013-41cd-8971-bdab183b47e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:56.034315 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-31859d29-0013-41cd-8971-bdab183b47e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:56.041123 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-31859d29-0013-41cd-8971-bdab183b47e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:56.041594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-31859d29-0013-41cd-8971-bdab183b47e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:56.042356 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-31859d29-0013-41cd-8971-bdab183b47e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:56.042794 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-31859d29-0013-41cd-8971-bdab183b47e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:56.174787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-31859d29-0013-41cd-8971-bdab183b47e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:56.183390 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-31859d29-0013-41cd-8971-bdab183b47e8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153635 Aug 04 05:02:56.183950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1099/2196] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:56 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:57.205143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-37937b66-6bc1-4f04-81eb-4bf58a34c663 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:57.205787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-37937b66-6bc1-4f04-81eb-4bf58a34c663 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:57.213196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37937b66-6bc1-4f04-81eb-4bf58a34c663 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:57.213682 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37937b66-6bc1-4f04-81eb-4bf58a34c663 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:57.214444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37937b66-6bc1-4f04-81eb-4bf58a34c663 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:57.214883 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-37937b66-6bc1-4f04-81eb-4bf58a34c663 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:57.342616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-37937b66-6bc1-4f04-81eb-4bf58a34c663 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:57.351510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-37937b66-6bc1-4f04-81eb-4bf58a34c663 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150309 Aug 04 05:02:57.352073 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1098/2197] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:57 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:58.372203 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-da5ac20f-bde7-474e-8bdb-8d2f1a942d93 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:58.372844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-da5ac20f-bde7-474e-8bdb-8d2f1a942d93 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:58.379662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da5ac20f-bde7-474e-8bdb-8d2f1a942d93 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:58.380117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da5ac20f-bde7-474e-8bdb-8d2f1a942d93 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:58.380874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da5ac20f-bde7-474e-8bdb-8d2f1a942d93 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:58.381307 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da5ac20f-bde7-474e-8bdb-8d2f1a942d93 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:58.511863 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-da5ac20f-bde7-474e-8bdb-8d2f1a942d93 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:58.520441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-da5ac20f-bde7-474e-8bdb-8d2f1a942d93 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152074 Aug 04 05:02:58.520995 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1100/2198] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:58 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:02:59.540944 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-679aa5a4-37cd-4e29-88fb-ffec70479da9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:02:59.541569 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-679aa5a4-37cd-4e29-88fb-ffec70479da9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:02:59.548542 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-679aa5a4-37cd-4e29-88fb-ffec70479da9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:59.548980 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-679aa5a4-37cd-4e29-88fb-ffec70479da9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:59.549760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-679aa5a4-37cd-4e29-88fb-ffec70479da9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:02:59.550250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-679aa5a4-37cd-4e29-88fb-ffec70479da9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:02:59.677807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-679aa5a4-37cd-4e29-88fb-ffec70479da9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:02:59.685796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-679aa5a4-37cd-4e29-88fb-ffec70479da9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148622 Aug 04 05:02:59.686362 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1099/2199] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:02:59 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:00.706653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e04374b8-8b65-46f5-925a-e8061fdccc0c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:00.707429 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e04374b8-8b65-46f5-925a-e8061fdccc0c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:00.713768 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e04374b8-8b65-46f5-925a-e8061fdccc0c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:00.714221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e04374b8-8b65-46f5-925a-e8061fdccc0c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:00.714985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e04374b8-8b65-46f5-925a-e8061fdccc0c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:00.715458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e04374b8-8b65-46f5-925a-e8061fdccc0c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:00.842317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e04374b8-8b65-46f5-925a-e8061fdccc0c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:00.850813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e04374b8-8b65-46f5-925a-e8061fdccc0c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148628 Aug 04 05:03:00.851385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1101/2200] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:00 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:01.871869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d5982837-7406-469b-be32-701b7fa94c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:01.872510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d5982837-7406-469b-be32-701b7fa94c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:01.874817 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=26 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:01.881205 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5982837-7406-469b-be32-701b7fa94c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:01.881758 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5982837-7406-469b-be32-701b7fa94c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:01.882521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5982837-7406-469b-be32-701b7fa94c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:01.882962 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d5982837-7406-469b-be32-701b7fa94c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:02.275284 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d5982837-7406-469b-be32-701b7fa94c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:02.283226 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d5982837-7406-469b-be32-701b7fa94c8f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.415171 Aug 04 05:03:02.283777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1100/2201] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:01 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:03.305627 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c21b4b19-14de-44dc-8b1e-e8c682c31d01 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:03.306294 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c21b4b19-14de-44dc-8b1e-e8c682c31d01 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:03.308327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=26 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:03.314240 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c21b4b19-14de-44dc-8b1e-e8c682c31d01 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:03.314688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c21b4b19-14de-44dc-8b1e-e8c682c31d01 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:03.315499 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c21b4b19-14de-44dc-8b1e-e8c682c31d01 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:03.316132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c21b4b19-14de-44dc-8b1e-e8c682c31d01 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:03.442481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c21b4b19-14de-44dc-8b1e-e8c682c31d01 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:03.450312 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c21b4b19-14de-44dc-8b1e-e8c682c31d01 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150011 Aug 04 05:03:03.450869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1102/2202] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:03 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:04.472106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c623fec7-1a56-496e-b39b-b2a2bd452854 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:04.472743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c623fec7-1a56-496e-b39b-b2a2bd452854 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:04.479360 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c623fec7-1a56-496e-b39b-b2a2bd452854 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:04.479813 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c623fec7-1a56-496e-b39b-b2a2bd452854 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:04.480577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c623fec7-1a56-496e-b39b-b2a2bd452854 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:04.481024 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c623fec7-1a56-496e-b39b-b2a2bd452854 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:04.613444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c623fec7-1a56-496e-b39b-b2a2bd452854 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:04.621471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c623fec7-1a56-496e-b39b-b2a2bd452854 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153311 Aug 04 05:03:04.622066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1101/2203] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:04 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:05.643270 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-00e28485-302f-4efd-a206-86a0b3fb171f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:05.644153 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-00e28485-302f-4efd-a206-86a0b3fb171f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:05.650630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-00e28485-302f-4efd-a206-86a0b3fb171f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:05.651087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-00e28485-302f-4efd-a206-86a0b3fb171f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:05.651851 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-00e28485-302f-4efd-a206-86a0b3fb171f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:05.652290 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-00e28485-302f-4efd-a206-86a0b3fb171f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:05.783817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-00e28485-302f-4efd-a206-86a0b3fb171f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:05.792328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-00e28485-302f-4efd-a206-86a0b3fb171f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152961 Aug 04 05:03:05.792887 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1103/2204] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:05 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:06.813412 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-91f6dee5-25e5-49a7-915e-be06a219006f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:06.814057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-91f6dee5-25e5-49a7-915e-be06a219006f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:06.821323 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91f6dee5-25e5-49a7-915e-be06a219006f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:06.821817 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91f6dee5-25e5-49a7-915e-be06a219006f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:06.822575 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91f6dee5-25e5-49a7-915e-be06a219006f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:06.823014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91f6dee5-25e5-49a7-915e-be06a219006f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:06.963265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-91f6dee5-25e5-49a7-915e-be06a219006f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:06.971244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-91f6dee5-25e5-49a7-915e-be06a219006f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.161732 Aug 04 05:03:06.971945 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1102/2205] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:06 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:07.993185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-da47d817-f0e2-4ca6-9d48-7f872a081c94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:07.993891 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-da47d817-f0e2-4ca6-9d48-7f872a081c94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:08.000319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da47d817-f0e2-4ca6-9d48-7f872a081c94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:08.001230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da47d817-f0e2-4ca6-9d48-7f872a081c94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:08.001501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da47d817-f0e2-4ca6-9d48-7f872a081c94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:08.001954 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-da47d817-f0e2-4ca6-9d48-7f872a081c94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:08.129918 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-da47d817-f0e2-4ca6-9d48-7f872a081c94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:08.137758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-da47d817-f0e2-4ca6-9d48-7f872a081c94 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148389 Aug 04 05:03:08.138310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1104/2206] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:07 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:09.158720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-89603941-2107-437e-823e-c941581f80fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:09.159328 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-89603941-2107-437e-823e-c941581f80fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:09.166000 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89603941-2107-437e-823e-c941581f80fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:09.166456 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89603941-2107-437e-823e-c941581f80fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:09.167217 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89603941-2107-437e-823e-c941581f80fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:09.167658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-89603941-2107-437e-823e-c941581f80fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:09.295100 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-89603941-2107-437e-823e-c941581f80fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:09.303979 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-89603941-2107-437e-823e-c941581f80fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149103 Aug 04 05:03:09.304539 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1103/2207] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:09 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:10.324901 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-dcc1b50a-a9ed-421c-b468-b2ad3d2608eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:10.325515 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-dcc1b50a-a9ed-421c-b468-b2ad3d2608eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:10.332777 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dcc1b50a-a9ed-421c-b468-b2ad3d2608eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:10.333224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dcc1b50a-a9ed-421c-b468-b2ad3d2608eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:10.334003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dcc1b50a-a9ed-421c-b468-b2ad3d2608eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:10.334434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-dcc1b50a-a9ed-421c-b468-b2ad3d2608eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:10.468706 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-dcc1b50a-a9ed-421c-b468-b2ad3d2608eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:10.476972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-dcc1b50a-a9ed-421c-b468-b2ad3d2608eb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.155904 Aug 04 05:03:10.477524 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1105/2208] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:10 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:11.498599 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-91baf611-2c69-4e25-bea7-7b0eb6e0d294 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:11.499198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-91baf611-2c69-4e25-bea7-7b0eb6e0d294 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:11.506094 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91baf611-2c69-4e25-bea7-7b0eb6e0d294 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:11.506552 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91baf611-2c69-4e25-bea7-7b0eb6e0d294 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:11.507320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91baf611-2c69-4e25-bea7-7b0eb6e0d294 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:11.507768 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-91baf611-2c69-4e25-bea7-7b0eb6e0d294 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:11.637841 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-91baf611-2c69-4e25-bea7-7b0eb6e0d294 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:11.646566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-91baf611-2c69-4e25-bea7-7b0eb6e0d294 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151820 Aug 04 05:03:11.647133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1104/2209] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:11 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:12.667557 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-659026cd-5724-4001-a2fd-19d3dacd6d52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:12.668159 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-659026cd-5724-4001-a2fd-19d3dacd6d52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:12.675646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-659026cd-5724-4001-a2fd-19d3dacd6d52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:12.676091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-659026cd-5724-4001-a2fd-19d3dacd6d52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:12.676842 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-659026cd-5724-4001-a2fd-19d3dacd6d52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:12.677276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-659026cd-5724-4001-a2fd-19d3dacd6d52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:12.807318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-659026cd-5724-4001-a2fd-19d3dacd6d52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:12.816069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-659026cd-5724-4001-a2fd-19d3dacd6d52 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151560 Aug 04 05:03:12.816626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1106/2210] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:12 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:13.836746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ae49dfdb-f1c6-44e8-8152-3470aba8bdeb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:13.837361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ae49dfdb-f1c6-44e8-8152-3470aba8bdeb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:13.843857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ae49dfdb-f1c6-44e8-8152-3470aba8bdeb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:13.844309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ae49dfdb-f1c6-44e8-8152-3470aba8bdeb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:13.845068 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ae49dfdb-f1c6-44e8-8152-3470aba8bdeb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:13.845507 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ae49dfdb-f1c6-44e8-8152-3470aba8bdeb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:13.974655 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ae49dfdb-f1c6-44e8-8152-3470aba8bdeb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:13.982618 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ae49dfdb-f1c6-44e8-8152-3470aba8bdeb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149688 Aug 04 05:03:13.983176 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1105/2211] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:13 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:15.003810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-62f7c5d8-5e7d-419e-8a74-14f0fed01860 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:15.004358 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-62f7c5d8-5e7d-419e-8a74-14f0fed01860 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:15.010775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-62f7c5d8-5e7d-419e-8a74-14f0fed01860 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:15.011227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-62f7c5d8-5e7d-419e-8a74-14f0fed01860 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:15.011976 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-62f7c5d8-5e7d-419e-8a74-14f0fed01860 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:15.012404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-62f7c5d8-5e7d-419e-8a74-14f0fed01860 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:15.146599 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-62f7c5d8-5e7d-419e-8a74-14f0fed01860 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:15.154554 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-62f7c5d8-5e7d-419e-8a74-14f0fed01860 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.154738 Aug 04 05:03:15.155115 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1107/2212] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:14 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:16.176482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-397d21de-5810-46c2-8e89-a14a6d0f1965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:16.177075 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-397d21de-5810-46c2-8e89-a14a6d0f1965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:16.183565 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-397d21de-5810-46c2-8e89-a14a6d0f1965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:16.184017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-397d21de-5810-46c2-8e89-a14a6d0f1965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:16.184795 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-397d21de-5810-46c2-8e89-a14a6d0f1965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:16.185215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-397d21de-5810-46c2-8e89-a14a6d0f1965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:16.317308 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-397d21de-5810-46c2-8e89-a14a6d0f1965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:16.325272 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-397d21de-5810-46c2-8e89-a14a6d0f1965 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153218 Aug 04 05:03:16.325884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1106/2213] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:16 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:17.347703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c13b5411-1e6d-4911-8d7b-55de4ee2e88e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:17.348327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c13b5411-1e6d-4911-8d7b-55de4ee2e88e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:17.354845 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c13b5411-1e6d-4911-8d7b-55de4ee2e88e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:17.355298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c13b5411-1e6d-4911-8d7b-55de4ee2e88e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:17.356061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c13b5411-1e6d-4911-8d7b-55de4ee2e88e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:17.356498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c13b5411-1e6d-4911-8d7b-55de4ee2e88e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:17.360504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=78 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:17.485402 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c13b5411-1e6d-4911-8d7b-55de4ee2e88e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:17.494199 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c13b5411-1e6d-4911-8d7b-55de4ee2e88e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151182 Aug 04 05:03:17.494760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1108/2214] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:17 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:18.515049 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7f16d238-7e3b-41b3-87d1-5f4318931af4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:18.515657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7f16d238-7e3b-41b3-87d1-5f4318931af4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:18.522852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7f16d238-7e3b-41b3-87d1-5f4318931af4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:18.523296 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7f16d238-7e3b-41b3-87d1-5f4318931af4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:18.524047 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7f16d238-7e3b-41b3-87d1-5f4318931af4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:18.524479 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7f16d238-7e3b-41b3-87d1-5f4318931af4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:18.656878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7f16d238-7e3b-41b3-87d1-5f4318931af4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:18.664891 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7f16d238-7e3b-41b3-87d1-5f4318931af4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153692 Aug 04 05:03:18.665453 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1107/2215] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:18 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:19.686748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c4c52acf-a9fe-49cc-baf4-9c4e73ed74c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:19.687460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c4c52acf-a9fe-49cc-baf4-9c4e73ed74c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:19.694175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c4c52acf-a9fe-49cc-baf4-9c4e73ed74c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:19.694631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c4c52acf-a9fe-49cc-baf4-9c4e73ed74c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:19.695393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c4c52acf-a9fe-49cc-baf4-9c4e73ed74c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:19.695832 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c4c52acf-a9fe-49cc-baf4-9c4e73ed74c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:19.824553 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c4c52acf-a9fe-49cc-baf4-9c4e73ed74c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:19.832504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c4c52acf-a9fe-49cc-baf4-9c4e73ed74c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149632 Aug 04 05:03:19.833073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1109/2216] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:19 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:20.854156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-817b52f3-7ea0-4ff9-8024-1689aab8133b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:20.854768 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-817b52f3-7ea0-4ff9-8024-1689aab8133b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:20.861216 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-817b52f3-7ea0-4ff9-8024-1689aab8133b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:20.862248 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-817b52f3-7ea0-4ff9-8024-1689aab8133b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:20.863268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-817b52f3-7ea0-4ff9-8024-1689aab8133b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:20.863709 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-817b52f3-7ea0-4ff9-8024-1689aab8133b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:20.995550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-817b52f3-7ea0-4ff9-8024-1689aab8133b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:21.004059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-817b52f3-7ea0-4ff9-8024-1689aab8133b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153804 Aug 04 05:03:21.004614 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1108/2217] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:20 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:22.024806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9ab59d48-b962-4937-8c27-2fca3099d351 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:22.025423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9ab59d48-b962-4937-8c27-2fca3099d351 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:22.032846 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ab59d48-b962-4937-8c27-2fca3099d351 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:22.033835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ab59d48-b962-4937-8c27-2fca3099d351 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:22.034705 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ab59d48-b962-4937-8c27-2fca3099d351 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:22.035150 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ab59d48-b962-4937-8c27-2fca3099d351 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:22.179995 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9ab59d48-b962-4937-8c27-2fca3099d351 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:22.188086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9ab59d48-b962-4937-8c27-2fca3099d351 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.167128 Aug 04 05:03:22.188652 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1110/2218] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:22 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:03:23.214751 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dc7f6437-85dd-454f-9b5d-cd8ed05a9acb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:23.215364 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dc7f6437-85dd-454f-9b5d-cd8ed05a9acb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:23.221906 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc7f6437-85dd-454f-9b5d-cd8ed05a9acb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:23.222355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc7f6437-85dd-454f-9b5d-cd8ed05a9acb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:23.223104 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc7f6437-85dd-454f-9b5d-cd8ed05a9acb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:23.223535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dc7f6437-85dd-454f-9b5d-cd8ed05a9acb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:23.226029 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=78 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:23.353116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dc7f6437-85dd-454f-9b5d-cd8ed05a9acb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:23.361031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dc7f6437-85dd-454f-9b5d-cd8ed05a9acb tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150157 Aug 04 05:03:23.362205 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1109/2219] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:23 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:24.382234 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5475c28b-2c84-42e3-be1a-86ea7ad5886e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:24.382885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5475c28b-2c84-42e3-be1a-86ea7ad5886e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:24.389081 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5475c28b-2c84-42e3-be1a-86ea7ad5886e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:24.389534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5475c28b-2c84-42e3-be1a-86ea7ad5886e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:24.390319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5475c28b-2c84-42e3-be1a-86ea7ad5886e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:24.390758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5475c28b-2c84-42e3-be1a-86ea7ad5886e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:24.524488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5475c28b-2c84-42e3-be1a-86ea7ad5886e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:24.532452 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5475c28b-2c84-42e3-be1a-86ea7ad5886e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.154108 Aug 04 05:03:24.533016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1111/2220] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:24 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:25.554741 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7a762e54-2d8c-46b7-b2d8-f83bc9669f46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:25.555360 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7a762e54-2d8c-46b7-b2d8-f83bc9669f46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:25.561789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7a762e54-2d8c-46b7-b2d8-f83bc9669f46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:25.562232 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7a762e54-2d8c-46b7-b2d8-f83bc9669f46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:25.562982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7a762e54-2d8c-46b7-b2d8-f83bc9669f46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:25.563414 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7a762e54-2d8c-46b7-b2d8-f83bc9669f46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:25.691648 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7a762e54-2d8c-46b7-b2d8-f83bc9669f46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:25.699529 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7a762e54-2d8c-46b7-b2d8-f83bc9669f46 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148969 Aug 04 05:03:25.700030 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1110/2221] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:25 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:26.721705 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ef96641b-dca2-4dae-abc6-9a17bab02489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:26.722317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ef96641b-dca2-4dae-abc6-9a17bab02489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:26.728292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef96641b-dca2-4dae-abc6-9a17bab02489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:26.728734 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef96641b-dca2-4dae-abc6-9a17bab02489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:26.729489 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef96641b-dca2-4dae-abc6-9a17bab02489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:26.729937 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef96641b-dca2-4dae-abc6-9a17bab02489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:26.863351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ef96641b-dca2-4dae-abc6-9a17bab02489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:26.871195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ef96641b-dca2-4dae-abc6-9a17bab02489 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.154222 Aug 04 05:03:26.871755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1112/2222] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:26 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:27.892818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-136135ed-ffbc-43a1-8bca-bc8e7cd3e2ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:27.893609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-136135ed-ffbc-43a1-8bca-bc8e7cd3e2ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:27.899875 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-136135ed-ffbc-43a1-8bca-bc8e7cd3e2ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:27.900319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-136135ed-ffbc-43a1-8bca-bc8e7cd3e2ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:27.901070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-136135ed-ffbc-43a1-8bca-bc8e7cd3e2ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:27.901500 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-136135ed-ffbc-43a1-8bca-bc8e7cd3e2ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:28.034524 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-136135ed-ffbc-43a1-8bca-bc8e7cd3e2ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:28.042472 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-136135ed-ffbc-43a1-8bca-bc8e7cd3e2ed tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153600 Aug 04 05:03:28.043040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1111/2223] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:27 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:29.063784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-627f30ad-9cdb-4a21-98f3-305967cbee8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:29.064548 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-627f30ad-9cdb-4a21-98f3-305967cbee8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:29.071046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-627f30ad-9cdb-4a21-98f3-305967cbee8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:29.071492 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-627f30ad-9cdb-4a21-98f3-305967cbee8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:29.072237 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-627f30ad-9cdb-4a21-98f3-305967cbee8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:29.072667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-627f30ad-9cdb-4a21-98f3-305967cbee8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:29.200196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-627f30ad-9cdb-4a21-98f3-305967cbee8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:29.208404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-627f30ad-9cdb-4a21-98f3-305967cbee8e tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148435 Aug 04 05:03:29.208972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1113/2224] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:29 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:30.229480 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a1d79ed3-6d6d-4c62-83b3-181c4d6a382c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:30.230149 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a1d79ed3-6d6d-4c62-83b3-181c4d6a382c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:30.236996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1d79ed3-6d6d-4c62-83b3-181c4d6a382c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:30.237418 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1d79ed3-6d6d-4c62-83b3-181c4d6a382c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:30.238198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1d79ed3-6d6d-4c62-83b3-181c4d6a382c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:30.238629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a1d79ed3-6d6d-4c62-83b3-181c4d6a382c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:30.372132 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a1d79ed3-6d6d-4c62-83b3-181c4d6a382c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:30.380551 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a1d79ed3-6d6d-4c62-83b3-181c4d6a382c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.154971 Aug 04 05:03:30.381126 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1112/2225] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:30 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:31.403034 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c2565e30-990c-4f44-bd00-742afcf9d192 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:31.403602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c2565e30-990c-4f44-bd00-742afcf9d192 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:31.410515 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2565e30-990c-4f44-bd00-742afcf9d192 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:31.410970 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2565e30-990c-4f44-bd00-742afcf9d192 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:31.411728 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2565e30-990c-4f44-bd00-742afcf9d192 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:31.412166 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c2565e30-990c-4f44-bd00-742afcf9d192 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:31.542569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c2565e30-990c-4f44-bd00-742afcf9d192 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:31.551107 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c2565e30-990c-4f44-bd00-742afcf9d192 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.152537 Aug 04 05:03:31.551665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1114/2226] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:31 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:32.572321 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-508906ca-3e2a-45f9-91f0-65e2169bc5a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:32.572933 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-508906ca-3e2a-45f9-91f0-65e2169bc5a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:32.575254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=26 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:32.580695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-508906ca-3e2a-45f9-91f0-65e2169bc5a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:32.581148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-508906ca-3e2a-45f9-91f0-65e2169bc5a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:32.581929 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-508906ca-3e2a-45f9-91f0-65e2169bc5a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:32.582366 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-508906ca-3e2a-45f9-91f0-65e2169bc5a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:32.718166 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-508906ca-3e2a-45f9-91f0-65e2169bc5a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:32.726928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-508906ca-3e2a-45f9-91f0-65e2169bc5a8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.158472 Aug 04 05:03:32.727496 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1113/2227] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:32 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:33.747682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6c1b69e0-7ee6-41b1-bbf1-5f7f72d3cda9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:33.748234 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6c1b69e0-7ee6-41b1-bbf1-5f7f72d3cda9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:33.750682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=26 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:33.756835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6c1b69e0-7ee6-41b1-bbf1-5f7f72d3cda9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:33.757282 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6c1b69e0-7ee6-41b1-bbf1-5f7f72d3cda9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:33.758066 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6c1b69e0-7ee6-41b1-bbf1-5f7f72d3cda9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:33.758506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6c1b69e0-7ee6-41b1-bbf1-5f7f72d3cda9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:33.885927 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6c1b69e0-7ee6-41b1-bbf1-5f7f72d3cda9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:33.893919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6c1b69e0-7ee6-41b1-bbf1-5f7f72d3cda9 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150151 Aug 04 05:03:33.894481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1115/2228] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:33 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:34.915108 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-94feabc7-6b06-49fb-933d-a18c69b1aaba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:34.915716 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-94feabc7-6b06-49fb-933d-a18c69b1aaba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:34.922439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-94feabc7-6b06-49fb-933d-a18c69b1aaba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:34.922906 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-94feabc7-6b06-49fb-933d-a18c69b1aaba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:34.924206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-94feabc7-6b06-49fb-933d-a18c69b1aaba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:34.924641 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-94feabc7-6b06-49fb-933d-a18c69b1aaba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:35.056751 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-94feabc7-6b06-49fb-933d-a18c69b1aaba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:35.065289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-94feabc7-6b06-49fb-933d-a18c69b1aaba tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.154035 Aug 04 05:03:35.065999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1114/2229] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:34 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:36.086281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3ef8b6d1-dc19-4258-a099-8c30a062925c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:36.086893 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3ef8b6d1-dc19-4258-a099-8c30a062925c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:36.093720 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ef8b6d1-dc19-4258-a099-8c30a062925c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:36.094166 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ef8b6d1-dc19-4258-a099-8c30a062925c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:36.094912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ef8b6d1-dc19-4258-a099-8c30a062925c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:36.096226 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ef8b6d1-dc19-4258-a099-8c30a062925c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:36.227557 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3ef8b6d1-dc19-4258-a099-8c30a062925c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:36.235547 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3ef8b6d1-dc19-4258-a099-8c30a062925c tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.153077 Aug 04 05:03:36.236142 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1116/2230] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:36 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:37.256958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9926cb13-3969-41a3-b751-5469d7b678ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:37.257525 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9926cb13-3969-41a3-b751-5469d7b678ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:37.266002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9926cb13-3969-41a3-b751-5469d7b678ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:37.266811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9926cb13-3969-41a3-b751-5469d7b678ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:37.268177 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9926cb13-3969-41a3-b751-5469d7b678ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:37.268970 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9926cb13-3969-41a3-b751-5469d7b678ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:37.400404 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9926cb13-3969-41a3-b751-5469d7b678ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:37.408369 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9926cb13-3969-41a3-b751-5469d7b678ce tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.155992 Aug 04 05:03:37.408937 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1115/2231] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:37 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:38.431350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-44314ffc-c49b-4fe0-9931-ea3af6ebd513 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:38.431964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-44314ffc-c49b-4fe0-9931-ea3af6ebd513 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:38.437994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44314ffc-c49b-4fe0-9931-ea3af6ebd513 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:38.438441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44314ffc-c49b-4fe0-9931-ea3af6ebd513 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:38.439188 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44314ffc-c49b-4fe0-9931-ea3af6ebd513 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:38.439617 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44314ffc-c49b-4fe0-9931-ea3af6ebd513 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:38.573851 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-44314ffc-c49b-4fe0-9931-ea3af6ebd513 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:38.581773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-44314ffc-c49b-4fe0-9931-ea3af6ebd513 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.155933 Aug 04 05:03:38.582361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1117/2232] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:38 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:39.603293 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-97d57e5c-fe95-42f3-b31f-392d2d0029ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:39.604019 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-97d57e5c-fe95-42f3-b31f-392d2d0029ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:39.611550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97d57e5c-fe95-42f3-b31f-392d2d0029ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:39.612000 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97d57e5c-fe95-42f3-b31f-392d2d0029ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:39.612773 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97d57e5c-fe95-42f3-b31f-392d2d0029ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:39.613212 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-97d57e5c-fe95-42f3-b31f-392d2d0029ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:39.751003 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-97d57e5c-fe95-42f3-b31f-392d2d0029ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:39.760022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-97d57e5c-fe95-42f3-b31f-392d2d0029ec tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.160543 Aug 04 05:03:39.760515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1116/2233] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:39 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:40.781271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9ea6c095-a88f-4a90-b643-dc339268d44b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:40.781911 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9ea6c095-a88f-4a90-b643-dc339268d44b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:40.789241 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ea6c095-a88f-4a90-b643-dc339268d44b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:40.789721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ea6c095-a88f-4a90-b643-dc339268d44b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:40.790483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ea6c095-a88f-4a90-b643-dc339268d44b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:40.790927 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9ea6c095-a88f-4a90-b643-dc339268d44b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:40.924530 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9ea6c095-a88f-4a90-b643-dc339268d44b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:40.932435 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9ea6c095-a88f-4a90-b643-dc339268d44b tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.155090 Aug 04 05:03:40.932999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1118/2234] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:40 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:41.953033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e27f0304-bc57-4671-a458-b0925e2fb7fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:41.953662 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e27f0304-bc57-4671-a458-b0925e2fb7fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:41.960831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e27f0304-bc57-4671-a458-b0925e2fb7fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:41.961273 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e27f0304-bc57-4671-a458-b0925e2fb7fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:41.962059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e27f0304-bc57-4671-a458-b0925e2fb7fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:41.962491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e27f0304-bc57-4671-a458-b0925e2fb7fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:42.092319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e27f0304-bc57-4671-a458-b0925e2fb7fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:42.100173 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e27f0304-bc57-4671-a458-b0925e2fb7fa tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.150985 Aug 04 05:03:42.100734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1117/2235] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:41 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:43.122377 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1326caaa-a14b-4773-b771-a415df878011 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:43.122989 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1326caaa-a14b-4773-b771-a415df878011 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:43.129562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1326caaa-a14b-4773-b771-a415df878011 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:43.130019 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1326caaa-a14b-4773-b771-a415df878011 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:43.130769 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1326caaa-a14b-4773-b771-a415df878011 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:43.131205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1326caaa-a14b-4773-b771-a415df878011 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:43.256903 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1326caaa-a14b-4773-b771-a415df878011 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:43.264729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1326caaa-a14b-4773-b771-a415df878011 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.146221 Aug 04 05:03:43.265279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1119/2236] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:43 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:44.287169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4c18288c-adc9-4f4a-9786-9f66eb4ca531 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:44.287775 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4c18288c-adc9-4f4a-9786-9f66eb4ca531 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:44.294251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4c18288c-adc9-4f4a-9786-9f66eb4ca531 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:44.294679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4c18288c-adc9-4f4a-9786-9f66eb4ca531 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:44.295698 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4c18288c-adc9-4f4a-9786-9f66eb4ca531 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:44.296129 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4c18288c-adc9-4f4a-9786-9f66eb4ca531 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:44.431056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4c18288c-adc9-4f4a-9786-9f66eb4ca531 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:44.440326 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4c18288c-adc9-4f4a-9786-9f66eb4ca531 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.157430 Aug 04 05:03:44.441294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1118/2237] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:44 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:45.462392 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-846fcece-a818-4f42-aca3-2763eba05c40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:45.463017 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-846fcece-a818-4f42-aca3-2763eba05c40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:45.469715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-846fcece-a818-4f42-aca3-2763eba05c40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:45.470172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-846fcece-a818-4f42-aca3-2763eba05c40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:45.470937 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-846fcece-a818-4f42-aca3-2763eba05c40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:45.471378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-846fcece-a818-4f42-aca3-2763eba05c40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:45.600367 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-846fcece-a818-4f42-aca3-2763eba05c40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:45.608271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-846fcece-a818-4f42-aca3-2763eba05c40 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.149724 Aug 04 05:03:45.608836 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1120/2238] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:45 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:03:46.629666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5db6df36-dae6-4467-a815-36f79bcb0374 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:46.630202 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5db6df36-dae6-4467-a815-36f79bcb0374 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:46.636639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5db6df36-dae6-4467-a815-36f79bcb0374 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:46.637085 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5db6df36-dae6-4467-a815-36f79bcb0374 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:46.637863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5db6df36-dae6-4467-a815-36f79bcb0374 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:46.638303 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5db6df36-dae6-4467-a815-36f79bcb0374 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:46.768535 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5db6df36-dae6-4467-a815-36f79bcb0374 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:46.777058 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5db6df36-dae6-4467-a815-36f79bcb0374 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151675 Aug 04 05:03:46.777638 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1119/2239] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:46 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:47.798802 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0ac321e1-4e28-4bfd-b90a-cf8a544d8bd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:47.799421 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0ac321e1-4e28-4bfd-b90a-cf8a544d8bd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:47.809579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ac321e1-4e28-4bfd-b90a-cf8a544d8bd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:47.810350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ac321e1-4e28-4bfd-b90a-cf8a544d8bd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:47.811642 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ac321e1-4e28-4bfd-b90a-cf8a544d8bd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:47.812384 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ac321e1-4e28-4bfd-b90a-cf8a544d8bd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:47.818037 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=78 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:47.944414 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0ac321e1-4e28-4bfd-b90a-cf8a544d8bd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:47.952358 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0ac321e1-4e28-4bfd-b90a-cf8a544d8bd3 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.157729 Aug 04 05:03:47.952919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1121/2240] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:47 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:48.973646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7742faaf-3f42-4207-8f98-d24b89bbab63 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:48.974288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7742faaf-3f42-4207-8f98-d24b89bbab63 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:48.981387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7742faaf-3f42-4207-8f98-d24b89bbab63 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:48.982069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7742faaf-3f42-4207-8f98-d24b89bbab63 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:48.983172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7742faaf-3f42-4207-8f98-d24b89bbab63 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:48.983613 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7742faaf-3f42-4207-8f98-d24b89bbab63 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:49.115352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7742faaf-3f42-4207-8f98-d24b89bbab63 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:49.123355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7742faaf-3f42-4207-8f98-d24b89bbab63 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.154128 Aug 04 05:03:49.123918 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1120/2241] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:48 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:50.145779 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-12a24aac-c949-4181-8ef8-0dfa3031ae50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:50.146379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-12a24aac-c949-4181-8ef8-0dfa3031ae50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:50.152778 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-12a24aac-c949-4181-8ef8-0dfa3031ae50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:50.153224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-12a24aac-c949-4181-8ef8-0dfa3031ae50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:50.154000 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-12a24aac-c949-4181-8ef8-0dfa3031ae50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:50.154488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-12a24aac-c949-4181-8ef8-0dfa3031ae50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:50.284146 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-12a24aac-c949-4181-8ef8-0dfa3031ae50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:50.292686 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-12a24aac-c949-4181-8ef8-0dfa3031ae50 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151520 Aug 04 05:03:50.293252 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1122/2242] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:50 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:51.314346 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-57f4815d-e39e-4503-9c99-6e715764af74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:51.314990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-57f4815d-e39e-4503-9c99-6e715764af74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:51.321865 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-57f4815d-e39e-4503-9c99-6e715764af74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:51.322319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-57f4815d-e39e-4503-9c99-6e715764af74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:51.323075 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-57f4815d-e39e-4503-9c99-6e715764af74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:51.323513 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-57f4815d-e39e-4503-9c99-6e715764af74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:51.459980 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-57f4815d-e39e-4503-9c99-6e715764af74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:51.467975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-57f4815d-e39e-4503-9c99-6e715764af74 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.157522 Aug 04 05:03:51.468541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1121/2243] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:51 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:52.488942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-931a63c1-8c2e-44e0-aaef-3dda0c47c628 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:52.489600 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-931a63c1-8c2e-44e0-aaef-3dda0c47c628 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:52.496003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-931a63c1-8c2e-44e0-aaef-3dda0c47c628 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:52.496447 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-931a63c1-8c2e-44e0-aaef-3dda0c47c628 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:52.497196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-931a63c1-8c2e-44e0-aaef-3dda0c47c628 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:52.497657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-931a63c1-8c2e-44e0-aaef-3dda0c47c628 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:52.635539 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-931a63c1-8c2e-44e0-aaef-3dda0c47c628 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:52.643345 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-931a63c1-8c2e-44e0-aaef-3dda0c47c628 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.158570 Aug 04 05:03:52.643960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1123/2244] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:52 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:53.666596 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9355a6df-6ad4-4a10-9836-6ebf8954a457 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:53.667210 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9355a6df-6ad4-4a10-9836-6ebf8954a457 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:53.674095 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9355a6df-6ad4-4a10-9836-6ebf8954a457 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:53.674541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9355a6df-6ad4-4a10-9836-6ebf8954a457 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:53.675850 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9355a6df-6ad4-4a10-9836-6ebf8954a457 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:53.676329 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9355a6df-6ad4-4a10-9836-6ebf8954a457 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:53.678968 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=78 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:03:53.806259 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9355a6df-6ad4-4a10-9836-6ebf8954a457 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:53.814007 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9355a6df-6ad4-4a10-9836-6ebf8954a457 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151296 Aug 04 05:03:53.814558 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1122/2245] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:53 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:54.834529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-04919cd2-52d3-4ac3-94af-ec64b4f148af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:54.835144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-04919cd2-52d3-4ac3-94af-ec64b4f148af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:54.841306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-04919cd2-52d3-4ac3-94af-ec64b4f148af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:54.841794 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-04919cd2-52d3-4ac3-94af-ec64b4f148af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:54.842552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-04919cd2-52d3-4ac3-94af-ec64b4f148af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:54.842988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-04919cd2-52d3-4ac3-94af-ec64b4f148af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:54.972558 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-04919cd2-52d3-4ac3-94af-ec64b4f148af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:54.981494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-04919cd2-52d3-4ac3-94af-ec64b4f148af tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.151216 Aug 04 05:03:54.982076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1124/2246] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:54 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:56.001719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fbd43be5-def7-4818-ad72-f95709a3d940 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:56.002395 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fbd43be5-def7-4818-ad72-f95709a3d940 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: a7ee17d5-d905-461c-95ff-9588447cc943] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:03:56.008580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fbd43be5-def7-4818-ad72-f95709a3d940 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:56.009024 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fbd43be5-def7-4818-ad72-f95709a3d940 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:56.009799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fbd43be5-def7-4818-ad72-f95709a3d940 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:56.010232 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fbd43be5-def7-4818-ad72-f95709a3d940 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:56.138083 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-fbd43be5-def7-4818-ad72-f95709a3d940 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:03:56.146450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fbd43be5-def7-4818-ad72-f95709a3d940 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943" status: 200 len: 1736 microversion: 2.1 time: 0.148577 Aug 04 05:03:56.147003 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1123/2247] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:03:55 2022] GET /compute/v2.1/servers/a7ee17d5-d905-461c-95ff-9588447cc943 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:03:56.166812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c5f84f39-5dfd-4a64-82b3-357c9fbace4a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '.version_select at 0x7fc942304430>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:03:56.171507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c5f84f39-5dfd-4a64-82b3-357c9fbace4a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [a1785e82-ca29-4268-ad9e-4475863b6d1d] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:03:57.179619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [None req-c5f84f39-5dfd-4a64-82b3-357c9fbace4a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [a1785e82-ca29-4268-ad9e-4475863b6d1d] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 40080. Aug 04 05:03:57.198632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c5f84f39-5dfd-4a64-82b3-357c9fbace4a tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-10215279" status: 202 len: 0 microversion: 2.1 time: 1.035635 Aug 04 05:03:57.199208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1125/2248] 10.222.0.47 () {58 vars in 1215 bytes} [Thu Aug 4 05:03:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-10215279 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:03:58.476984 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-da59c239-3dde-41a4-93ee-8121e2e590cc req-a8ada0d7-de72-41fa-a55c-c4fcfadfca1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7ee17d5-d905-461c-95ff-9588447cc943", "tag": "ca3160b8-9bcf-4d31-a9a6-db749330c679"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:03:58.486500 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-da59c239-3dde-41a4-93ee-8121e2e590cc req-a8ada0d7-de72-41fa-a55c-c4fcfadfca1c service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:03:58.487038 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-da59c239-3dde-41a4-93ee-8121e2e590cc req-a8ada0d7-de72-41fa-a55c-c4fcfadfca1c service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:03:58.498832 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-da59c239-3dde-41a4-93ee-8121e2e590cc req-a8ada0d7-de72-41fa-a55c-c4fcfadfca1c service nova] Creating event network-changed:ca3160b8-9bcf-4d31-a9a6-db749330c679 for instance a7ee17d5-d905-461c-95ff-9588447cc943 on hv-cinder-85127 Aug 04 05:03:58.510139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-da59c239-3dde-41a4-93ee-8121e2e590cc req-a8ada0d7-de72-41fa-a55c-c4fcfadfca1c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169492 Aug 04 05:03:58.510915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1124/2249] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:04:13.828682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=23 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:13.829669 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:13.835006 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4ea8a49a-1b70-4fc3-b77a-fd83f1785672 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:13.835541 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4ea8a49a-1b70-4fc3-b77a-fd83f1785672 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:13.843698 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4ea8a49a-1b70-4fc3-b77a-fd83f1785672 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:13.844165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4ea8a49a-1b70-4fc3-b77a-fd83f1785672 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:13.844939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4ea8a49a-1b70-4fc3-b77a-fd83f1785672 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:13.845377 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4ea8a49a-1b70-4fc3-b77a-fd83f1785672 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:13.860349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-4ea8a49a-1b70-4fc3-b77a-fd83f1785672 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] HTTP exception thrown: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4ea8a49a-1b70-4fc3-b77a-fd83f1785672 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Request method failure captured: Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: DELETE /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a HTTP/1.1 Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601qv00E86gDF5SzueP9-B8uyKvLj0nc6Sro2hqNRnxqf2FFlVY_GJALo_D0NGRq_yIC65WvSXE_w16sIVtcZnCaKtgGOc7rRi-c_pAJDe7GccoFXaRba4f_54MB_ilclV0cxbNI5IM7M76SLtoy4xBpnigqD0YOU-aN8nNE7xHgrj4 Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 157a41f0f76c41cb8dfff71a14138534 Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeTestJSON-1618805094 Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:04:13.861997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:04:13.864069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_157a41f0f76c41cb8dfff71a14138534", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:04:13.864069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeTestJSON-1618805094 Aug 04 05:04:13.864069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 157a41f0f76c41cb8dfff71a14138534 Aug 04 05:04:13.864069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1618805094 Aug 04 05:04:13.864069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeTestJSON-1618805094-project Aug 04 05:04:13.864069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:04:13.864069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:04:13.864069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 12f7b1c19d824ac7b8207bf001b79057 Aug 04 05:04:13.864069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeTestJSON-1618805094-project Aug 04 05:04:13.864069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:04:13.864069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 05:04:13.864069 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'ce02b26c-276e-4d87-9790-87a8469fac7a'} Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:04:13.865054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 05:04:13.867253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.869619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4ea8a49a-1b70-4fc3-b77a-fd83f1785672 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Returning 404 to user: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:04:13.869619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4ea8a49a-1b70-4fc3-b77a-fd83f1785672 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 404 len: 111 microversion: 2.1 time: 0.035895 Aug 04 05:04:13.869619 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1126/2250] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 05:04:13 2022] DELETE /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:04:13.873823 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1c1f5602-3865-4632-901d-e47ce4af9ff3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:13.874527 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1c1f5602-3865-4632-901d-e47ce4af9ff3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] [instance: ce02b26c-276e-4d87-9790-87a8469fac7a] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:13.877088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=23 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:13.877385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-781b3afc-454d-440d-9623-08d47b5111ba tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:13.877961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-781b3afc-454d-440d-9623-08d47b5111ba tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:13.878157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=13 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:13.886186 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c1f5602-3865-4632-901d-e47ce4af9ff3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:13.886643 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c1f5602-3865-4632-901d-e47ce4af9ff3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:13.886785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-781b3afc-454d-440d-9623-08d47b5111ba tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:13.887237 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-781b3afc-454d-440d-9623-08d47b5111ba tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:13.887411 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c1f5602-3865-4632-901d-e47ce4af9ff3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:13.888005 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-781b3afc-454d-440d-9623-08d47b5111ba tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:13.888126 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1c1f5602-3865-4632-901d-e47ce4af9ff3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:13.888439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-781b3afc-454d-440d-9623-08d47b5111ba tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:13.902892 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-781b3afc-454d-440d-9623-08d47b5111ba tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] HTTP exception thrown: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 05:04:13.903940 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-1c1f5602-3865-4632-901d-e47ce4af9ff3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] HTTP exception thrown: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-781b3afc-454d-440d-9623-08d47b5111ba tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Request method failure captured: Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: DELETE /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 HTTP/1.1 Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601nPjLcmPV0vVg2FNKyAsUUje18RWIG_TxIfWC210jnaphASZrRhZyq9Y_SDchjVsQCYWSIYUoM5T9CtXKQ_J1Fh7Tjbxe-nlzSYrFMa_gd3dtSn8J6vs-YriYCapLoJ7GeQWUpW8try5lu_qo4lbCzvyB9WeIJv208TzJ5f7iZnds Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:04:13.904831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:04:13.906595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9124d19d48f44fe2a904a715e5db1223", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:04:13.906595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:04:13.906595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:04:13.906595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:04:13.906595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:04:13.906595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:04:13.906595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:04:13.906595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 49a7ce9a27734dc0a187d1b217206785 Aug 04 05:04:13.906595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:04:13.906595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:04:13.906595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 05:04:13.906595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '47c8e2da-dd45-499e-9704-5a6e5d507640'} Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:04:13.907724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 05:04:13.909906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1c1f5602-3865-4632-901d-e47ce4af9ff3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Request method failure captured: Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a HTTP/1.1 Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi601qv00E86gDF5SzueP9-B8uyKvLj0nc6Sro2hqNRnxqf2FFlVY_GJALo_D0NGRq_yIC65WvSXE_w16sIVtcZnCaKtgGOc7rRi-c_pAJDe7GccoFXaRba4f_54MB_ilclV0cxbNI5IM7M76SLtoy4xBpnigqD0YOU-aN8nNE7xHgrj4 Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 157a41f0f76c41cb8dfff71a14138534 Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-AttachVolumeTestJSON-1618805094 Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:04:13.911855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:04:13.914062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_157a41f0f76c41cb8dfff71a14138534", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/157a41f0f76c41cb8dfff71a14138534"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:04:13.914062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-AttachVolumeTestJSON-1618805094 Aug 04 05:04:13.914062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 157a41f0f76c41cb8dfff71a14138534 Aug 04 05:04:13.914062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1618805094 Aug 04 05:04:13.914062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-AttachVolumeTestJSON-1618805094-project Aug 04 05:04:13.914062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:04:13.914062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:04:13.914062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 12f7b1c19d824ac7b8207bf001b79057 Aug 04 05:04:13.914062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-AttachVolumeTestJSON-1618805094-project Aug 04 05:04:13.914062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 05:04:13.914062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 05:04:13.914062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': 'ce02b26c-276e-4d87-9790-87a8469fac7a'} Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:04:13.919256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. Aug 04 05:04:13.921088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.922573 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1c1f5602-3865-4632-901d-e47ce4af9ff3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] Returning 404 to user: Instance ce02b26c-276e-4d87-9790-87a8469fac7a could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:04:13.922670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-781b3afc-454d-440d-9623-08d47b5111ba tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Returning 404 to user: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:04:13.922767 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1c1f5602-3865-4632-901d-e47ce4af9ff3 tempest-AttachVolumeTestJSON-1618805094 tempest-AttachVolumeTestJSON-1618805094-project] 10.222.0.47 "GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a" status: 404 len: 111 microversion: 2.1 time: 0.037328 Aug 04 05:04:13.922767 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1125/2251] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:13 2022] GET /compute/v2.1/servers/ce02b26c-276e-4d87-9790-87a8469fac7a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:04:13.922942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-781b3afc-454d-440d-9623-08d47b5111ba tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "DELETE /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 404 len: 111 microversion: 2.1 time: 0.036875 Aug 04 05:04:13.922942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1127/2252] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 05:04:13 2022] DELETE /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:04:13.923106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-90ed6965-3fb5-4815-8fa2-d57a1ba6cbb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:13.923106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-90ed6965-3fb5-4815-8fa2-d57a1ba6cbb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 47c8e2da-dd45-499e-9704-5a6e5d507640] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:04:13.927232 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-90ed6965-3fb5-4815-8fa2-d57a1ba6cbb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:13.927701 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-90ed6965-3fb5-4815-8fa2-d57a1ba6cbb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:13.928699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-90ed6965-3fb5-4815-8fa2-d57a1ba6cbb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:13.928959 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-90ed6965-3fb5-4815-8fa2-d57a1ba6cbb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:13.943588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-90ed6965-3fb5-4815-8fa2-d57a1ba6cbb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] HTTP exception thrown: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-90ed6965-3fb5-4815-8fa2-d57a1ba6cbb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Request method failure captured: Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 HTTP/1.1 Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi601nPjLcmPV0vVg2FNKyAsUUje18RWIG_TxIfWC210jnaphASZrRhZyq9Y_SDchjVsQCYWSIYUoM5T9CtXKQ_J1Fh7Tjbxe-nlzSYrFMa_gd3dtSn8J6vs-YriYCapLoJ7GeQWUpW8try5lu_qo4lbCzvyB9WeIJv208TzJ5f7iZnds Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:04:13.945157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:04:13.946928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9124d19d48f44fe2a904a715e5db1223", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:04:13.946928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:04:13.946928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:04:13.946928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:04:13.946928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:04:13.946928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:04:13.946928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:04:13.946928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 49a7ce9a27734dc0a187d1b217206785 Aug 04 05:04:13.946928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:04:13.946928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 05:04:13.946928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 05:04:13.946928 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': '47c8e2da-dd45-499e-9704-5a6e5d507640'} Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:04:13.948087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. Aug 04 05:04:13.949678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:13.951295 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-90ed6965-3fb5-4815-8fa2-d57a1ba6cbb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Returning 404 to user: Instance 47c8e2da-dd45-499e-9704-5a6e5d507640 could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:04:13.951295 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-90ed6965-3fb5-4815-8fa2-d57a1ba6cbb9 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640" status: 404 len: 111 microversion: 2.1 time: 0.030993 Aug 04 05:04:13.951295 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1126/2253] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:04:13 2022] GET /compute/v2.1/servers/47c8e2da-dd45-499e-9704-5a6e5d507640 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:04:15.440541 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-7cdf82a7-d19b-4e0e-b3e3-0ea4438d5191 req-f979be3b-b213-4f6c-b933-f2d39c668a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7ee17d5-d905-461c-95ff-9588447cc943", "name": "network-vif-deleted", "tag": "ca3160b8-9bcf-4d31-a9a6-db749330c679"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:15.452001 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-7cdf82a7-d19b-4e0e-b3e3-0ea4438d5191 req-f979be3b-b213-4f6c-b933-f2d39c668a47 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:04:15.452624 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-7cdf82a7-d19b-4e0e-b3e3-0ea4438d5191 req-f979be3b-b213-4f6c-b933-f2d39c668a47 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:04:15.466110 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-7cdf82a7-d19b-4e0e-b3e3-0ea4438d5191 req-f979be3b-b213-4f6c-b933-f2d39c668a47 service nova] Creating event network-vif-deleted:ca3160b8-9bcf-4d31-a9a6-db749330c679 for instance a7ee17d5-d905-461c-95ff-9588447cc943 on hv-cinder-85127 Aug 04 05:04:15.471994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR oslo.messaging._drivers.impl_rabbit [req-7cdf82a7-d19b-4e0e-b3e3-0ea4438d5191 req-f979be3b-b213-4f6c-b933-f2d39c668a47 service nova] [5c99fdf8-9354-4463-8999-0c939f2e1fca] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:04:16.482715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [req-7cdf82a7-d19b-4e0e-b3e3-0ea4438d5191 req-f979be3b-b213-4f6c-b933-f2d39c668a47 service nova] [5c99fdf8-9354-4463-8999-0c939f2e1fca] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 40136. Aug 04 05:04:16.487167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-7cdf82a7-d19b-4e0e-b3e3-0ea4438d5191 req-f979be3b-b213-4f6c-b933-f2d39c668a47 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.050416 Aug 04 05:04:16.488134 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1128/2254] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:04:18.578440 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:04:18.579027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:04:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:04:19.146639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-05b421be-4b0f-4c1e-965e-2edd8b81fbbf tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Action: 'create', calling method: .version_select at 0x7fc9424c5d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1246447123", "metadata": {"Type": "work"}}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-05b421be-4b0f-4c1e-965e-2edd8b81fbbf tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Request method failure captured: Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 122 Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi61NS_bQMjq8CD5cyEUDgxZ-79X_zgE01V-6wYMTDU4HiBAYWBEf7_iaErt7dWFMpqH6cT1HoLxQIr7Agk9sFWilO-kqrQ8v3yX21fgWD9b0SEE9qzyJH-Eu2jljl78pKULxv1v9vugpY64-GekyWoMZ4KL8AzWzyax9HqaNc0i2dK6I Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:04:19.155965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:04:19.157745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1f07f2e1a0d14749be23ba5fadb2e2de", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:04:19.157745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-VolumesNegativeTest-1697586020 Aug 04 05:04:19.157745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:04:19.157745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:04:19.157745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:04:19.157745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:04:19.157745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:04:19.157745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 0c4d68028f274f1aa98f43d259df16c4 Aug 04 05:04:19.157745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:04:19.157745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Aug 04 05:04:19.157745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1246447123", "metadata": {"Type": "work"}}} Aug 04 05:04:19.157745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: Aug 04 05:04:19.157745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1246447123', 'metadata': {'Type': 'work'}}}} Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise error Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:04:19.158860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 05:04:19.162925 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 05:04:19.164493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 05:04:19.164493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.164493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-05b421be-4b0f-4c1e-965e-2edd8b81fbbf tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:04:19.164493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-05b421be-4b0f-4c1e-965e-2edd8b81fbbf tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.122809 Aug 04 05:04:19.164493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1127/2255] 10.222.0.47 () {60 vars in 1156 bytes} [Thu Aug 4 05:04:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:04:19.168574 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d4159ea6-e959-4e18-8b07-498d99ddcba4 tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Action: 'create', calling method: .version_select at 0x7fc9420094c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-752969483", "metadata": {"Type": "work"}}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d4159ea6-e959-4e18-8b07-498d99ddcba4 tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Request method failure captured: Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 119 Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi61NS_bQMjq8CD5cyEUDgxZ-79X_zgE01V-6wYMTDU4HiBAYWBEf7_iaErt7dWFMpqH6cT1HoLxQIr7Agk9sFWilO-kqrQ8v3yX21fgWD9b0SEE9qzyJH-Eu2jljl78pKULxv1v9vugpY64-GekyWoMZ4KL8AzWzyax9HqaNc0i2dK6I Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:04:19.173483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:04:19.175306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1f07f2e1a0d14749be23ba5fadb2e2de", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:04:19.175306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-VolumesNegativeTest-1697586020 Aug 04 05:04:19.175306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:04:19.175306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:04:19.175306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:04:19.175306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:04:19.175306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:04:19.175306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 0c4d68028f274f1aa98f43d259df16c4 Aug 04 05:04:19.175306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:04:19.175306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Aug 04 05:04:19.175306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-752969483", "metadata": {"Type": "work"}}} Aug 04 05:04:19.175306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: Aug 04 05:04:19.175306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-752969483', 'metadata': {'Type': 'work'}}}} Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise error Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi '0' Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:04:19.176821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 05:04:19.178597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 05:04:19.180361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 05:04:19.180361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.180361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d4159ea6-e959-4e18-8b07-498d99ddcba4 tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:04:19.180361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d4159ea6-e959-4e18-8b07-498d99ddcba4 tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010993 Aug 04 05:04:19.180361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1129/2256] 10.222.0.47 () {60 vars in 1156 bytes} [Thu Aug 4 05:04:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:04:19.185485 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5d702fbe-37b8-44a8-8942-8a37d0b6ae0b tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Action: 'create', calling method: .version_select at 0x7fc94369e700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2106248393", "metadata": {"Type": "work"}}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5d702fbe-37b8-44a8-8942-8a37d0b6ae0b tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Request method failure captured: Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 119 Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi61NS_bQMjq8CD5cyEUDgxZ-79X_zgE01V-6wYMTDU4HiBAYWBEf7_iaErt7dWFMpqH6cT1HoLxQIr7Agk9sFWilO-kqrQ8v3yX21fgWD9b0SEE9qzyJH-Eu2jljl78pKULxv1v9vugpY64-GekyWoMZ4KL8AzWzyax9HqaNc0i2dK6I Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:04:19.188975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:04:19.190702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1f07f2e1a0d14749be23ba5fadb2e2de", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:04:19.190702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-VolumesNegativeTest-1697586020 Aug 04 05:04:19.190702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:04:19.190702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:04:19.190702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:04:19.190702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:04:19.190702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:04:19.190702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 0c4d68028f274f1aa98f43d259df16c4 Aug 04 05:04:19.190702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:04:19.190702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Aug 04 05:04:19.190702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2106248393", "metadata": {"Type": "work"}}} Aug 04 05:04:19.190702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: Aug 04 05:04:19.190702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2106248393', 'metadata': {'Type': 'work'}}}} Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise error Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi '' Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:04:19.192139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 05:04:19.193958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 05:04:19.195438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 05:04:19.195438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:04:19.195438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5d702fbe-37b8-44a8-8942-8a37d0b6ae0b tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:04:19.195438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5d702fbe-37b8-44a8-8942-8a37d0b6ae0b tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009598 Aug 04 05:04:19.195438 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1128/2257] 10.222.0.47 () {60 vars in 1156 bytes} [Thu Aug 4 05:04:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 05:04:19.199211 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0722d534-4d46-45e2-94f0-6609652abe34 tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Calling method '.version_select at 0x7fc9420413a0>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:04:25.448951 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=6 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:04:25.457786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=6 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:19.227916 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=4 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:19.228701 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=4 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:05:19.233450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0a99c3cd-7f93-41cc-8e38-7dfbc2c250fa tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Calling method '.version_select at 0x7fc942164ee0>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:05:39.822393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:05:39.823081 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:05:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/tempest-invalid-1070139128 (ip 10.222.0.47) !!! Aug 04 05:06:00.286425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:06:00.287163 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:06:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/tempest-invalid-1070139128 (ip 10.222.0.47) !!! Aug 04 05:06:14.502180 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-0722d534-4d46-45e2-94f0-6609652abe34 tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] HTTP exception thrown: Volume tempest-invalid-1070139128 could not be found. Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0722d534-4d46-45e2-94f0-6609652abe34 tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Request method failure captured: Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1070139128 HTTP/1.1 Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi61NS_bQMjq8CD5cyEUDgxZ-79X_zgE01V-6wYMTDU4HiBAYWBEf7_iaErt7dWFMpqH6cT1HoLxQIr7Agk9sFWilO-kqrQ8v3yX21fgWD9b0SEE9qzyJH-Eu2jljl78pKULxv1v9vugpY64-GekyWoMZ4KL8AzWzyax9HqaNc0i2dK6I Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:06:14.504327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:06:14.506588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1f07f2e1a0d14749be23ba5fadb2e2de", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:06:14.506588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-VolumesNegativeTest-1697586020 Aug 04 05:06:14.506588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:06:14.506588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:06:14.506588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:06:14.506588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:06:14.506588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:06:14.506588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 0c4d68028f274f1aa98f43d259df16c4 Aug 04 05:06:14.506588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:06:14.506588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: Aug 04 05:06:14.506588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Volume tempest-invalid-1070139128 could not be found. Aug 04 05:06:14.506588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'tempest-invalid-1070139128'} Aug 04 05:06:14.506588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1070139128 could not be found. (HTTP 404) (Request-ID: req-2a2177c8-0f11-40ab-a103-c6f6177b724c) Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:14.508213 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:06:14.509816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1070139128 could not be found. Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:06:14.511579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1070139128 could not be found. Aug 04 05:06:14.513263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.513263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:14.513263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.513263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:14.513263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:14.513263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:14.513263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:06:14.513263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:06:14.513263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1070139128 could not be found. Aug 04 05:06:14.513263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.513263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0722d534-4d46-45e2-94f0-6609652abe34 tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Returning 404 to user: Volume tempest-invalid-1070139128 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:06:14.513263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0722d534-4d46-45e2-94f0-6609652abe34 tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1070139128" status: 404 len: 99 microversion: 2.1 time: 115.311535 Aug 04 05:06:14.513263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1130/2258] 10.222.0.47 () {58 vars in 1218 bytes} [Thu Aug 4 05:04:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1070139128 => generated 99 bytes in 115313 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 05:06:14.681688 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-0a99c3cd-7f93-41cc-8e38-7dfbc2c250fa tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] HTTP exception thrown: Volume tempest-invalid-1070139128 could not be found. Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0a99c3cd-7f93-41cc-8e38-7dfbc2c250fa tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Request method failure captured: Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1070139128 HTTP/1.1 Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi61NS_bQMjq8CD5cyEUDgxZ-79X_zgE01V-6wYMTDU4HiBAYWBEf7_iaErt7dWFMpqH6cT1HoLxQIr7Agk9sFWilO-kqrQ8v3yX21fgWD9b0SEE9qzyJH-Eu2jljl78pKULxv1v9vugpY64-GekyWoMZ4KL8AzWzyax9HqaNc0i2dK6I Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:06:14.683807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:06:14.685333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1f07f2e1a0d14749be23ba5fadb2e2de", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:06:14.685333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-VolumesNegativeTest-1697586020 Aug 04 05:06:14.685333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:06:14.685333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:06:14.685333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:06:14.685333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:06:14.685333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:06:14.685333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 0c4d68028f274f1aa98f43d259df16c4 Aug 04 05:06:14.685333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:06:14.685333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: Aug 04 05:06:14.685333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Volume tempest-invalid-1070139128 could not be found. Aug 04 05:06:14.685333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': 'tempest-invalid-1070139128'} Aug 04 05:06:14.685333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1070139128 could not be found. (HTTP 404) (Request-ID: req-d1d3d49a-44a5-460c-8ffb-4404b7d6ba48) Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:14.686531 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:06:14.687774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1070139128 could not be found. Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:06:14.689046 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1070139128 could not be found. Aug 04 05:06:14.690887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.690887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:06:14.690887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.690887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:06:14.690887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:06:14.690887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:06:14.690887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:06:14.690887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:06:14.690887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1070139128 could not be found. Aug 04 05:06:14.690887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:06:14.690887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0a99c3cd-7f93-41cc-8e38-7dfbc2c250fa tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Returning 404 to user: Volume tempest-invalid-1070139128 could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:06:14.690887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0a99c3cd-7f93-41cc-8e38-7dfbc2c250fa tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1070139128" status: 404 len: 99 microversion: 2.1 time: 55.459350 Aug 04 05:06:14.690887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1129/2259] 10.222.0.47 () {58 vars in 1218 bytes} [Thu Aug 4 05:05:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1070139128 => generated 99 bytes in 55460 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 05:06:14.697593 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fa7d5fb4-acdf-47ed-b0af-9445d4a639c9 tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005192 Aug 04 05:06:14.698233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1131/2260] 10.222.0.47 () {58 vars in 1140 bytes} [Thu Aug 4 05:06:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 05:06:14.707879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c44d5b45-a106-4262-8fc2-faed64387fe5 tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003711 Aug 04 05:06:14.708864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1130/2261] 10.222.0.47 () {58 vars in 1137 bytes} [Thu Aug 4 05:06:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 05:06:14.717244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c425ee06-001d-42d3-845c-906f4f5f0c8d tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Calling method '.version_select at 0x7fc941fedee0>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:14.780747 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-290fd63c-9ca5-40c5-9fda-fb74e136f3bd tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Calling method '.version_select at 0x7fc9424f5700>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:07:24.656686 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:07:24.657320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:07:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/36ada4bc-e3e0-43fb-afb0-32a2509d4540 (ip 10.222.0.47) !!! Aug 04 05:07:38.591687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:07:38.592228 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:07:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/36ada4bc-e3e0-43fb-afb0-32a2509d4540 (ip 10.222.0.47) !!! Aug 04 05:07:57.319059 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-c425ee06-001d-42d3-845c-906f4f5f0c8d tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] HTTP exception thrown: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c425ee06-001d-42d3-845c-906f4f5f0c8d tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Request method failure captured: Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: DELETE /compute/v2.1/os-volumes/36ada4bc-e3e0-43fb-afb0-32a2509d4540 HTTP/1.1 Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi61NS_bQMjq8CD5cyEUDgxZ-79X_zgE01V-6wYMTDU4HiBAYWBEf7_iaErt7dWFMpqH6cT1HoLxQIr7Agk9sFWilO-kqrQ8v3yX21fgWD9b0SEE9qzyJH-Eu2jljl78pKULxv1v9vugpY64-GekyWoMZ4KL8AzWzyax9HqaNc0i2dK6I Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:07:57.321205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:07:57.322820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1f07f2e1a0d14749be23ba5fadb2e2de", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:07:57.322820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-VolumesNegativeTest-1697586020 Aug 04 05:07:57.322820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:07:57.322820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:07:57.322820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:07:57.322820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:07:57.322820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:07:57.322820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 0c4d68028f274f1aa98f43d259df16c4 Aug 04 05:07:57.322820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:07:57.322820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: Aug 04 05:07:57.322820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. Aug 04 05:07:57.322820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '36ada4bc-e3e0-43fb-afb0-32a2509d4540'} Aug 04 05:07:57.322820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. (HTTP 404) (Request-ID: req-855bd9df-c65a-4a04-92d0-3c9fd0d97b33) Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:07:57.323869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:07:57.325220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 05:07:57.327216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c425ee06-001d-42d3-845c-906f4f5f0c8d tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Returning 404 to user: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c425ee06-001d-42d3-845c-906f4f5f0c8d tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/36ada4bc-e3e0-43fb-afb0-32a2509d4540" status: 404 len: 109 microversion: 2.1 time: 102.609265 Aug 04 05:07:57.328984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1132/2262] 10.222.0.47 () {58 vars in 1248 bytes} [Thu Aug 4 05:06:14 2022] DELETE /compute/v2.1/os-volumes/36ada4bc-e3e0-43fb-afb0-32a2509d4540 => generated 109 bytes in 102610 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:07:57.574509 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-290fd63c-9ca5-40c5-9fda-fb74e136f3bd tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] HTTP exception thrown: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-290fd63c-9ca5-40c5-9fda-fb74e136f3bd tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Request method failure captured: Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: DELETE /compute/v2.1/os-volumes/36ada4bc-e3e0-43fb-afb0-32a2509d4540 HTTP/1.1 Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi61NS_bQMjq8CD5cyEUDgxZ-79X_zgE01V-6wYMTDU4HiBAYWBEf7_iaErt7dWFMpqH6cT1HoLxQIr7Agk9sFWilO-kqrQ8v3yX21fgWD9b0SEE9qzyJH-Eu2jljl78pKULxv1v9vugpY64-GekyWoMZ4KL8AzWzyax9HqaNc0i2dK6I Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:07:57.576570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:07:57.578320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1f07f2e1a0d14749be23ba5fadb2e2de", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:07:57.578320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-VolumesNegativeTest-1697586020 Aug 04 05:07:57.578320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:07:57.578320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:07:57.578320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:07:57.578320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:07:57.578320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:07:57.578320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 0c4d68028f274f1aa98f43d259df16c4 Aug 04 05:07:57.578320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:07:57.578320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: Aug 04 05:07:57.578320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. Aug 04 05:07:57.578320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': '36ada4bc-e3e0-43fb-afb0-32a2509d4540'} Aug 04 05:07:57.578320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. (HTTP 404) (Request-ID: req-76bc4c72-ec7d-4b4f-b783-0b2296f9de6b) Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:07:57.579728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 05:07:57.581143 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 05:07:57.582422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-290fd63c-9ca5-40c5-9fda-fb74e136f3bd tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Returning 404 to user: Volume 36ada4bc-e3e0-43fb-afb0-32a2509d4540 could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-290fd63c-9ca5-40c5-9fda-fb74e136f3bd tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/36ada4bc-e3e0-43fb-afb0-32a2509d4540" status: 404 len: 109 microversion: 2.1 time: 42.803216 Aug 04 05:07:57.583920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1131/2263] 10.222.0.47 () {58 vars in 1248 bytes} [Thu Aug 4 05:07:14 2022] DELETE /compute/v2.1/os-volumes/36ada4bc-e3e0-43fb-afb0-32a2509d4540 => generated 109 bytes in 42804 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:07:57.589236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7efef260-bf74-4b3b-8960-166f50dab43e tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Calling method '.version_select at 0x7fc941fed160>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:08:14.732772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-7efef260-bf74-4b3b-8960-166f50dab43e tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] HTTP exception thrown: Volume 0e1abaf9-b427-47af-9e4d-7a1c9e69b0d9 could not be found. Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7efef260-bf74-4b3b-8960-166f50dab43e tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Request method failure captured: Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/os-volumes/0e1abaf9-b427-47af-9e4d-7a1c9e69b0d9 HTTP/1.1 Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi61NS_bQMjq8CD5cyEUDgxZ-79X_zgE01V-6wYMTDU4HiBAYWBEf7_iaErt7dWFMpqH6cT1HoLxQIr7Agk9sFWilO-kqrQ8v3yX21fgWD9b0SEE9qzyJH-Eu2jljl78pKULxv1v9vugpY64-GekyWoMZ4KL8AzWzyax9HqaNc0i2dK6I Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:08:14.734775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:08:14.736696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1f07f2e1a0d14749be23ba5fadb2e2de", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1f07f2e1a0d14749be23ba5fadb2e2de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:08:14.736696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-VolumesNegativeTest-1697586020 Aug 04 05:08:14.736696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 1f07f2e1a0d14749be23ba5fadb2e2de Aug 04 05:08:14.736696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-VolumesNegativeTest-1697586020 Aug 04 05:08:14.736696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:08:14.736696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:08:14.736696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:08:14.736696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 0c4d68028f274f1aa98f43d259df16c4 Aug 04 05:08:14.736696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-VolumesNegativeTest-1697586020-project Aug 04 05:08:14.736696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: Aug 04 05:08:14.736696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Volume 0e1abaf9-b427-47af-9e4d-7a1c9e69b0d9 could not be found. Aug 04 05:08:14.736696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '0e1abaf9-b427-47af-9e4d-7a1c9e69b0d9'} Aug 04 05:08:14.736696 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0e1abaf9-b427-47af-9e4d-7a1c9e69b0d9 could not be found. (HTTP 404) (Request-ID: req-7c62ec49-5b53-4b9a-85c7-c315c7949c52) Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:08:14.738162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 05:08:14.739775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0e1abaf9-b427-47af-9e4d-7a1c9e69b0d9 could not be found. Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 05:08:14.741303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:08:14.743691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0e1abaf9-b427-47af-9e4d-7a1c9e69b0d9 could not be found. Aug 04 05:08:14.743691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:08:14.743691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:08:14.743691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:08:14.743691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:08:14.743691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:08:14.743691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:08:14.743691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:08:14.743691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:08:14.743691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0e1abaf9-b427-47af-9e4d-7a1c9e69b0d9 could not be found. Aug 04 05:08:14.743691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:08:14.743691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7efef260-bf74-4b3b-8960-166f50dab43e tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] Returning 404 to user: Volume 0e1abaf9-b427-47af-9e4d-7a1c9e69b0d9 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:08:14.743691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7efef260-bf74-4b3b-8960-166f50dab43e tempest-VolumesNegativeTest-1697586020 tempest-VolumesNegativeTest-1697586020-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/0e1abaf9-b427-47af-9e4d-7a1c9e69b0d9" status: 404 len: 109 microversion: 2.1 time: 17.152057 Aug 04 05:08:14.744993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1133/2264] 10.222.0.47 () {58 vars in 1245 bytes} [Thu Aug 4 05:07:57 2022] GET /compute/v2.1/os-volumes/0e1abaf9-b427-47af-9e4d-7a1c9e69b0d9 => generated 109 bytes in 17161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:08:59.830561 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:08:59.831178 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:09:08.264022 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:09:08.264659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:09:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:09:20.294379 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:09:20.294893 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:09:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:09:33.067287 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:09:33.067950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:09:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:10:15.051960 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR oslo.messaging._drivers.impl_rabbit [-] [086f8b94-79ce-49dc-aa60-e5aa4476d9c6] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:10:15.055954 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f9da7a5a-392f-4163-82a9-7f57b3303cfa tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:10:15.056454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f9da7a5a-392f-4163-82a9-7f57b3303cfa tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:10:15.063238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9da7a5a-392f-4163-82a9-7f57b3303cfa tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:10:15.063691 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9da7a5a-392f-4163-82a9-7f57b3303cfa tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:10:15.064448 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9da7a5a-392f-4163-82a9-7f57b3303cfa tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:10:15.064886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f9da7a5a-392f-4163-82a9-7f57b3303cfa tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:10:15.078997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-f9da7a5a-392f-4163-82a9-7f57b3303cfa tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] HTTP exception thrown: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f9da7a5a-392f-4163-82a9-7f57b3303cfa tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Request method failure captured: Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: DELETE /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd HTTP/1.1 Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi601nPjLcmPV0vVg2FNKyAsUUje18RWIG_TxIfWC210jnaphASZrRhZyq9Y_SDchjVsQCYWSIYUoM5T9CtXKQ_J1Fh7Tjbxe-nlzSYrFMa_gd3dtSn8J6vs-YriYCapLoJ7GeQWUpW8try5lu_qo4lbCzvyB9WeIJv208TzJ5f7iZnds Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:10:15.080890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:10:15.082778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9124d19d48f44fe2a904a715e5db1223", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:10:15.082778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:10:15.082778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:10:15.082778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:10:15.082778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:10:15.082778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:10:15.082778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:10:15.082778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 49a7ce9a27734dc0a187d1b217206785 Aug 04 05:10:15.082778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:10:15.082778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 05:10:15.082778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 05:10:15.082778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': '6dbf781e-8aba-4088-8d3e-037ef7c8acbd'} Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:10:15.083842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 05:10:15.085519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.087187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f9da7a5a-392f-4163-82a9-7f57b3303cfa tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Returning 404 to user: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:10:15.087187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f9da7a5a-392f-4163-82a9-7f57b3303cfa tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 404 len: 111 microversion: 2.1 time: 0.033546 Aug 04 05:10:15.087187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1132/2265] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 05:10:15 2022] DELETE /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:10:15.092423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd002c78-6a33-45a8-a101-bc6ad645af03] AMQP server on 10.222.0.47:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 05:10:15.096297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ed753316-2038-4f3c-bae2-cf6a337abf02 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:10:15.097150 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ed753316-2038-4f3c-bae2-cf6a337abf02 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 6dbf781e-8aba-4088-8d3e-037ef7c8acbd] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:10:15.103412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ed753316-2038-4f3c-bae2-cf6a337abf02 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:10:15.103864 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ed753316-2038-4f3c-bae2-cf6a337abf02 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:10:15.104622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ed753316-2038-4f3c-bae2-cf6a337abf02 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:10:15.105118 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ed753316-2038-4f3c-bae2-cf6a337abf02 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:10:15.118493 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-ed753316-2038-4f3c-bae2-cf6a337abf02 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] HTTP exception thrown: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ed753316-2038-4f3c-bae2-cf6a337abf02 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Request method failure captured: Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd HTTP/1.1 Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601nPjLcmPV0vVg2FNKyAsUUje18RWIG_TxIfWC210jnaphASZrRhZyq9Y_SDchjVsQCYWSIYUoM5T9CtXKQ_J1Fh7Tjbxe-nlzSYrFMa_gd3dtSn8J6vs-YriYCapLoJ7GeQWUpW8try5lu_qo4lbCzvyB9WeIJv208TzJ5f7iZnds Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:10:15.119983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:10:15.121670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9124d19d48f44fe2a904a715e5db1223", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:10:15.121670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:10:15.121670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:10:15.121670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:10:15.121670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:10:15.121670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:10:15.121670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:10:15.121670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 49a7ce9a27734dc0a187d1b217206785 Aug 04 05:10:15.121670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:10:15.121670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:10:15.121670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 05:10:15.121670 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '6dbf781e-8aba-4088-8d3e-037ef7c8acbd'} Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:10:15.122736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. Aug 04 05:10:15.124337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.125795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ed753316-2038-4f3c-bae2-cf6a337abf02 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Returning 404 to user: Instance 6dbf781e-8aba-4088-8d3e-037ef7c8acbd could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:10:15.125795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ed753316-2038-4f3c-bae2-cf6a337abf02 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd" status: 404 len: 111 microversion: 2.1 time: 0.032624 Aug 04 05:10:15.125795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1134/2266] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:10:15 2022] GET /compute/v2.1/servers/6dbf781e-8aba-4088-8d3e-037ef7c8acbd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:10:15.130674 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-590631fa-3e5d-4f08-bcf2-5e5ee0143def tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:10:15.131139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-590631fa-3e5d-4f08-bcf2-5e5ee0143def tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:10:15.137058 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-590631fa-3e5d-4f08-bcf2-5e5ee0143def tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:10:15.137506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-590631fa-3e5d-4f08-bcf2-5e5ee0143def tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:10:15.138287 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-590631fa-3e5d-4f08-bcf2-5e5ee0143def tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:10:15.138720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-590631fa-3e5d-4f08-bcf2-5e5ee0143def tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:10:15.152580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-590631fa-3e5d-4f08-bcf2-5e5ee0143def tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] HTTP exception thrown: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-590631fa-3e5d-4f08-bcf2-5e5ee0143def tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Request method failure captured: Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: DELETE /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 HTTP/1.1 Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi601nPjLcmPV0vVg2FNKyAsUUje18RWIG_TxIfWC210jnaphASZrRhZyq9Y_SDchjVsQCYWSIYUoM5T9CtXKQ_J1Fh7Tjbxe-nlzSYrFMa_gd3dtSn8J6vs-YriYCapLoJ7GeQWUpW8try5lu_qo4lbCzvyB9WeIJv208TzJ5f7iZnds Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:10:15.154124 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:10:15.155797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9124d19d48f44fe2a904a715e5db1223", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:10:15.155797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:10:15.155797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:10:15.155797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:10:15.155797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:10:15.155797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:10:15.155797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:10:15.155797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 49a7ce9a27734dc0a187d1b217206785 Aug 04 05:10:15.155797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:10:15.155797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 05:10:15.155797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 05:10:15.155797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': '609de40c-089d-4edb-bb3e-9d66b12890a6'} Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:10:15.156746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 05:10:15.158406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.160703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-590631fa-3e5d-4f08-bcf2-5e5ee0143def tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Returning 404 to user: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:10:15.160703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-590631fa-3e5d-4f08-bcf2-5e5ee0143def tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "DELETE /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 404 len: 111 microversion: 2.1 time: 0.029624 Aug 04 05:10:15.160703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1133/2267] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 05:10:15 2022] DELETE /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:10:15.164792 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7107cb41-7069-42c0-8378-c3e9ac514e10 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:10:15.165404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7107cb41-7069-42c0-8378-c3e9ac514e10 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: 609de40c-089d-4edb-bb3e-9d66b12890a6] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:10:15.171638 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7107cb41-7069-42c0-8378-c3e9ac514e10 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:10:15.172084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7107cb41-7069-42c0-8378-c3e9ac514e10 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:10:15.172831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7107cb41-7069-42c0-8378-c3e9ac514e10 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:10:15.173271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7107cb41-7069-42c0-8378-c3e9ac514e10 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:10:15.192257 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-7107cb41-7069-42c0-8378-c3e9ac514e10 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] HTTP exception thrown: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7107cb41-7069-42c0-8378-c3e9ac514e10 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Request method failure captured: Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 HTTP/1.1 Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601nPjLcmPV0vVg2FNKyAsUUje18RWIG_TxIfWC210jnaphASZrRhZyq9Y_SDchjVsQCYWSIYUoM5T9CtXKQ_J1Fh7Tjbxe-nlzSYrFMa_gd3dtSn8J6vs-YriYCapLoJ7GeQWUpW8try5lu_qo4lbCzvyB9WeIJv208TzJ5f7iZnds Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:10:15.199473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:10:15.201500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9124d19d48f44fe2a904a715e5db1223", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:10:15.201500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:10:15.201500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:10:15.201500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:10:15.201500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:10:15.201500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:10:15.201500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:10:15.201500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 49a7ce9a27734dc0a187d1b217206785 Aug 04 05:10:15.201500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:10:15.201500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:10:15.201500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 05:10:15.201500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '609de40c-089d-4edb-bb3e-9d66b12890a6'} Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:10:15.202498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. Aug 04 05:10:15.204076 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:10:15.205501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7107cb41-7069-42c0-8378-c3e9ac514e10 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Returning 404 to user: Instance 609de40c-089d-4edb-bb3e-9d66b12890a6 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:10:15.205501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7107cb41-7069-42c0-8378-c3e9ac514e10 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6" status: 404 len: 111 microversion: 2.1 time: 0.035888 Aug 04 05:10:15.205501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1135/2268] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:10:15 2022] GET /compute/v2.1/servers/609de40c-089d-4edb-bb3e-9d66b12890a6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:10:44.664999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:10:44.665638 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:10:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:10:58.600052 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:10:58.600570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:10:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:12:19.839447 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:12:19.840020 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:12:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:12:28.272800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:12:28.273371 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:12:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:12:40.303348 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:12:40.304120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:12:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:12:53.075873 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:12:53.076473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:12:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:14:04.673607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:14:04.674170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:14:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:14:11.728762 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=4 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:11.729602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=4 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:11.737280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1f7321cb-d483-49f1-8f98-fad073976f83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:11.738021 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1f7321cb-d483-49f1-8f98-fad073976f83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:11.742216 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-72bfccb9-1a12-4dfb-a5f2-16a560a36ff1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:11.743590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-72bfccb9-1a12-4dfb-a5f2-16a560a36ff1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:11.745527 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1f7321cb-d483-49f1-8f98-fad073976f83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:11.745999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1f7321cb-d483-49f1-8f98-fad073976f83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:11.746948 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1f7321cb-d483-49f1-8f98-fad073976f83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:11.747566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1f7321cb-d483-49f1-8f98-fad073976f83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:11.750431 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=4 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:11.751479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=4 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:11.753099 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72bfccb9-1a12-4dfb-a5f2-16a560a36ff1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:11.753648 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72bfccb9-1a12-4dfb-a5f2-16a560a36ff1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:11.754466 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72bfccb9-1a12-4dfb-a5f2-16a560a36ff1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:11.754915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-72bfccb9-1a12-4dfb-a5f2-16a560a36ff1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:11.763067 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] [086f8b94-79ce-49dc-aa60-e5aa4476d9c6] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 40574. Aug 04 05:14:11.772246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-72bfccb9-1a12-4dfb-a5f2-16a560a36ff1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] HTTP exception thrown: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-72bfccb9-1a12-4dfb-a5f2-16a560a36ff1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Request method failure captured: Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: DELETE /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 HTTP/1.1 Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601nPjLcmPV0vVg2FNKyAsUUje18RWIG_TxIfWC210jnaphASZrRhZyq9Y_SDchjVsQCYWSIYUoM5T9CtXKQ_J1Fh7Tjbxe-nlzSYrFMa_gd3dtSn8J6vs-YriYCapLoJ7GeQWUpW8try5lu_qo4lbCzvyB9WeIJv208TzJ5f7iZnds Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:14:11.774931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:14:11.776755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9124d19d48f44fe2a904a715e5db1223", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:14:11.776755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:14:11.776755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:14:11.776755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:14:11.776755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:14:11.776755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:14:11.776755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:14:11.776755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 49a7ce9a27734dc0a187d1b217206785 Aug 04 05:14:11.776755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:14:11.776755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:14:11.776755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 05:14:11.776755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'b66d5fe6-f2d3-45e8-a225-8d7d10522e92'} Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:14:11.777837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 05:14:11.779605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:11.782217 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-72bfccb9-1a12-4dfb-a5f2-16a560a36ff1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Returning 404 to user: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:14:11.783248 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-72bfccb9-1a12-4dfb-a5f2-16a560a36ff1 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 404 len: 111 microversion: 2.1 time: 0.045664 Aug 04 05:14:11.784291 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1136/2269] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 05:14:11 2022] DELETE /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:14:11.786935 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1f7321cb-d483-49f1-8f98-fad073976f83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Going to try to terminate instance {{(pid=134883) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:14:11.792453 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b2d7ea43-43c4-4dc4-a393-1490f0aab9a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:11.793074 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b2d7ea43-43c4-4dc4-a393-1490f0aab9a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] [instance: b66d5fe6-f2d3-45e8-a225-8d7d10522e92] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:11.800423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b2d7ea43-43c4-4dc4-a393-1490f0aab9a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:11.800905 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b2d7ea43-43c4-4dc4-a393-1490f0aab9a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:11.801687 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b2d7ea43-43c4-4dc4-a393-1490f0aab9a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:11.802130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b2d7ea43-43c4-4dc4-a393-1490f0aab9a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:11.802773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd002c78-6a33-45a8-a101-bc6ad645af03] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 40580. Aug 04 05:14:11.818027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-b2d7ea43-43c4-4dc4-a393-1490f0aab9a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] HTTP exception thrown: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b2d7ea43-43c4-4dc4-a393-1490f0aab9a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Request method failure captured: Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 HTTP/1.1 Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi601nPjLcmPV0vVg2FNKyAsUUje18RWIG_TxIfWC210jnaphASZrRhZyq9Y_SDchjVsQCYWSIYUoM5T9CtXKQ_J1Fh7Tjbxe-nlzSYrFMa_gd3dtSn8J6vs-YriYCapLoJ7GeQWUpW8try5lu_qo4lbCzvyB9WeIJv208TzJ5f7iZnds Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:14:11.819594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:14:11.821991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9124d19d48f44fe2a904a715e5db1223", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9124d19d48f44fe2a904a715e5db1223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:14:11.821991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:14:11.821991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 9124d19d48f44fe2a904a715e5db1223 Aug 04 05:14:11.821991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1998793746 Aug 04 05:14:11.821991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:14:11.821991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:14:11.821991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:14:11.821991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 49a7ce9a27734dc0a187d1b217206785 Aug 04 05:14:11.821991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeNegativeTest-1998793746-project Aug 04 05:14:11.821991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:14:11.821991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 05:14:11.821991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'b66d5fe6-f2d3-45e8-a225-8d7d10522e92'} Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:14:11.823087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. Aug 04 05:14:11.824791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:11.826477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b2d7ea43-43c4-4dc4-a393-1490f0aab9a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] Returning 404 to user: Instance b66d5fe6-f2d3-45e8-a225-8d7d10522e92 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:14:11.826477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b2d7ea43-43c4-4dc4-a393-1490f0aab9a0 tempest-AttachVolumeNegativeTest-1998793746 tempest-AttachVolumeNegativeTest-1998793746-project] 10.222.0.47 "GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92" status: 404 len: 111 microversion: 2.1 time: 0.032834 Aug 04 05:14:11.827301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1137/2270] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:11 2022] GET /compute/v2.1/servers/b66d5fe6-f2d3-45e8-a225-8d7d10522e92 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:14:11.904183 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1f7321cb-d483-49f1-8f98-fad073976f83 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 204 len: 0 microversion: 2.1 time: 0.177862 Aug 04 05:14:11.905204 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1134/2271] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 05:14:11 2022] DELETE /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:14:11.913439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-555a963f-6ed0-49c8-9f75-551252af52c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:11.914205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-555a963f-6ed0-49c8-9f75-551252af52c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:11.921807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-555a963f-6ed0-49c8-9f75-551252af52c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:11.922725 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-555a963f-6ed0-49c8-9f75-551252af52c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:11.924002 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-555a963f-6ed0-49c8-9f75-551252af52c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:11.924675 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-555a963f-6ed0-49c8-9f75-551252af52c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:12.339687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-a72128e1-ec48-44f1-904c-c646304f25cc req-60e0e9e2-7f02-49b4-b2d3-9eaeddcc14fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf81135-dc56-4991-b7a5-0ed62f3fc2a6", "name": "network-vif-deleted", "tag": "a814e481-ae95-4c87-b59d-c2f124c91e2b"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:12.353293 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-a72128e1-ec48-44f1-904c-c646304f25cc req-60e0e9e2-7f02-49b4-b2d3-9eaeddcc14fb service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:12.353293 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-a72128e1-ec48-44f1-904c-c646304f25cc req-60e0e9e2-7f02-49b4-b2d3-9eaeddcc14fb service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:12.371971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-a72128e1-ec48-44f1-904c-c646304f25cc req-60e0e9e2-7f02-49b4-b2d3-9eaeddcc14fb service nova] Creating event network-vif-deleted:a814e481-ae95-4c87-b59d-c2f124c91e2b for instance dbf81135-dc56-4991-b7a5-0ed62f3fc2a6 on hv-cinder-85127 Aug 04 05:14:12.377123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-a72128e1-ec48-44f1-904c-c646304f25cc req-60e0e9e2-7f02-49b4-b2d3-9eaeddcc14fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.316067 Aug 04 05:14:12.382807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1135/2272] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:14:12.568462 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-555a963f-6ed0-49c8-9f75-551252af52c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:12.578511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-555a963f-6ed0-49c8-9f75-551252af52c8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1509 microversion: 2.1 time: 0.668915 Aug 04 05:14:12.579372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1138/2273] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:11 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1509 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:13.639177 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c035313f-9ae3-4533-af9e-cecae5316444 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:13.642911 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c035313f-9ae3-4533-af9e-cecae5316444 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:13.675659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c035313f-9ae3-4533-af9e-cecae5316444 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:13.675659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c035313f-9ae3-4533-af9e-cecae5316444 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:13.675659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c035313f-9ae3-4533-af9e-cecae5316444 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:13.675659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c035313f-9ae3-4533-af9e-cecae5316444 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:14.135690 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c035313f-9ae3-4533-af9e-cecae5316444 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:14.151162 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c035313f-9ae3-4533-af9e-cecae5316444 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 200 len: 1467 microversion: 2.1 time: 0.554386 Aug 04 05:14:14.152352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1136/2274] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:13 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 1467 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:14:14.410486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-5ca644f2-1953-4997-ac51-43369eac281c req-5a419d0b-eee4-4657-9dac-924d2b911318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d94d001-2e5d-414e-912f-3e6d0a7ae1a8", "name": "network-vif-deleted", "tag": "24b6a132-9134-4cf2-a1cc-b0b93a4d5634"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:14.437088 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-5ca644f2-1953-4997-ac51-43369eac281c req-5a419d0b-eee4-4657-9dac-924d2b911318 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:14.437869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-5ca644f2-1953-4997-ac51-43369eac281c req-5a419d0b-eee4-4657-9dac-924d2b911318 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:14.453672 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-5ca644f2-1953-4997-ac51-43369eac281c req-5a419d0b-eee4-4657-9dac-924d2b911318 service nova] Creating event network-vif-deleted:24b6a132-9134-4cf2-a1cc-b0b93a4d5634 for instance 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 on hv-cinder-85127 Aug 04 05:14:14.460711 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-5ca644f2-1953-4997-ac51-43369eac281c req-5a419d0b-eee4-4657-9dac-924d2b911318 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056007 Aug 04 05:14:14.462006 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1139/2275] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:14:15.172760 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-089f8680-56d0-4aa8-8a98-bf73af754b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:15.173490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-089f8680-56d0-4aa8-8a98-bf73af754b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:15.182110 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-089f8680-56d0-4aa8-8a98-bf73af754b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:15.182562 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-089f8680-56d0-4aa8-8a98-bf73af754b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:15.183331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-089f8680-56d0-4aa8-8a98-bf73af754b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:15.183852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-089f8680-56d0-4aa8-8a98-bf73af754b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:15.197901 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-089f8680-56d0-4aa8-8a98-bf73af754b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] HTTP exception thrown: Instance 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 could not be found. Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-089f8680-56d0-4aa8-8a98-bf73af754b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Request method failure captured: Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 HTTP/1.1 Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi602uPptuqgFy02y-YzHoVclj5Hq7_LkNXMBvqUC5pmyegtWcMpw0F-pJKdartgmkAfmDd6OJ6hXCBM-pb0p815YHMVq5KwB3Coc6cqRFibtNHQXOz8y91Enyk9viUVHGfYG4BP1_AVa5Ew_ePDyW5iQqlyKdaV2k_FR1A3vcY5g3BfI Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: e43171bfd4564b0c92395767641b91ce Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1508178778 Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:14:15.199541 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:14:15.201080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e43171bfd4564b0c92395767641b91ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e43171bfd4564b0c92395767641b91ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e43171bfd4564b0c92395767641b91ce", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e43171bfd4564b0c92395767641b91ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:14:15.201080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1508178778 Aug 04 05:14:15.201080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: e43171bfd4564b0c92395767641b91ce Aug 04 05:14:15.201080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1508178778 Aug 04 05:14:15.201080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-ServerRescueNegativeTestJSON-1508178778-project Aug 04 05:14:15.201080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:14:15.201080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:14:15.201080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 40a2cbbc654749199e742ae96329a1d9 Aug 04 05:14:15.201080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1508178778-project Aug 04 05:14:15.201080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 05:14:15.201080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 could not be found. Aug 04 05:14:15.201080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': '1d94d001-2e5d-414e-912f-3e6d0a7ae1a8'} Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 could not be found. Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:14:15.202033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 could not be found. Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 could not be found. Aug 04 05:14:15.204889 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:14:15.206608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-089f8680-56d0-4aa8-8a98-bf73af754b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Returning 404 to user: Instance 1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:14:15.206608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-089f8680-56d0-4aa8-8a98-bf73af754b36 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8" status: 404 len: 111 microversion: 2.1 time: 0.032416 Aug 04 05:14:15.206608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1137/2276] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:15 2022] GET /compute/v2.1/servers/1d94d001-2e5d-414e-912f-3e6d0a7ae1a8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:14:15.211061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-cfe28474-a263-4610-87c6-9016da90e4e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:15.211061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cfe28474-a263-4610-87c6-9016da90e4e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:15.217488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cfe28474-a263-4610-87c6-9016da90e4e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:15.217996 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cfe28474-a263-4610-87c6-9016da90e4e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:15.218732 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cfe28474-a263-4610-87c6-9016da90e4e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:15.219162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-cfe28474-a263-4610-87c6-9016da90e4e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:15.246729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-cfe28474-a263-4610-87c6-9016da90e4e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Going to try to terminate instance {{(pid=134884) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:14:15.333225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-cfe28474-a263-4610-87c6-9016da90e4e6 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "DELETE /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 204 len: 0 microversion: 2.1 time: 0.126831 Aug 04 05:14:15.337497 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1140/2277] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 05:14:15 2022] DELETE /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 05:14:15.343190 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0a78dde3-fbfb-4eb0-b266-87c7e420082f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:15.343801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0a78dde3-fbfb-4eb0-b266-87c7e420082f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:15.350120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a78dde3-fbfb-4eb0-b266-87c7e420082f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:15.350572 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a78dde3-fbfb-4eb0-b266-87c7e420082f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:15.351336 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a78dde3-fbfb-4eb0-b266-87c7e420082f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:15.351806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0a78dde3-fbfb-4eb0-b266-87c7e420082f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:15.582150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0a78dde3-fbfb-4eb0-b266-87c7e420082f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:15.593087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0a78dde3-fbfb-4eb0-b266-87c7e420082f tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.253971 Aug 04 05:14:15.604305 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1138/2278] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:15 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:16.615549 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e11d1d05-7e71-485d-9239-42ffd0659254 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:16.616879 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e11d1d05-7e71-485d-9239-42ffd0659254 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:16.624397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e11d1d05-7e71-485d-9239-42ffd0659254 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:16.624828 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e11d1d05-7e71-485d-9239-42ffd0659254 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:16.625604 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e11d1d05-7e71-485d-9239-42ffd0659254 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:16.626208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e11d1d05-7e71-485d-9239-42ffd0659254 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:16.936667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e11d1d05-7e71-485d-9239-42ffd0659254 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:16.946571 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e11d1d05-7e71-485d-9239-42ffd0659254 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.335395 Aug 04 05:14:16.961009 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1141/2279] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:16 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:17.974281 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-708e4c98-6a9c-41d8-ae8a-f23e9d6d0d73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:17.974884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-708e4c98-6a9c-41d8-ae8a-f23e9d6d0d73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:17.996000 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-708e4c98-6a9c-41d8-ae8a-f23e9d6d0d73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:18.006307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-708e4c98-6a9c-41d8-ae8a-f23e9d6d0d73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:18.007460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-708e4c98-6a9c-41d8-ae8a-f23e9d6d0d73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:18.009272 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-708e4c98-6a9c-41d8-ae8a-f23e9d6d0d73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:18.242798 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-708e4c98-6a9c-41d8-ae8a-f23e9d6d0d73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:18.257493 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-708e4c98-6a9c-41d8-ae8a-f23e9d6d0d73 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.292205 Aug 04 05:14:18.279304 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1139/2280] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:17 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:18.608369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:14:18.608861 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:14:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:14:19.280422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a50b9e40-8d5b-44bc-be09-9895bfe8c9c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:19.281056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a50b9e40-8d5b-44bc-be09-9895bfe8c9c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:19.292825 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a50b9e40-8d5b-44bc-be09-9895bfe8c9c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:19.303041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a50b9e40-8d5b-44bc-be09-9895bfe8c9c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:19.304964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a50b9e40-8d5b-44bc-be09-9895bfe8c9c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:19.314428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a50b9e40-8d5b-44bc-be09-9895bfe8c9c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:19.612572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a50b9e40-8d5b-44bc-be09-9895bfe8c9c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:19.626160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a50b9e40-8d5b-44bc-be09-9895bfe8c9c5 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1521 microversion: 2.1 time: 0.349563 Aug 04 05:14:19.628605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1142/2281] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:19 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:19.662782 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-49ad5718-ce79-443a-90db-d10552bcc83f req-5b59b3f8-7548-47ad-b204-787a70367488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e490bd-0671-4049-b64c-74e8dfe5bfb1", "name": "network-vif-deleted", "tag": "40ec849e-d21e-47ee-aa1e-70a0ce528fe8"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:19.680440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-49ad5718-ce79-443a-90db-d10552bcc83f req-5b59b3f8-7548-47ad-b204-787a70367488 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:19.681008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-49ad5718-ce79-443a-90db-d10552bcc83f req-5b59b3f8-7548-47ad-b204-787a70367488 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:19.714362 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-49ad5718-ce79-443a-90db-d10552bcc83f req-5b59b3f8-7548-47ad-b204-787a70367488 service nova] Creating event network-vif-deleted:40ec849e-d21e-47ee-aa1e-70a0ce528fe8 for instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 on hv-cinder-85127 Aug 04 05:14:19.731367 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-49ad5718-ce79-443a-90db-d10552bcc83f req-5b59b3f8-7548-47ad-b204-787a70367488 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072037 Aug 04 05:14:19.732321 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1140/2282] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:14:20.648637 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8be4a89a-1600-4d81-8820-e4a6310b3967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:20.650060 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8be4a89a-1600-4d81-8820-e4a6310b3967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:20.662662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8be4a89a-1600-4d81-8820-e4a6310b3967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:20.663530 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8be4a89a-1600-4d81-8820-e4a6310b3967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:20.664933 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8be4a89a-1600-4d81-8820-e4a6310b3967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:20.665653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8be4a89a-1600-4d81-8820-e4a6310b3967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:20.705971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8be4a89a-1600-4d81-8820-e4a6310b3967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:20.706412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8be4a89a-1600-4d81-8820-e4a6310b3967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:20.707252 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.objects.instance [None req-8be4a89a-1600-4d81-8820-e4a6310b3967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lazy-loading 'fault' on Instance uuid 66e490bd-0671-4049-b64c-74e8dfe5bfb1 {{(pid=134884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:14:20.756464 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8be4a89a-1600-4d81-8820-e4a6310b3967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:20.764540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8be4a89a-1600-4d81-8820-e4a6310b3967 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1311 microversion: 2.1 time: 0.121452 Aug 04 05:14:20.773781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1143/2283] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:20 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1311 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:21.787524 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-fdeb8335-ee5f-4641-895a-e455d03b32c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:21.789013 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-fdeb8335-ee5f-4641-895a-e455d03b32c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:21.797187 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdeb8335-ee5f-4641-895a-e455d03b32c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:21.797846 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdeb8335-ee5f-4641-895a-e455d03b32c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:21.799084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdeb8335-ee5f-4641-895a-e455d03b32c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:21.799639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdeb8335-ee5f-4641-895a-e455d03b32c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:21.836958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdeb8335-ee5f-4641-895a-e455d03b32c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:21.837566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-fdeb8335-ee5f-4641-895a-e455d03b32c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:21.838246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-fdeb8335-ee5f-4641-895a-e455d03b32c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lazy-loading 'fault' on Instance uuid 66e490bd-0671-4049-b64c-74e8dfe5bfb1 {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:14:21.901478 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-fdeb8335-ee5f-4641-895a-e455d03b32c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a2cbbc654749199e742ae96329a1d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43171bfd4564b0c92395767641b91ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:21.910010 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-fdeb8335-ee5f-4641-895a-e455d03b32c4 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 200 len: 1311 microversion: 2.1 time: 0.126929 Aug 04 05:14:21.910839 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1141/2284] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:21 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 1311 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:22.931850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bbf97b9c-4045-46f2-9788-ffd1e37f6dc8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:22.932611 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bbf97b9c-4045-46f2-9788-ffd1e37f6dc8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] [instance: 66e490bd-0671-4049-b64c-74e8dfe5bfb1] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:22.942784 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bbf97b9c-4045-46f2-9788-ffd1e37f6dc8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:22.943329 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bbf97b9c-4045-46f2-9788-ffd1e37f6dc8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:22.944136 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bbf97b9c-4045-46f2-9788-ffd1e37f6dc8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:22.946014 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bbf97b9c-4045-46f2-9788-ffd1e37f6dc8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:22.968201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-bbf97b9c-4045-46f2-9788-ffd1e37f6dc8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] HTTP exception thrown: Instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 could not be found. Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bbf97b9c-4045-46f2-9788-ffd1e37f6dc8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Request method failure captured: Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 HTTP/1.1 Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi602uPptuqgFy02y-YzHoVclj5Hq7_LkNXMBvqUC5pmyegtWcMpw0F-pJKdartgmkAfmDd6OJ6hXCBM-pb0p815YHMVq5KwB3Coc6cqRFibtNHQXOz8y91Enyk9viUVHGfYG4BP1_AVa5Ew_ePDyW5iQqlyKdaV2k_FR1A3vcY5g3BfI Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: e43171bfd4564b0c92395767641b91ce Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1508178778 Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:14:22.970196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:14:22.971835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e43171bfd4564b0c92395767641b91ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e43171bfd4564b0c92395767641b91ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e43171bfd4564b0c92395767641b91ce", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e43171bfd4564b0c92395767641b91ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:14:22.971835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1508178778 Aug 04 05:14:22.971835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: e43171bfd4564b0c92395767641b91ce Aug 04 05:14:22.971835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1508178778 Aug 04 05:14:22.971835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-ServerRescueNegativeTestJSON-1508178778-project Aug 04 05:14:22.971835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:14:22.971835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:14:22.971835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 40a2cbbc654749199e742ae96329a1d9 Aug 04 05:14:22.971835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1508178778-project Aug 04 05:14:22.971835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:14:22.971835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 could not be found. Aug 04 05:14:22.971835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '66e490bd-0671-4049-b64c-74e8dfe5bfb1'} Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 could not be found. Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:14:22.972721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 could not be found. Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 could not be found. Aug 04 05:14:22.974147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:14:22.975423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bbf97b9c-4045-46f2-9788-ffd1e37f6dc8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] Returning 404 to user: Instance 66e490bd-0671-4049-b64c-74e8dfe5bfb1 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:14:22.975423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bbf97b9c-4045-46f2-9788-ffd1e37f6dc8 tempest-ServerRescueNegativeTestJSON-1508178778 tempest-ServerRescueNegativeTestJSON-1508178778-project] 10.222.0.47 "GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1" status: 404 len: 111 microversion: 2.1 time: 0.045175 Aug 04 05:14:22.975423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1144/2285] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:22 2022] GET /compute/v2.1/servers/66e490bd-0671-4049-b64c-74e8dfe5bfb1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:14:28.834563 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b991b92e-4686-456e-b67e-8104a4c6120f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Action: 'create', calling method: .version_select at 0x7fc94226e790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1187330075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXzUHTHkk7QPzpry4cIbLNOids2DiZYQK1PEqhdAYod/2JgY5CBtaVwJnLyVxrQLqfYkRY5/jz3irpZJXqlL8k3LqcvKM8NN6f7NF5MRu7SPvhEg+ooCqDUh5ps2TPYBw=="}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:28.868051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-b991b92e-4686-456e-b67e-8104a4c6120f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Getting quotas for project 731637c0b96a4f1f8d9edb1af69e98cb. Resources: {'key_pairs'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:14:28.874032 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-b991b92e-4686-456e-b67e-8104a4c6120f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Getting quotas for user 30c0ff27c5a84ebd8615fb4608fc3882 and project 731637c0b96a4f1f8d9edb1af69e98cb. Resources: {'key_pairs'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:14:28.935698 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b991b92e-4686-456e-b67e-8104a4c6120f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.518020 Aug 04 05:14:28.937513 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1142/2286] 10.222.0.47 () {60 vars in 1159 bytes} [Thu Aug 4 05:14:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:14:37.382951 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:37.383688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:37.525683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b3577047-c04f-4d48-8113-9717d9b474c5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Action: 'create', calling method: .version_select at 0x7fc941fef8b0>, body: {"keypair": {"name": "tempest-keypair-1444407129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvyRZjXatKs+bP00vmNpTrjMGgOZ2mobE0NNFysquACw5gAL65R+TQKvGygoFq7AkaMhPUFdKZ+16kS9LJPHksv+sHINxB+UdbKHGG8LZNZQzBsl9is0mPGb7U50bbVng=="}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:37.564890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-b3577047-c04f-4d48-8113-9717d9b474c5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Getting quotas for project c27540203cac4353859078edecd89b4d. Resources: {'key_pairs'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:14:37.572794 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-b3577047-c04f-4d48-8113-9717d9b474c5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Getting quotas for user 28bf7f4d000248c9b40c1b4e596b5d3a and project c27540203cac4353859078edecd89b4d. Resources: {'key_pairs'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:14:37.603045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b3577047-c04f-4d48-8113-9717d9b474c5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.225917 Aug 04 05:14:37.603765 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1145/2287] 10.222.0.47 () {62 vars in 1200 bytes} [Thu Aug 4 05:14:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 227 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 05:14:39.401215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:39.402624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=4 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:39.403552 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:39.410885 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1114995657", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff238d07-f6c9-4435-8f56-c4790b739f8b"}], "security_groups": [{"name": "tempest-securitygroup--1489063226"}], "key_name": "tempest-keypair-1444407129", "user_data": "}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:39.545111 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] validate_networks() for [('ff238d07-f6c9-4435-8f56-c4790b739f8b', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:14:40.216827 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:14:40.217457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:14:40.218018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:14:40.218444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:14:40.218865 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:14:40.232917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:40.234014 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:40.237931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:40.238515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:40.259954 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Getting quotas for project c27540203cac4353859078edecd89b4d. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:14:40.264103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Getting quotas for user 28bf7f4d000248c9b40c1b4e596b5d3a and project c27540203cac4353859078edecd89b4d. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:14:40.276457 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:14:40.284015 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:14:40.347382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1f155ed7-91b9-4a20-88c4-188413d9754c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.947397 Aug 04 05:14:40.357814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1143/2288] 10.222.0.47 () {62 vars in 1188 bytes} [Thu Aug 4 05:14:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 04 05:14:40.359961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0f80c392-6f49-4dfe-80e0-085284a505d9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:40.360639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0f80c392-6f49-4dfe-80e0-085284a505d9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:40.456030 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0f80c392-6f49-4dfe-80e0-085284a505d9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:40.466612 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0f80c392-6f49-4dfe-80e0-085284a505d9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:40.469090 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0f80c392-6f49-4dfe-80e0-085284a505d9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:40.474566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0f80c392-6f49-4dfe-80e0-085284a505d9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1282 microversion: 2.20 time: 0.118971 Aug 04 05:14:40.477713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1146/2289] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:14:40 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1282 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:14:41.504646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8dd7d8c1-514a-4f78-a25a-88bcdb42c16d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:41.508598 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8dd7d8c1-514a-4f78-a25a-88bcdb42c16d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:41.527772 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8dd7d8c1-514a-4f78-a25a-88bcdb42c16d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:41.528440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8dd7d8c1-514a-4f78-a25a-88bcdb42c16d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:41.531135 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8dd7d8c1-514a-4f78-a25a-88bcdb42c16d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:41.531741 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8dd7d8c1-514a-4f78-a25a-88bcdb42c16d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:41.621169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8dd7d8c1-514a-4f78-a25a-88bcdb42c16d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:41.642284 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8dd7d8c1-514a-4f78-a25a-88bcdb42c16d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:41.644017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8dd7d8c1-514a-4f78-a25a-88bcdb42c16d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:41.645421 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8dd7d8c1-514a-4f78-a25a-88bcdb42c16d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1278 microversion: 2.20 time: 0.148858 Aug 04 05:14:41.662515 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1144/2290] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:14:41 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:14:42.672484 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-faca572d-597d-41a6-9ef2-e3b95bc20f9a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:42.673281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-faca572d-597d-41a6-9ef2-e3b95bc20f9a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:42.687038 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-faca572d-597d-41a6-9ef2-e3b95bc20f9a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:42.689467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-faca572d-597d-41a6-9ef2-e3b95bc20f9a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:42.704250 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-faca572d-597d-41a6-9ef2-e3b95bc20f9a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:42.704951 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-faca572d-597d-41a6-9ef2-e3b95bc20f9a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:42.795817 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-faca572d-597d-41a6-9ef2-e3b95bc20f9a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:42.806954 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-faca572d-597d-41a6-9ef2-e3b95bc20f9a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:42.808467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-faca572d-597d-41a6-9ef2-e3b95bc20f9a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:42.809600 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-faca572d-597d-41a6-9ef2-e3b95bc20f9a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1340 microversion: 2.20 time: 0.143859 Aug 04 05:14:42.827054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1147/2291] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:14:42 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1340 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:14:43.836708 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7b9c5b2c-7acc-44d7-8667-1e8c2f3476e4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:43.838209 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7b9c5b2c-7acc-44d7-8667-1e8c2f3476e4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:43.850841 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b9c5b2c-7acc-44d7-8667-1e8c2f3476e4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:43.853337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b9c5b2c-7acc-44d7-8667-1e8c2f3476e4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:43.854284 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b9c5b2c-7acc-44d7-8667-1e8c2f3476e4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:43.856511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b9c5b2c-7acc-44d7-8667-1e8c2f3476e4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:43.984838 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-8f7358b3-3e9a-4d2c-bfa8-ace81e6c9bde req-af87ddf1-1950-4c94-8862-91edab2947f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226cfa69-f0ad-40f0-bbf2-65a99c5f9824", "tag": "3c938bb8-c645-4f88-8ca8-d8188999f813"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:44.008956 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-8f7358b3-3e9a-4d2c-bfa8-ace81e6c9bde req-af87ddf1-1950-4c94-8862-91edab2947f3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:44.010601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-8f7358b3-3e9a-4d2c-bfa8-ace81e6c9bde req-af87ddf1-1950-4c94-8862-91edab2947f3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:44.025767 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-8f7358b3-3e9a-4d2c-bfa8-ace81e6c9bde req-af87ddf1-1950-4c94-8862-91edab2947f3 service nova] Creating event network-changed:3c938bb8-c645-4f88-8ca8-d8188999f813 for instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 on hv-cinder-85127 Aug 04 05:14:44.032653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-8f7358b3-3e9a-4d2c-bfa8-ace81e6c9bde req-af87ddf1-1950-4c94-8862-91edab2947f3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059161 Aug 04 05:14:44.033671 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1148/2292] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:14:44.071748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7b9c5b2c-7acc-44d7-8667-1e8c2f3476e4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:44.087996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7b9c5b2c-7acc-44d7-8667-1e8c2f3476e4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:44.090785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7b9c5b2c-7acc-44d7-8667-1e8c2f3476e4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:44.092364 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7b9c5b2c-7acc-44d7-8667-1e8c2f3476e4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1408 microversion: 2.20 time: 0.260949 Aug 04 05:14:44.101905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1145/2293] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:14:43 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:14:45.116633 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4475dc53-ad2a-46ce-b093-acc3babda329 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:45.117912 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4475dc53-ad2a-46ce-b093-acc3babda329 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:45.126032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4475dc53-ad2a-46ce-b093-acc3babda329 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:45.126483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4475dc53-ad2a-46ce-b093-acc3babda329 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:45.127467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4475dc53-ad2a-46ce-b093-acc3babda329 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:45.128553 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4475dc53-ad2a-46ce-b093-acc3babda329 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:45.275223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4475dc53-ad2a-46ce-b093-acc3babda329 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:45.283361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4475dc53-ad2a-46ce-b093-acc3babda329 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:45.285037 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4475dc53-ad2a-46ce-b093-acc3babda329 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:45.286394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4475dc53-ad2a-46ce-b093-acc3babda329 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1408 microversion: 2.20 time: 0.173957 Aug 04 05:14:45.287407 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1149/2294] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:14:45 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:14:46.314307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-496c2eeb-735d-4259-88e3-358876ff0177 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:46.314902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-496c2eeb-735d-4259-88e3-358876ff0177 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:46.322012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-496c2eeb-735d-4259-88e3-358876ff0177 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:46.322459 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-496c2eeb-735d-4259-88e3-358876ff0177 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:46.323211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-496c2eeb-735d-4259-88e3-358876ff0177 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:46.323644 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-496c2eeb-735d-4259-88e3-358876ff0177 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:46.471026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-496c2eeb-735d-4259-88e3-358876ff0177 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:46.479022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-496c2eeb-735d-4259-88e3-358876ff0177 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:46.480611 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-496c2eeb-735d-4259-88e3-358876ff0177 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:46.481824 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-496c2eeb-735d-4259-88e3-358876ff0177 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1408 microversion: 2.20 time: 0.171639 Aug 04 05:14:46.482455 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1146/2295] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:14:46 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:14:47.504914 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-198998c7-d9a5-450d-bce4-23268eb37786 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:47.505465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-198998c7-d9a5-450d-bce4-23268eb37786 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:47.517839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-198998c7-d9a5-450d-bce4-23268eb37786 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:47.518327 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-198998c7-d9a5-450d-bce4-23268eb37786 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:47.519105 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-198998c7-d9a5-450d-bce4-23268eb37786 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:47.519543 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-198998c7-d9a5-450d-bce4-23268eb37786 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:47.671132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-198998c7-d9a5-450d-bce4-23268eb37786 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:47.682943 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-198998c7-d9a5-450d-bce4-23268eb37786 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:47.684510 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-198998c7-d9a5-450d-bce4-23268eb37786 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:47.686029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-198998c7-d9a5-450d-bce4-23268eb37786 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1408 microversion: 2.20 time: 0.185109 Aug 04 05:14:47.686834 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1150/2296] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:14:47 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:14:48.716740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2daadd7d-5836-4b28-ad33-f51ed9413aa6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:48.717861 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2daadd7d-5836-4b28-ad33-f51ed9413aa6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:48.724601 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2daadd7d-5836-4b28-ad33-f51ed9413aa6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:48.725064 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2daadd7d-5836-4b28-ad33-f51ed9413aa6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:48.726791 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2daadd7d-5836-4b28-ad33-f51ed9413aa6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:48.727749 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2daadd7d-5836-4b28-ad33-f51ed9413aa6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:48.893915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2daadd7d-5836-4b28-ad33-f51ed9413aa6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:48.903956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2daadd7d-5836-4b28-ad33-f51ed9413aa6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:48.905805 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2daadd7d-5836-4b28-ad33-f51ed9413aa6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:48.907146 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2daadd7d-5836-4b28-ad33-f51ed9413aa6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1408 microversion: 2.20 time: 0.194427 Aug 04 05:14:48.907699 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1147/2297] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:14:48 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:14:48.998615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1924868362", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1187330075", "security_groups": [{"name": "tempest-secgroup-smoke-1777883312"}], "block_device_mapping_v2": [{"uuid": "9ea3a266-5226-48a1-8d9e-cbe901b3578a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "863cf01d-dc84-403c-86c5-61b4b6d33a3b"}]}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:49.145507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.network.neutron [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] validate_networks() for [('863cf01d-dc84-403c-86c5-61b4b6d33a3b', None, None, None, None, None)] {{(pid=134884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:14:49.519020 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-f27320cc-45a6-40bd-81d0-10ee3d5fc318 req-4901dba1-cca0-4943-87d4-78a55ce9e943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226cfa69-f0ad-40f0-bbf2-65a99c5f9824", "name": "network-vif-plugged", "status": "completed", "tag": "3c938bb8-c645-4f88-8ca8-d8188999f813"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:49.533987 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-f27320cc-45a6-40bd-81d0-10ee3d5fc318 req-4901dba1-cca0-4943-87d4-78a55ce9e943 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:49.535188 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-f27320cc-45a6-40bd-81d0-10ee3d5fc318 req-4901dba1-cca0-4943-87d4-78a55ce9e943 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:49.549319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-f27320cc-45a6-40bd-81d0-10ee3d5fc318 req-4901dba1-cca0-4943-87d4-78a55ce9e943 service nova] Creating event network-vif-plugged:3c938bb8-c645-4f88-8ca8-d8188999f813 for instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 on hv-cinder-85127 Aug 04 05:14:49.555896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-f27320cc-45a6-40bd-81d0-10ee3d5fc318 req-4901dba1-cca0-4943-87d4-78a55ce9e943 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.305905 Aug 04 05:14:49.556637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1148/2298] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:14:49.831192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Flavor limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:14:49.831734 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Image limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:14:49.832296 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Flavor pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:14:49.832743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Image pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:14:49.833359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:14:49.844690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:49.845274 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:49.846185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:49.846736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:49.865843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Getting quotas for project 731637c0b96a4f1f8d9edb1af69e98cb. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:14:49.871923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Getting quotas for user 30c0ff27c5a84ebd8615fb4608fc3882 and project 731637c0b96a4f1f8d9edb1af69e98cb. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:14:49.933857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-75f8db87-a735-43ce-bbda-8c43c525cd83 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:49.934637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-75f8db87-a735-43ce-bbda-8c43c525cd83 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:49.946332 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-75f8db87-a735-43ce-bbda-8c43c525cd83 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:49.947142 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-75f8db87-a735-43ce-bbda-8c43c525cd83 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:49.948076 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-75f8db87-a735-43ce-bbda-8c43c525cd83 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:49.948445 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-75f8db87-a735-43ce-bbda-8c43c525cd83 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:49.967662 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Going to run 1 instances... {{(pid=134884) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:14:49.969909 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ea3a266-5226-48a1-8d9e-cbe901b3578a',volume_size=None,volume_type=None)] {{(pid=134884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:14:50.175453 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-75f8db87-a735-43ce-bbda-8c43c525cd83 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:50.189088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-75f8db87-a735-43ce-bbda-8c43c525cd83 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:50.190728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-75f8db87-a735-43ce-bbda-8c43c525cd83 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:50.191838 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-75f8db87-a735-43ce-bbda-8c43c525cd83 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1408 microversion: 2.20 time: 0.262812 Aug 04 05:14:50.192402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1149/2299] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:14:49 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1408 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:14:50.199490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-472cc158-8446-46d4-970f-bbe1f43f2dbe tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.204631 Aug 04 05:14:50.200630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1151/2300] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 05:14:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:14:50.216286 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ac1951c8-d815-4e3d-967b-4aa2c5163efa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:50.217769 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ac1951c8-d815-4e3d-967b-4aa2c5163efa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:50.255169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:50.271171 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=6 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:50.293121 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ac1951c8-d815-4e3d-967b-4aa2c5163efa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:50.305278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ac1951c8-d815-4e3d-967b-4aa2c5163efa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1095 microversion: 2.1 time: 0.095715 Aug 04 05:14:50.307315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1150/2301] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:50 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1095 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:51.243214 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1aa5bfca-e246-406e-9c1c-4296bad041dc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:51.244037 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1aa5bfca-e246-406e-9c1c-4296bad041dc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:51.252445 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1aa5bfca-e246-406e-9c1c-4296bad041dc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:51.253264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1aa5bfca-e246-406e-9c1c-4296bad041dc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:51.258632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1aa5bfca-e246-406e-9c1c-4296bad041dc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:51.259084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1aa5bfca-e246-406e-9c1c-4296bad041dc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:51.329972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-84345904-ad4a-48d1-b8ed-dd6e8284eba2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:51.332224 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-84345904-ad4a-48d1-b8ed-dd6e8284eba2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:51.339727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-84345904-ad4a-48d1-b8ed-dd6e8284eba2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:51.341331 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-84345904-ad4a-48d1-b8ed-dd6e8284eba2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:51.342310 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-84345904-ad4a-48d1-b8ed-dd6e8284eba2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:51.344572 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-84345904-ad4a-48d1-b8ed-dd6e8284eba2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:51.447351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-84345904-ad4a-48d1-b8ed-dd6e8284eba2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:51.465979 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-84345904-ad4a-48d1-b8ed-dd6e8284eba2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1193 microversion: 2.1 time: 0.141524 Aug 04 05:14:51.482510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1151/2302] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:51 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1193 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:14:51.514305 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1aa5bfca-e246-406e-9c1c-4296bad041dc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:51.518107 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1aa5bfca-e246-406e-9c1c-4296bad041dc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:51.521193 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1aa5bfca-e246-406e-9c1c-4296bad041dc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:51.524016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1aa5bfca-e246-406e-9c1c-4296bad041dc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1601 microversion: 2.20 time: 0.285726 Aug 04 05:14:51.525582 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1152/2303] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:14:51 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1601 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:14:51.557121 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7b42dfb8-068b-4542-a21d-8bc6143e31cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:51.557627 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7b42dfb8-068b-4542-a21d-8bc6143e31cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:51.563756 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b42dfb8-068b-4542-a21d-8bc6143e31cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:51.564199 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b42dfb8-068b-4542-a21d-8bc6143e31cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:51.565260 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b42dfb8-068b-4542-a21d-8bc6143e31cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:51.565976 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7b42dfb8-068b-4542-a21d-8bc6143e31cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:51.695979 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7b42dfb8-068b-4542-a21d-8bc6143e31cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.144480 Aug 04 05:14:51.696571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1152/2304] 10.222.0.47 () {60 vars in 1316 bytes} [Thu Aug 4 05:14:51 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:14:52.488527 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2a31c359-4a2b-41e5-a4c4-5413214b8eee tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:52.489350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2a31c359-4a2b-41e5-a4c4-5413214b8eee tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:52.497582 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2a31c359-4a2b-41e5-a4c4-5413214b8eee tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:52.497582 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2a31c359-4a2b-41e5-a4c4-5413214b8eee tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:52.498162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2a31c359-4a2b-41e5-a4c4-5413214b8eee tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:52.498796 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2a31c359-4a2b-41e5-a4c4-5413214b8eee tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:52.805660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2a31c359-4a2b-41e5-a4c4-5413214b8eee tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:52.818515 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2a31c359-4a2b-41e5-a4c4-5413214b8eee tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.333904 Aug 04 05:14:52.823208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1153/2305] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:52 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:53.505808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-45a4d56b-2122-4fd2-9deb-c6bbc779f0b3 req-7804fecd-6305-4cb1-8243-19831894e157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226cfa69-f0ad-40f0-bbf2-65a99c5f9824", "tag": "3c938bb8-c645-4f88-8ca8-d8188999f813"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:53.518543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-45a4d56b-2122-4fd2-9deb-c6bbc779f0b3 req-7804fecd-6305-4cb1-8243-19831894e157 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:53.519306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-45a4d56b-2122-4fd2-9deb-c6bbc779f0b3 req-7804fecd-6305-4cb1-8243-19831894e157 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:53.534293 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-45a4d56b-2122-4fd2-9deb-c6bbc779f0b3 req-7804fecd-6305-4cb1-8243-19831894e157 service nova] Creating event network-changed:3c938bb8-c645-4f88-8ca8-d8188999f813 for instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 on hv-cinder-85127 Aug 04 05:14:53.540603 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-45a4d56b-2122-4fd2-9deb-c6bbc779f0b3 req-7804fecd-6305-4cb1-8243-19831894e157 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152734 Aug 04 05:14:53.542111 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1153/2306] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:14:53.584102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-0a12a2fe-e772-40ab-9068-eb7d7cd23ac9 req-96e29a38-5883-4366-96bb-f14c9784d8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd146ac-9a7e-4703-bb98-74e43843451e", "tag": "95a9dccb-4598-4eb7-84c0-b38f2e41c65c"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:14:53.602934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-0a12a2fe-e772-40ab-9068-eb7d7cd23ac9 req-96e29a38-5883-4366-96bb-f14c9784d8b0 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:53.603649 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-0a12a2fe-e772-40ab-9068-eb7d7cd23ac9 req-96e29a38-5883-4366-96bb-f14c9784d8b0 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:53.628364 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-0a12a2fe-e772-40ab-9068-eb7d7cd23ac9 req-96e29a38-5883-4366-96bb-f14c9784d8b0 service nova] Creating event network-changed:95a9dccb-4598-4eb7-84c0-b38f2e41c65c for instance 8bd146ac-9a7e-4703-bb98-74e43843451e on hv-cinder-85127 Aug 04 05:14:53.635690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-0a12a2fe-e772-40ab-9068-eb7d7cd23ac9 req-96e29a38-5883-4366-96bb-f14c9784d8b0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057757 Aug 04 05:14:53.639915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1154/2307] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:14:53.845208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f8505338-1e00-4b15-bc88-41b8d5904ca0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:53.845942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f8505338-1e00-4b15-bc88-41b8d5904ca0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:53.854471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8505338-1e00-4b15-bc88-41b8d5904ca0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:53.855559 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8505338-1e00-4b15-bc88-41b8d5904ca0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:53.867348 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8505338-1e00-4b15-bc88-41b8d5904ca0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:53.868200 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f8505338-1e00-4b15-bc88-41b8d5904ca0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:54.143381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f8505338-1e00-4b15-bc88-41b8d5904ca0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:54.157060 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f8505338-1e00-4b15-bc88-41b8d5904ca0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.316244 Aug 04 05:14:54.173318 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1154/2308] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:53 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:55.183257 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5f9e41cc-3331-492b-9b45-30bfb71ac797 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:55.184016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5f9e41cc-3331-492b-9b45-30bfb71ac797 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:55.190890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f9e41cc-3331-492b-9b45-30bfb71ac797 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:55.191340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f9e41cc-3331-492b-9b45-30bfb71ac797 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:55.192099 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f9e41cc-3331-492b-9b45-30bfb71ac797 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:55.192872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5f9e41cc-3331-492b-9b45-30bfb71ac797 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:55.352839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5f9e41cc-3331-492b-9b45-30bfb71ac797 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:55.360995 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5f9e41cc-3331-492b-9b45-30bfb71ac797 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.183719 Aug 04 05:14:55.361583 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1155/2309] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:55 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:56.382705 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8e0eadd7-90d6-4efc-8caa-ee0bcd9d9e9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:56.383382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8e0eadd7-90d6-4efc-8caa-ee0bcd9d9e9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:56.391206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8e0eadd7-90d6-4efc-8caa-ee0bcd9d9e9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:56.391679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8e0eadd7-90d6-4efc-8caa-ee0bcd9d9e9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:56.397656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8e0eadd7-90d6-4efc-8caa-ee0bcd9d9e9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:56.397656 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8e0eadd7-90d6-4efc-8caa-ee0bcd9d9e9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:56.530521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8e0eadd7-90d6-4efc-8caa-ee0bcd9d9e9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:56.538717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8e0eadd7-90d6-4efc-8caa-ee0bcd9d9e9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.159093 Aug 04 05:14:56.539378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1155/2310] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:56 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:57.559322 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e9e4c117-8066-496f-9da5-7c7d332f56dd tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:57.559933 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e9e4c117-8066-496f-9da5-7c7d332f56dd tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:57.566395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e9e4c117-8066-496f-9da5-7c7d332f56dd tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:57.566840 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e9e4c117-8066-496f-9da5-7c7d332f56dd tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:57.567598 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e9e4c117-8066-496f-9da5-7c7d332f56dd tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:57.568031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e9e4c117-8066-496f-9da5-7c7d332f56dd tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:57.699507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e9e4c117-8066-496f-9da5-7c7d332f56dd tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:57.706910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e9e4c117-8066-496f-9da5-7c7d332f56dd tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.151442 Aug 04 05:14:57.707460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1156/2311] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:57 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:58.728008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-27171902-5460-442a-8fdc-efa24b2ef2e5 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:58.728604 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-27171902-5460-442a-8fdc-efa24b2ef2e5 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:58.735302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27171902-5460-442a-8fdc-efa24b2ef2e5 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:58.735757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27171902-5460-442a-8fdc-efa24b2ef2e5 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:58.736520 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27171902-5460-442a-8fdc-efa24b2ef2e5 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:58.736954 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-27171902-5460-442a-8fdc-efa24b2ef2e5 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:58.873215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-27171902-5460-442a-8fdc-efa24b2ef2e5 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:14:58.880945 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-27171902-5460-442a-8fdc-efa24b2ef2e5 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.156895 Aug 04 05:14:58.882150 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1156/2312] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:58 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:14:59.902820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e88f1b2c-f6d1-490e-b18b-041aa088bb8e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:14:59.903393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e88f1b2c-f6d1-490e-b18b-041aa088bb8e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:14:59.905799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:59.906490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=12 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:14:59.918152 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e88f1b2c-f6d1-490e-b18b-041aa088bb8e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:59.918603 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e88f1b2c-f6d1-490e-b18b-041aa088bb8e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:14:59.919382 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e88f1b2c-f6d1-490e-b18b-041aa088bb8e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:14:59.919810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e88f1b2c-f6d1-490e-b18b-041aa088bb8e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:00.053761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e88f1b2c-f6d1-490e-b18b-041aa088bb8e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:00.061637 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e88f1b2c-f6d1-490e-b18b-041aa088bb8e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.162719 Aug 04 05:15:00.062214 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1157/2313] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:14:59 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:01.082279 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5ed2b5e5-6b49-46f1-822b-c5965ca14861 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:01.082896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5ed2b5e5-6b49-46f1-822b-c5965ca14861 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:01.085957 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:01.091365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ed2b5e5-6b49-46f1-822b-c5965ca14861 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:01.091821 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ed2b5e5-6b49-46f1-822b-c5965ca14861 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:01.092588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ed2b5e5-6b49-46f1-822b-c5965ca14861 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:01.093084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ed2b5e5-6b49-46f1-822b-c5965ca14861 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:01.259452 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5ed2b5e5-6b49-46f1-822b-c5965ca14861 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:01.270117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5ed2b5e5-6b49-46f1-822b-c5965ca14861 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.191601 Aug 04 05:15:01.270737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1157/2314] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:01 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:02.291758 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e50c783e-7340-47f7-ab0b-47cb2dee4cf0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:02.292376 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e50c783e-7340-47f7-ab0b-47cb2dee4cf0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:02.298962 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e50c783e-7340-47f7-ab0b-47cb2dee4cf0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:02.299412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e50c783e-7340-47f7-ab0b-47cb2dee4cf0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:02.300170 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e50c783e-7340-47f7-ab0b-47cb2dee4cf0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:02.300649 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e50c783e-7340-47f7-ab0b-47cb2dee4cf0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:02.444726 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e50c783e-7340-47f7-ab0b-47cb2dee4cf0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:02.454807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e50c783e-7340-47f7-ab0b-47cb2dee4cf0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.166238 Aug 04 05:15:02.454807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1158/2315] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:02 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:03.474545 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1b0317db-f90b-4c86-b9ef-cce360d0954e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:03.475737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1b0317db-f90b-4c86-b9ef-cce360d0954e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:03.482491 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1b0317db-f90b-4c86-b9ef-cce360d0954e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:03.482939 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1b0317db-f90b-4c86-b9ef-cce360d0954e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:03.483690 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1b0317db-f90b-4c86-b9ef-cce360d0954e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:03.484122 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1b0317db-f90b-4c86-b9ef-cce360d0954e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:03.620709 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1b0317db-f90b-4c86-b9ef-cce360d0954e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:03.628268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1b0317db-f90b-4c86-b9ef-cce360d0954e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.157588 Aug 04 05:15:03.628829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1158/2316] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:03 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:15:04.649392 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6e69d058-be7b-42eb-84fa-98de95a99a4d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:04.650040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6e69d058-be7b-42eb-84fa-98de95a99a4d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:04.656688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e69d058-be7b-42eb-84fa-98de95a99a4d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:04.657138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e69d058-be7b-42eb-84fa-98de95a99a4d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:04.657959 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e69d058-be7b-42eb-84fa-98de95a99a4d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:04.658424 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6e69d058-be7b-42eb-84fa-98de95a99a4d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:04.787867 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6e69d058-be7b-42eb-84fa-98de95a99a4d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:04.795288 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6e69d058-be7b-42eb-84fa-98de95a99a4d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.150338 Aug 04 05:15:04.795843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1159/2317] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:04 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:05.816357 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3cc8590e-b624-431b-aefa-7d36785984fa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:05.816981 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3cc8590e-b624-431b-aefa-7d36785984fa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:05.824685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3cc8590e-b624-431b-aefa-7d36785984fa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:05.825136 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3cc8590e-b624-431b-aefa-7d36785984fa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:05.825924 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3cc8590e-b624-431b-aefa-7d36785984fa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:05.826361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3cc8590e-b624-431b-aefa-7d36785984fa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:05.968280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3cc8590e-b624-431b-aefa-7d36785984fa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:05.976657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3cc8590e-b624-431b-aefa-7d36785984fa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.164099 Aug 04 05:15:05.977230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1159/2318] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:05 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:06.998449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3ebce226-3fe8-424b-9ff4-4498caf9c15f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:06.999027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3ebce226-3fe8-424b-9ff4-4498caf9c15f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:07.005392 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ebce226-3fe8-424b-9ff4-4498caf9c15f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:07.005918 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ebce226-3fe8-424b-9ff4-4498caf9c15f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:07.006681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ebce226-3fe8-424b-9ff4-4498caf9c15f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:07.007104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3ebce226-3fe8-424b-9ff4-4498caf9c15f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:07.149688 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3ebce226-3fe8-424b-9ff4-4498caf9c15f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:07.157345 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3ebce226-3fe8-424b-9ff4-4498caf9c15f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.162899 Aug 04 05:15:07.157944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1160/2319] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:06 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:08.179864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6fa6c0a4-b47b-40e7-96ca-b92d429c039b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:08.180597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6fa6c0a4-b47b-40e7-96ca-b92d429c039b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:08.187944 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6fa6c0a4-b47b-40e7-96ca-b92d429c039b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:08.188396 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6fa6c0a4-b47b-40e7-96ca-b92d429c039b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:08.189156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6fa6c0a4-b47b-40e7-96ca-b92d429c039b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:08.189606 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6fa6c0a4-b47b-40e7-96ca-b92d429c039b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:08.343084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6fa6c0a4-b47b-40e7-96ca-b92d429c039b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:08.351201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6fa6c0a4-b47b-40e7-96ca-b92d429c039b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.176428 Aug 04 05:15:08.351776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1160/2320] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:08 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:09.372706 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5a11e56e-f93c-4ffb-b64a-9f5f8de2d21e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:09.373246 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5a11e56e-f93c-4ffb-b64a-9f5f8de2d21e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:09.375539 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:09.382240 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a11e56e-f93c-4ffb-b64a-9f5f8de2d21e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:09.388398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a11e56e-f93c-4ffb-b64a-9f5f8de2d21e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:09.388398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a11e56e-f93c-4ffb-b64a-9f5f8de2d21e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:09.388398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a11e56e-f93c-4ffb-b64a-9f5f8de2d21e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:09.388398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=73 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:09.531882 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5a11e56e-f93c-4ffb-b64a-9f5f8de2d21e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:09.542187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5a11e56e-f93c-4ffb-b64a-9f5f8de2d21e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.173100 Aug 04 05:15:09.542660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1161/2321] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:09 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:09.736600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-8e214325-36dc-42f5-ae0b-8e11e1928206 req-fb5c1c6f-e4b7-4433-afeb-29eb813d4924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd146ac-9a7e-4703-bb98-74e43843451e", "name": "network-vif-plugged", "status": "completed", "tag": "95a9dccb-4598-4eb7-84c0-b38f2e41c65c"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:09.744805 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:09.755363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-8e214325-36dc-42f5-ae0b-8e11e1928206 req-fb5c1c6f-e4b7-4433-afeb-29eb813d4924 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:09.756550 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-8e214325-36dc-42f5-ae0b-8e11e1928206 req-fb5c1c6f-e4b7-4433-afeb-29eb813d4924 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:09.761005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=89 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:09.773440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-8e214325-36dc-42f5-ae0b-8e11e1928206 req-fb5c1c6f-e4b7-4433-afeb-29eb813d4924 service nova] Creating event network-vif-plugged:95a9dccb-4598-4eb7-84c0-b38f2e41c65c for instance 8bd146ac-9a7e-4703-bb98-74e43843451e on hv-cinder-85127 Aug 04 05:15:09.779916 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-8e214325-36dc-42f5-ae0b-8e11e1928206 req-fb5c1c6f-e4b7-4433-afeb-29eb813d4924 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048007 Aug 04 05:15:09.780552 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1161/2322] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:15:10.580669 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-11753337-0376-4678-ae2d-3402ca2b2d8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:10.581707 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-11753337-0376-4678-ae2d-3402ca2b2d8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:10.588987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-11753337-0376-4678-ae2d-3402ca2b2d8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:10.590315 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-11753337-0376-4678-ae2d-3402ca2b2d8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:10.591117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-11753337-0376-4678-ae2d-3402ca2b2d8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:10.591585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-11753337-0376-4678-ae2d-3402ca2b2d8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:10.752176 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-11753337-0376-4678-ae2d-3402ca2b2d8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:10.760575 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-11753337-0376-4678-ae2d-3402ca2b2d8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.188097 Aug 04 05:15:10.761075 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1162/2323] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:10 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:11.783946 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bc96e11f-be35-46b5-bd84-3684e864285a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:11.784685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-bc96e11f-be35-46b5-bd84-3684e864285a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:11.792137 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bc96e11f-be35-46b5-bd84-3684e864285a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:11.792583 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bc96e11f-be35-46b5-bd84-3684e864285a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:11.793355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bc96e11f-be35-46b5-bd84-3684e864285a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:11.793820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bc96e11f-be35-46b5-bd84-3684e864285a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:11.939393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-bc96e11f-be35-46b5-bd84-3684e864285a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:11.947140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-bc96e11f-be35-46b5-bd84-3684e864285a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.167506 Aug 04 05:15:11.947731 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1162/2324] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:11 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:12.968223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c7a7a11f-572f-4231-8998-e0fecf677f7e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:12.968787 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c7a7a11f-572f-4231-8998-e0fecf677f7e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:12.975660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c7a7a11f-572f-4231-8998-e0fecf677f7e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:12.976118 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c7a7a11f-572f-4231-8998-e0fecf677f7e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:12.976894 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c7a7a11f-572f-4231-8998-e0fecf677f7e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:12.977334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c7a7a11f-572f-4231-8998-e0fecf677f7e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:13.116400 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c7a7a11f-572f-4231-8998-e0fecf677f7e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:13.123821 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c7a7a11f-572f-4231-8998-e0fecf677f7e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1267 microversion: 2.1 time: 0.159537 Aug 04 05:15:13.124385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1163/2325] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:12 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:14.144818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6f537af4-c67b-470b-a618-fca6a2115da3 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:14.145414 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6f537af4-c67b-470b-a618-fca6a2115da3 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:14.153005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f537af4-c67b-470b-a618-fca6a2115da3 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:14.153476 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f537af4-c67b-470b-a618-fca6a2115da3 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:14.154247 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f537af4-c67b-470b-a618-fca6a2115da3 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:14.154687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f537af4-c67b-470b-a618-fca6a2115da3 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:14.285298 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6f537af4-c67b-470b-a618-fca6a2115da3 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:14.293523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6f537af4-c67b-470b-a618-fca6a2115da3 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1454 microversion: 2.1 time: 0.152609 Aug 04 05:15:14.294106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1163/2326] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:14 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:14.313993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-47681087-842c-429b-9790-7c92437418d0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:14.314610 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-47681087-842c-429b-9790-7c92437418d0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:14.321379 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47681087-842c-429b-9790-7c92437418d0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:14.321865 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47681087-842c-429b-9790-7c92437418d0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:14.322635 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47681087-842c-429b-9790-7c92437418d0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:14.323078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-47681087-842c-429b-9790-7c92437418d0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:14.452530 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-47681087-842c-429b-9790-7c92437418d0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:14.460664 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-47681087-842c-429b-9790-7c92437418d0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1454 microversion: 2.1 time: 0.150408 Aug 04 05:15:14.461231 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1164/2327] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:14 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:16.351312 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-7482998b-6a9b-4d45-ac74-a89c968db7f6 req-817a0562-1ca0-4287-bac4-7d6c206493bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd146ac-9a7e-4703-bb98-74e43843451e", "tag": "95a9dccb-4598-4eb7-84c0-b38f2e41c65c"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:16.361315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-7482998b-6a9b-4d45-ac74-a89c968db7f6 req-817a0562-1ca0-4287-bac4-7d6c206493bb service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:16.361806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-7482998b-6a9b-4d45-ac74-a89c968db7f6 req-817a0562-1ca0-4287-bac4-7d6c206493bb service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:16.373125 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-7482998b-6a9b-4d45-ac74-a89c968db7f6 req-817a0562-1ca0-4287-bac4-7d6c206493bb service nova] Creating event network-changed:95a9dccb-4598-4eb7-84c0-b38f2e41c65c for instance 8bd146ac-9a7e-4703-bb98-74e43843451e on hv-cinder-85127 Aug 04 05:15:16.378273 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-7482998b-6a9b-4d45-ac74-a89c968db7f6 req-817a0562-1ca0-4287-bac4-7d6c206493bb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031028 Aug 04 05:15:16.378867 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1164/2328] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:15:29.621256 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0737e91d-0ca6-46bb-8b6c-829962f56f03 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:29.622058 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0737e91d-0ca6-46bb-8b6c-829962f56f03 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:29.627572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=7 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:29.628255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=23 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:29.634040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0737e91d-0ca6-46bb-8b6c-829962f56f03 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:29.634666 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0737e91d-0ca6-46bb-8b6c-829962f56f03 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:29.635289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0737e91d-0ca6-46bb-8b6c-829962f56f03 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:29.635748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0737e91d-0ca6-46bb-8b6c-829962f56f03 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:29.673430 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0737e91d-0ca6-46bb-8b6c-829962f56f03 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/ips" status: 200 len: 153 microversion: 2.20 time: 0.055880 Aug 04 05:15:29.674496 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1165/2329] 10.222.0.47 () {60 vars in 1289 bytes} [Thu Aug 4 05:15:29 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/ips => generated 153 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:15:33.034231 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-50debc3b-b747-459f-a406-7b9fb7e8bd66 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:33.035186 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-50debc3b-b747-459f-a406-7b9fb7e8bd66 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:33.040471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=7 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:33.049902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=15 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:33.062343 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-50debc3b-b747-459f-a406-7b9fb7e8bd66 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:33.066464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-50debc3b-b747-459f-a406-7b9fb7e8bd66 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:33.067445 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-50debc3b-b747-459f-a406-7b9fb7e8bd66 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:33.067842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-50debc3b-b747-459f-a406-7b9fb7e8bd66 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:33.110831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-50debc3b-b747-459f-a406-7b9fb7e8bd66 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lazy-loading 'flavor' on Instance uuid 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:15:33.409986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-50debc3b-b747-459f-a406-7b9fb7e8bd66 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "POST /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/action" status: 202 len: 0 microversion: 2.20 time: 0.381543 Aug 04 05:15:33.411965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1165/2330] 10.222.0.47 () {62 vars in 1319 bytes} [Thu Aug 4 05:15:33 2022] POST /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:15:33.431915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-48372e36-eda6-40a5-853c-b62903e4e2ed tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:33.436806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-48372e36-eda6-40a5-853c-b62903e4e2ed tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:33.456114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-48372e36-eda6-40a5-853c-b62903e4e2ed tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:33.456875 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-48372e36-eda6-40a5-853c-b62903e4e2ed tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:33.459601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-48372e36-eda6-40a5-853c-b62903e4e2ed tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:33.460268 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-48372e36-eda6-40a5-853c-b62903e4e2ed tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:33.999419 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-48372e36-eda6-40a5-853c-b62903e4e2ed tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:34.015960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-48372e36-eda6-40a5-853c-b62903e4e2ed tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:34.018051 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-48372e36-eda6-40a5-853c-b62903e4e2ed tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:34.019570 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-48372e36-eda6-40a5-853c-b62903e4e2ed tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1726 microversion: 2.20 time: 0.600482 Aug 04 05:15:34.020715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1166/2331] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:33 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1726 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:35.090349 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eb8a0c74-3f5d-48b9-9ddc-601e75ff071d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:35.102836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eb8a0c74-3f5d-48b9-9ddc-601e75ff071d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:35.135227 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb8a0c74-3f5d-48b9-9ddc-601e75ff071d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:35.136653 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb8a0c74-3f5d-48b9-9ddc-601e75ff071d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:35.140898 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb8a0c74-3f5d-48b9-9ddc-601e75ff071d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:35.143657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb8a0c74-3f5d-48b9-9ddc-601e75ff071d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:35.482489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-eb8a0c74-3f5d-48b9-9ddc-601e75ff071d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:35.514256 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-eb8a0c74-3f5d-48b9-9ddc-601e75ff071d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:35.521452 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-eb8a0c74-3f5d-48b9-9ddc-601e75ff071d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:35.532869 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eb8a0c74-3f5d-48b9-9ddc-601e75ff071d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1726 microversion: 2.20 time: 0.471369 Aug 04 05:15:35.534152 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1166/2332] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:35 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1726 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:36.574993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f7c05ddb-3308-4266-9365-539200b75813 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:36.575853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f7c05ddb-3308-4266-9365-539200b75813 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:36.584180 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f7c05ddb-3308-4266-9365-539200b75813 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:36.584516 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f7c05ddb-3308-4266-9365-539200b75813 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:36.585228 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f7c05ddb-3308-4266-9365-539200b75813 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:36.585714 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f7c05ddb-3308-4266-9365-539200b75813 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:36.815048 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f7c05ddb-3308-4266-9365-539200b75813 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:36.835034 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f7c05ddb-3308-4266-9365-539200b75813 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:36.837328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f7c05ddb-3308-4266-9365-539200b75813 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:36.839161 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f7c05ddb-3308-4266-9365-539200b75813 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1726 microversion: 2.20 time: 0.270166 Aug 04 05:15:36.840007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1167/2333] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:36 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1726 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:37.867799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e1f8cdfe-9e80-4f0e-9404-cdea65cd2031 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:37.869712 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e1f8cdfe-9e80-4f0e-9404-cdea65cd2031 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:37.880961 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e1f8cdfe-9e80-4f0e-9404-cdea65cd2031 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:37.881745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e1f8cdfe-9e80-4f0e-9404-cdea65cd2031 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:37.883262 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e1f8cdfe-9e80-4f0e-9404-cdea65cd2031 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:37.884072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e1f8cdfe-9e80-4f0e-9404-cdea65cd2031 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:38.073582 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e1f8cdfe-9e80-4f0e-9404-cdea65cd2031 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:38.089578 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e1f8cdfe-9e80-4f0e-9404-cdea65cd2031 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:38.091796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e1f8cdfe-9e80-4f0e-9404-cdea65cd2031 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:38.093857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e1f8cdfe-9e80-4f0e-9404-cdea65cd2031 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1726 microversion: 2.20 time: 0.231493 Aug 04 05:15:38.094616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1167/2334] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:37 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1726 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:38.305396 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-967749b1-5f58-4f84-a804-51877f60ee69 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Action: 'create', calling method: .version_select at 0x7fc941fde430>, body: {"keypair": {"name": "tempest-TestShelveInstance-327351427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQPlz57oAGYjXCPNYNbzodIVvHZifvb0AlrqRz8O6oR+lM/qM9w4xY0CXMxCfifA7qQfkViRonHiZjZlccStFs/0J0ljefwaJQQN768uMWkbiD5ZYg2hdxZFG7fKjssyQ=="}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:38.335094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-967749b1-5f58-4f84-a804-51877f60ee69 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Getting quotas for project 016110e9048a475f817a105e50f2cf6a. Resources: {'key_pairs'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:15:38.341428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-967749b1-5f58-4f84-a804-51877f60ee69 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Getting quotas for user 932dfc6718754b04bb50d9e8444b05a6 and project 016110e9048a475f817a105e50f2cf6a. Resources: {'key_pairs'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:15:38.375794 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-967749b1-5f58-4f84-a804-51877f60ee69 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.418737 Aug 04 05:15:38.376737 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1168/2335] 10.222.0.47 () {60 vars in 1159 bytes} [Thu Aug 4 05:15:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:15:39.120172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-7698fa69-098d-414f-a851-c17a4c1786f6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:39.122257 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-7698fa69-098d-414f-a851-c17a4c1786f6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:39.129808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7698fa69-098d-414f-a851-c17a4c1786f6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:39.130653 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7698fa69-098d-414f-a851-c17a4c1786f6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:39.131668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7698fa69-098d-414f-a851-c17a4c1786f6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:39.132117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-7698fa69-098d-414f-a851-c17a4c1786f6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:39.309423 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7698fa69-098d-414f-a851-c17a4c1786f6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:39.323469 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7698fa69-098d-414f-a851-c17a4c1786f6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:39.331342 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-7698fa69-098d-414f-a851-c17a4c1786f6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:39.333382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-7698fa69-098d-414f-a851-c17a4c1786f6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1726 microversion: 2.20 time: 0.217118 Aug 04 05:15:39.343736 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1168/2336] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:39 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1726 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:40.363460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9f5c380f-66f8-4a54-bc42-ab29fac7fac7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:40.364862 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9f5c380f-66f8-4a54-bc42-ab29fac7fac7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:40.374987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f5c380f-66f8-4a54-bc42-ab29fac7fac7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:40.374987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f5c380f-66f8-4a54-bc42-ab29fac7fac7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:40.375458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f5c380f-66f8-4a54-bc42-ab29fac7fac7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:40.375886 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9f5c380f-66f8-4a54-bc42-ab29fac7fac7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:40.560773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9f5c380f-66f8-4a54-bc42-ab29fac7fac7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:40.570909 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9f5c380f-66f8-4a54-bc42-ab29fac7fac7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:40.572341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9f5c380f-66f8-4a54-bc42-ab29fac7fac7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:40.573520 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9f5c380f-66f8-4a54-bc42-ab29fac7fac7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1726 microversion: 2.20 time: 0.214628 Aug 04 05:15:40.574097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1169/2337] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:40 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:41.598901 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-344f877c-c5d6-4375-b16d-c3bc3e374662 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:41.599711 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-344f877c-c5d6-4375-b16d-c3bc3e374662 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:41.606337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-344f877c-c5d6-4375-b16d-c3bc3e374662 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:41.606796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-344f877c-c5d6-4375-b16d-c3bc3e374662 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:41.607574 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-344f877c-c5d6-4375-b16d-c3bc3e374662 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:41.608012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-344f877c-c5d6-4375-b16d-c3bc3e374662 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:41.760906 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-344f877c-c5d6-4375-b16d-c3bc3e374662 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:41.769328 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-344f877c-c5d6-4375-b16d-c3bc3e374662 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:41.771006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-344f877c-c5d6-4375-b16d-c3bc3e374662 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:41.773292 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-344f877c-c5d6-4375-b16d-c3bc3e374662 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1726 microversion: 2.20 time: 0.177446 Aug 04 05:15:41.773292 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1169/2338] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:41 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:42.797006 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ac5942d3-e00b-4412-828d-d88140dadb89 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:42.798683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ac5942d3-e00b-4412-828d-d88140dadb89 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:42.819883 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac5942d3-e00b-4412-828d-d88140dadb89 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:42.820348 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac5942d3-e00b-4412-828d-d88140dadb89 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:42.821143 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac5942d3-e00b-4412-828d-d88140dadb89 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:42.821613 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ac5942d3-e00b-4412-828d-d88140dadb89 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:42.976993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ac5942d3-e00b-4412-828d-d88140dadb89 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:42.986712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ac5942d3-e00b-4412-828d-d88140dadb89 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:42.989973 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ac5942d3-e00b-4412-828d-d88140dadb89 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:42.991533 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ac5942d3-e00b-4412-828d-d88140dadb89 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1726 microversion: 2.20 time: 0.199071 Aug 04 05:15:43.005576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1170/2339] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:42 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1726 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:44.021878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6a670ff5-145c-41de-9e9b-bf2ca35d6400 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:44.022501 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6a670ff5-145c-41de-9e9b-bf2ca35d6400 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:44.029182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6a670ff5-145c-41de-9e9b-bf2ca35d6400 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:44.029680 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6a670ff5-145c-41de-9e9b-bf2ca35d6400 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:44.030454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6a670ff5-145c-41de-9e9b-bf2ca35d6400 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:44.030902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6a670ff5-145c-41de-9e9b-bf2ca35d6400 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:44.177718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6a670ff5-145c-41de-9e9b-bf2ca35d6400 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:44.186218 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6a670ff5-145c-41de-9e9b-bf2ca35d6400 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:44.187709 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6a670ff5-145c-41de-9e9b-bf2ca35d6400 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:44.188886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6a670ff5-145c-41de-9e9b-bf2ca35d6400 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1726 microversion: 2.20 time: 0.171583 Aug 04 05:15:44.189500 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1170/2340] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:44 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:45.215783 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5e76a1ac-47ca-4519-b001-04551a7c90c7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:45.216636 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5e76a1ac-47ca-4519-b001-04551a7c90c7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:45.224465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5e76a1ac-47ca-4519-b001-04551a7c90c7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:45.224692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5e76a1ac-47ca-4519-b001-04551a7c90c7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:45.225407 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5e76a1ac-47ca-4519-b001-04551a7c90c7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:45.225877 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5e76a1ac-47ca-4519-b001-04551a7c90c7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:45.369838 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5e76a1ac-47ca-4519-b001-04551a7c90c7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:45.380810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5e76a1ac-47ca-4519-b001-04551a7c90c7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:45.382346 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5e76a1ac-47ca-4519-b001-04551a7c90c7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:45.383498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5e76a1ac-47ca-4519-b001-04551a7c90c7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1747 microversion: 2.20 time: 0.172249 Aug 04 05:15:45.384053 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1171/2341] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:45 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1747 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:46.408573 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3598999a-d9e0-4d62-9d34-b49c2ca65f10 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:46.409166 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3598999a-d9e0-4d62-9d34-b49c2ca65f10 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:46.419714 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3598999a-d9e0-4d62-9d34-b49c2ca65f10 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:46.420168 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3598999a-d9e0-4d62-9d34-b49c2ca65f10 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:46.420955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3598999a-d9e0-4d62-9d34-b49c2ca65f10 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:46.421386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3598999a-d9e0-4d62-9d34-b49c2ca65f10 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:46.562257 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3598999a-d9e0-4d62-9d34-b49c2ca65f10 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:46.570708 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3598999a-d9e0-4d62-9d34-b49c2ca65f10 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:46.572224 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3598999a-d9e0-4d62-9d34-b49c2ca65f10 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:46.573365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3598999a-d9e0-4d62-9d34-b49c2ca65f10 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1747 microversion: 2.20 time: 0.168684 Aug 04 05:15:46.573953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1171/2342] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:46 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:47.596701 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-37a97ea0-5774-4a78-8901-d92b1316c8a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:47.598211 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-37a97ea0-5774-4a78-8901-d92b1316c8a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:47.615189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-37a97ea0-5774-4a78-8901-d92b1316c8a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:47.615772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-37a97ea0-5774-4a78-8901-d92b1316c8a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:47.616659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-37a97ea0-5774-4a78-8901-d92b1316c8a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:47.617805 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-37a97ea0-5774-4a78-8901-d92b1316c8a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:47.768776 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-37a97ea0-5774-4a78-8901-d92b1316c8a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:47.778333 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-37a97ea0-5774-4a78-8901-d92b1316c8a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:47.780471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-37a97ea0-5774-4a78-8901-d92b1316c8a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:47.782021 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-37a97ea0-5774-4a78-8901-d92b1316c8a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1742 microversion: 2.20 time: 0.189792 Aug 04 05:15:47.797728 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1172/2343] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:47 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1742 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:48.813244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2bd9fbb1-46da-43e2-8c97-8bf8d560f55f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:48.815311 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2bd9fbb1-46da-43e2-8c97-8bf8d560f55f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:48.825355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2bd9fbb1-46da-43e2-8c97-8bf8d560f55f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:48.826189 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2bd9fbb1-46da-43e2-8c97-8bf8d560f55f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:48.827956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2bd9fbb1-46da-43e2-8c97-8bf8d560f55f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:48.829008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2bd9fbb1-46da-43e2-8c97-8bf8d560f55f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:49.017257 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2bd9fbb1-46da-43e2-8c97-8bf8d560f55f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:49.027390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2bd9fbb1-46da-43e2-8c97-8bf8d560f55f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:49.029144 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2bd9fbb1-46da-43e2-8c97-8bf8d560f55f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:49.030500 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2bd9fbb1-46da-43e2-8c97-8bf8d560f55f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1742 microversion: 2.20 time: 0.223972 Aug 04 05:15:49.032723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1172/2344] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:48 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1742 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:15:49.987260 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-d74d1f3d-6d26-46d2-8a87-85ca03d5feb7 req-be269ef9-19a4-49f5-8210-a4146d2c3b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226cfa69-f0ad-40f0-bbf2-65a99c5f9824", "name": "network-vif-plugged", "status": "completed", "tag": "3c938bb8-c645-4f88-8ca8-d8188999f813"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:49.993425 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=4 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:49.999984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-d74d1f3d-6d26-46d2-8a87-85ca03d5feb7 req-be269ef9-19a4-49f5-8210-a4146d2c3b99 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:50.000782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-d74d1f3d-6d26-46d2-8a87-85ca03d5feb7 req-be269ef9-19a4-49f5-8210-a4146d2c3b99 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:50.014035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-d74d1f3d-6d26-46d2-8a87-85ca03d5feb7 req-be269ef9-19a4-49f5-8210-a4146d2c3b99 service nova] Creating event network-vif-plugged:3c938bb8-c645-4f88-8ca8-d8188999f813 for instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 on hv-cinder-85127 Aug 04 05:15:50.022024 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-d74d1f3d-6d26-46d2-8a87-85ca03d5feb7 req-be269ef9-19a4-49f5-8210-a4146d2c3b99 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038252 Aug 04 05:15:50.023281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1173/2345] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:15:50.057815 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6f4c49ef-6e64-4ddc-a163-1abd3e8aec27 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:50.058430 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6f4c49ef-6e64-4ddc-a163-1abd3e8aec27 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:50.077762 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f4c49ef-6e64-4ddc-a163-1abd3e8aec27 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:50.078222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f4c49ef-6e64-4ddc-a163-1abd3e8aec27 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:50.079200 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f4c49ef-6e64-4ddc-a163-1abd3e8aec27 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:50.079812 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6f4c49ef-6e64-4ddc-a163-1abd3e8aec27 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:50.233716 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6f4c49ef-6e64-4ddc-a163-1abd3e8aec27 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:50.246978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6f4c49ef-6e64-4ddc-a163-1abd3e8aec27 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:50.248706 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6f4c49ef-6e64-4ddc-a163-1abd3e8aec27 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:50.250066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6f4c49ef-6e64-4ddc-a163-1abd3e8aec27 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1742 microversion: 2.20 time: 0.197100 Aug 04 05:15:50.250626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1173/2346] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:50 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1742 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:51.281674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a76923a1-6154-47b8-bc5e-b45e724baf50 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:51.282373 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a76923a1-6154-47b8-bc5e-b45e724baf50 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:51.289910 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a76923a1-6154-47b8-bc5e-b45e724baf50 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:51.290357 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a76923a1-6154-47b8-bc5e-b45e724baf50 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:51.291292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a76923a1-6154-47b8-bc5e-b45e724baf50 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:51.291717 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a76923a1-6154-47b8-bc5e-b45e724baf50 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:51.472858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a76923a1-6154-47b8-bc5e-b45e724baf50 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:51.482138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a76923a1-6154-47b8-bc5e-b45e724baf50 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:51.483848 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a76923a1-6154-47b8-bc5e-b45e724baf50 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:51.485739 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a76923a1-6154-47b8-bc5e-b45e724baf50 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1742 microversion: 2.20 time: 0.213215 Aug 04 05:15:51.487736 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1174/2347] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:51 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1742 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:52.516688 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a18c39fd-3b30-4dbf-8ce4-8b6e3528eca4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:52.517881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a18c39fd-3b30-4dbf-8ce4-8b6e3528eca4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:52.531817 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a18c39fd-3b30-4dbf-8ce4-8b6e3528eca4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:52.532263 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a18c39fd-3b30-4dbf-8ce4-8b6e3528eca4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:52.533028 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a18c39fd-3b30-4dbf-8ce4-8b6e3528eca4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:52.533459 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a18c39fd-3b30-4dbf-8ce4-8b6e3528eca4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:52.687306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a18c39fd-3b30-4dbf-8ce4-8b6e3528eca4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:52.696089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a18c39fd-3b30-4dbf-8ce4-8b6e3528eca4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:52.701511 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a18c39fd-3b30-4dbf-8ce4-8b6e3528eca4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:52.702847 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a18c39fd-3b30-4dbf-8ce4-8b6e3528eca4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1742 microversion: 2.20 time: 0.192014 Aug 04 05:15:52.703651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1174/2348] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:52 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1742 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:53.736668 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-51f12656-8011-4179-8cff-2a94538a4c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:53.737873 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-51f12656-8011-4179-8cff-2a94538a4c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:53.745273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-51f12656-8011-4179-8cff-2a94538a4c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:53.745970 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-51f12656-8011-4179-8cff-2a94538a4c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:53.746925 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-51f12656-8011-4179-8cff-2a94538a4c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:53.747364 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-51f12656-8011-4179-8cff-2a94538a4c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:53.897512 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-51f12656-8011-4179-8cff-2a94538a4c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:53.906771 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-51f12656-8011-4179-8cff-2a94538a4c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:53.908321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-51f12656-8011-4179-8cff-2a94538a4c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:53.909515 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-51f12656-8011-4179-8cff-2a94538a4c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1742 microversion: 2.20 time: 0.178514 Aug 04 05:15:53.910442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1175/2349] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:53 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1742 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:54.935512 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-edaa6708-7ff1-432b-a062-5df2f8290dbd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:54.936208 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-edaa6708-7ff1-432b-a062-5df2f8290dbd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:54.942510 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-edaa6708-7ff1-432b-a062-5df2f8290dbd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:54.942957 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-edaa6708-7ff1-432b-a062-5df2f8290dbd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:54.943712 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-edaa6708-7ff1-432b-a062-5df2f8290dbd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:54.944191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-edaa6708-7ff1-432b-a062-5df2f8290dbd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:55.094441 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-edaa6708-7ff1-432b-a062-5df2f8290dbd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:55.104999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-edaa6708-7ff1-432b-a062-5df2f8290dbd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:55.104999 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-edaa6708-7ff1-432b-a062-5df2f8290dbd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:55.106210 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-edaa6708-7ff1-432b-a062-5df2f8290dbd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1742 microversion: 2.20 time: 0.174910 Aug 04 05:15:55.106948 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1175/2350] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:54 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1742 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:56.120262 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-22555945", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-327351427", "security_groups": [{"name": "tempest-secgroup-smoke-502001333"}], "networks": [{"uuid": "e19b9069-9732-4cbf-8d77-95648ced264d"}], "block_device_mapping_v2": [{"uuid": "54a7d00f-9e16-453c-bc20-5e739f035039", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:15:56.133587 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c3286783-5176-497f-9cf5-955d71c14732 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:56.134914 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c3286783-5176-497f-9cf5-955d71c14732 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:56.142092 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3286783-5176-497f-9cf5-955d71c14732 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:56.142879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3286783-5176-497f-9cf5-955d71c14732 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:56.147115 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3286783-5176-497f-9cf5-955d71c14732 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:56.148447 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3286783-5176-497f-9cf5-955d71c14732 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:56.342368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.network.neutron [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] validate_networks() for [('e19b9069-9732-4cbf-8d77-95648ced264d', None, None, None, None, None)] {{(pid=134884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:15:56.414000 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c3286783-5176-497f-9cf5-955d71c14732 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:56.423651 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c3286783-5176-497f-9cf5-955d71c14732 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:56.425519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c3286783-5176-497f-9cf5-955d71c14732 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:56.427039 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c3286783-5176-497f-9cf5-955d71c14732 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1742 microversion: 2.20 time: 0.298025 Aug 04 05:15:56.437951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1176/2351] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:56 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1742 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:15:56.788654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Flavor limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:15:56.789117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Image limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:15:56.789693 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Flavor pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:15:56.790027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Image pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:15:56.790435 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:15:56.799445 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:56.799830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:56.800602 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:56.801066 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:56.820692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Getting quotas for project 016110e9048a475f817a105e50f2cf6a. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:15:56.825660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Getting quotas for user 932dfc6718754b04bb50d9e8444b05a6 and project 016110e9048a475f817a105e50f2cf6a. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:15:56.888534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Going to run 1 instances... {{(pid=134884) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:15:56.890638 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='54a7d00f-9e16-453c-bc20-5e739f035039',volume_size=None,volume_type=None)] {{(pid=134884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:15:57.018835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-46d0b5db-3614-46fa-987b-de28a37cacf9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.905848 Aug 04 05:15:57.019483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1176/2352] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 05:15:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 05:15:57.030686 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-cfc36d97-0be2-4004-a2bd-434f59e02587 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:57.031299 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-cfc36d97-0be2-4004-a2bd-434f59e02587 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:57.083728 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-cfc36d97-0be2-4004-a2bd-434f59e02587 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:57.091801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-cfc36d97-0be2-4004-a2bd-434f59e02587 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1086 microversion: 2.1 time: 0.064937 Aug 04 05:15:57.092400 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1177/2353] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:57 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1086 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:57.451511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8d59d6e6-c34e-4de7-ae67-c967eccbacd2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:57.452125 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8d59d6e6-c34e-4de7-ae67-c967eccbacd2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:57.458283 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d59d6e6-c34e-4de7-ae67-c967eccbacd2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:57.458732 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d59d6e6-c34e-4de7-ae67-c967eccbacd2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:57.459489 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d59d6e6-c34e-4de7-ae67-c967eccbacd2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:57.459923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8d59d6e6-c34e-4de7-ae67-c967eccbacd2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:57.601405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8d59d6e6-c34e-4de7-ae67-c967eccbacd2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:57.610894 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8d59d6e6-c34e-4de7-ae67-c967eccbacd2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:57.613000 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8d59d6e6-c34e-4de7-ae67-c967eccbacd2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:57.614450 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8d59d6e6-c34e-4de7-ae67-c967eccbacd2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1724 microversion: 2.20 time: 0.167319 Aug 04 05:15:57.616098 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1177/2354] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:57 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:15:58.115066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2599b946-398c-4213-8d40-e62343cb378a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:58.117061 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2599b946-398c-4213-8d40-e62343cb378a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:58.125103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2599b946-398c-4213-8d40-e62343cb378a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:58.125921 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2599b946-398c-4213-8d40-e62343cb378a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:58.126903 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2599b946-398c-4213-8d40-e62343cb378a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:58.127576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2599b946-398c-4213-8d40-e62343cb378a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:58.207660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2599b946-398c-4213-8d40-e62343cb378a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:58.217462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2599b946-398c-4213-8d40-e62343cb378a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1192 microversion: 2.1 time: 0.107767 Aug 04 05:15:58.218819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1178/2355] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:58 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1192 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:58.641782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-58f31c94-be13-4d85-8360-a7d3a3aa905b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:58.642609 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-58f31c94-be13-4d85-8360-a7d3a3aa905b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:58.650517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-58f31c94-be13-4d85-8360-a7d3a3aa905b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:58.650977 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-58f31c94-be13-4d85-8360-a7d3a3aa905b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:58.651755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-58f31c94-be13-4d85-8360-a7d3a3aa905b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:58.652220 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-58f31c94-be13-4d85-8360-a7d3a3aa905b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:58.786584 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-58f31c94-be13-4d85-8360-a7d3a3aa905b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:58.795219 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-58f31c94-be13-4d85-8360-a7d3a3aa905b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:58.796745 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-58f31c94-be13-4d85-8360-a7d3a3aa905b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:58.797928 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-58f31c94-be13-4d85-8360-a7d3a3aa905b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1724 microversion: 2.20 time: 0.160054 Aug 04 05:15:58.798485 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1178/2356] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:58 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:15:59.240922 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3f4c907e-7f96-4cfc-9547-12dd307ed35e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:59.242114 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3f4c907e-7f96-4cfc-9547-12dd307ed35e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:59.248967 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3f4c907e-7f96-4cfc-9547-12dd307ed35e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:59.249422 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3f4c907e-7f96-4cfc-9547-12dd307ed35e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:59.250248 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3f4c907e-7f96-4cfc-9547-12dd307ed35e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:59.250685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3f4c907e-7f96-4cfc-9547-12dd307ed35e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:59.312333 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3f4c907e-7f96-4cfc-9547-12dd307ed35e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:15:59.319808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3f4c907e-7f96-4cfc-9547-12dd307ed35e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1202 microversion: 2.1 time: 0.082623 Aug 04 05:15:59.320693 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1179/2357] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:15:59 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1202 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:15:59.821575 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-13ac32eb-be58-4fa6-be72-f8b34ed482cf tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:15:59.822456 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-13ac32eb-be58-4fa6-be72-f8b34ed482cf tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:15:59.826350 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:15:59.830852 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-13ac32eb-be58-4fa6-be72-f8b34ed482cf tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:59.831296 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-13ac32eb-be58-4fa6-be72-f8b34ed482cf tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:59.832064 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-13ac32eb-be58-4fa6-be72-f8b34ed482cf tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:15:59.832659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-13ac32eb-be58-4fa6-be72-f8b34ed482cf tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:15:59.837045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=69 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:00.031144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-13ac32eb-be58-4fa6-be72-f8b34ed482cf tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:00.040452 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-13ac32eb-be58-4fa6-be72-f8b34ed482cf tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:00.042117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-13ac32eb-be58-4fa6-be72-f8b34ed482cf tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:00.043370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-13ac32eb-be58-4fa6-be72-f8b34ed482cf tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1724 microversion: 2.20 time: 0.226636 Aug 04 05:16:00.044102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1179/2358] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:15:59 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:00.341016 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eef66aad-1cce-465a-a6dc-a199870d9904 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:00.341657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eef66aad-1cce-465a-a6dc-a199870d9904 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:00.349483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eef66aad-1cce-465a-a6dc-a199870d9904 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:00.350632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eef66aad-1cce-465a-a6dc-a199870d9904 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:00.352544 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eef66aad-1cce-465a-a6dc-a199870d9904 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:00.353005 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eef66aad-1cce-465a-a6dc-a199870d9904 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:00.374337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:00.447031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-eef66aad-1cce-465a-a6dc-a199870d9904 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:00.455107 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eef66aad-1cce-465a-a6dc-a199870d9904 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1190 microversion: 2.1 time: 0.117707 Aug 04 05:16:00.455554 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1180/2359] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:00 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1190 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:01.066825 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6d47683b-c7ab-440f-9299-e7a3639c990c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:01.067900 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6d47683b-c7ab-440f-9299-e7a3639c990c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:01.074695 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d47683b-c7ab-440f-9299-e7a3639c990c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.075239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d47683b-c7ab-440f-9299-e7a3639c990c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:01.076015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d47683b-c7ab-440f-9299-e7a3639c990c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.076449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6d47683b-c7ab-440f-9299-e7a3639c990c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:01.324749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6d47683b-c7ab-440f-9299-e7a3639c990c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:01.332831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6d47683b-c7ab-440f-9299-e7a3639c990c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:01.334378 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6d47683b-c7ab-440f-9299-e7a3639c990c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:01.336286 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6d47683b-c7ab-440f-9299-e7a3639c990c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1667 microversion: 2.20 time: 0.272729 Aug 04 05:16:01.336939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1180/2360] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:01 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1667 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:01.358578 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-303545b6-a852-4673-ab66-23792305c045 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66cec82a-7990-44a9-a541-973723dde642"}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:01.360941 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-303545b6-a852-4673-ab66-23792305c045 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:01.367767 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-303545b6-a852-4673-ab66-23792305c045 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.368226 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-303545b6-a852-4673-ab66-23792305c045 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:01.369002 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-303545b6-a852-4673-ab66-23792305c045 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.369449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-303545b6-a852-4673-ab66-23792305c045 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:01.430372 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-2c1667df-f42a-4200-9dad-e2e968eefbde req-81ef604b-44ff-47e7-97db-3283e0edb9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd63e685-c924-4940-ba66-4128dead0a60", "tag": "753b26da-a0d7-412a-b173-7ac7d5ad56de"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:01.443798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-2c1667df-f42a-4200-9dad-e2e968eefbde req-81ef604b-44ff-47e7-97db-3283e0edb9c2 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.444299 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-2c1667df-f42a-4200-9dad-e2e968eefbde req-81ef604b-44ff-47e7-97db-3283e0edb9c2 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:01.459724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-2c1667df-f42a-4200-9dad-e2e968eefbde req-81ef604b-44ff-47e7-97db-3283e0edb9c2 service nova] Creating event network-changed:753b26da-a0d7-412a-b173-7ac7d5ad56de for instance bd63e685-c924-4940-ba66-4128dead0a60 on hv-cinder-85127 Aug 04 05:16:01.466678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-2c1667df-f42a-4200-9dad-e2e968eefbde req-81ef604b-44ff-47e7-97db-3283e0edb9c2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041496 Aug 04 05:16:01.467450 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1181/2361] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:16:01.478311 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0d9f03cf-a887-4ccb-a4e7-7819f4e3946f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:01.479345 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0d9f03cf-a887-4ccb-a4e7-7819f4e3946f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:01.486116 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d9f03cf-a887-4ccb-a4e7-7819f4e3946f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.486628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d9f03cf-a887-4ccb-a4e7-7819f4e3946f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:01.487307 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d9f03cf-a887-4ccb-a4e7-7819f4e3946f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.487735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0d9f03cf-a887-4ccb-a4e7-7819f4e3946f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:01.682523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-303545b6-a852-4673-ab66-23792305c045 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "POST /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327945 Aug 04 05:16:01.683133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1181/2362] 10.222.0.47 () {62 vars in 1364 bytes} [Thu Aug 4 05:16:01 2022] POST /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/os-volume_attachments => generated 188 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:16:01.725208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0d9f03cf-a887-4ccb-a4e7-7819f4e3946f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:01.735856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0d9f03cf-a887-4ccb-a4e7-7819f4e3946f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.262132 Aug 04 05:16:01.737656 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1182/2363] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:01 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:01.811916 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-49cfc14e-9828-480c-893e-865f14bfe261 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:01.812520 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-49cfc14e-9828-480c-893e-865f14bfe261 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:01.819241 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49cfc14e-9828-480c-893e-865f14bfe261 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.819831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49cfc14e-9828-480c-893e-865f14bfe261 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:01.820774 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49cfc14e-9828-480c-893e-865f14bfe261 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.821215 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-49cfc14e-9828-480c-893e-865f14bfe261 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:01.866064 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-49cfc14e-9828-480c-893e-865f14bfe261 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134883) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 05:16:01.940239 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-49cfc14e-9828-480c-893e-865f14bfe261 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "POST /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/action" status: 202 len: 0 microversion: 2.20 time: 0.132219 Aug 04 05:16:01.941524 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1182/2364] 10.222.0.47 () {62 vars in 1319 bytes} [Thu Aug 4 05:16:01 2022] POST /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:16:01.952340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ab7e082e-4617-4eb6-bf97-b5b7bec238f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:01.953067 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ab7e082e-4617-4eb6-bf97-b5b7bec238f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:01.969097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ab7e082e-4617-4eb6-bf97-b5b7bec238f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.972385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ab7e082e-4617-4eb6-bf97-b5b7bec238f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:01.973431 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ab7e082e-4617-4eb6-bf97-b5b7bec238f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.975452 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ab7e082e-4617-4eb6-bf97-b5b7bec238f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:01.975595 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-bb922df4-8dff-4dab-86f4-6bbf38eb65e4 req-995ae508-3a3d-4f4c-9ebe-dc6f8eed0309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226cfa69-f0ad-40f0-bbf2-65a99c5f9824", "name": "network-vif-unplugged", "status": "completed", "tag": "3c938bb8-c645-4f88-8ca8-d8188999f813"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:01.991419 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-bb922df4-8dff-4dab-86f4-6bbf38eb65e4 req-995ae508-3a3d-4f4c-9ebe-dc6f8eed0309 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:01.991915 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-bb922df4-8dff-4dab-86f4-6bbf38eb65e4 req-995ae508-3a3d-4f4c-9ebe-dc6f8eed0309 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:02.005885 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.compute.server_external_events [req-bb922df4-8dff-4dab-86f4-6bbf38eb65e4 req-995ae508-3a3d-4f4c-9ebe-dc6f8eed0309 service nova] Unable to find a host for instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824. Dropping event network-vif-unplugged {{(pid=134883) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 05:16:02.006814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-bb922df4-8dff-4dab-86f4-6bbf38eb65e4 req-995ae508-3a3d-4f4c-9ebe-dc6f8eed0309 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039999 Aug 04 05:16:02.008593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1183/2365] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 05:16:02.136899 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ab7e082e-4617-4eb6-bf97-b5b7bec238f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:02.145631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ab7e082e-4617-4eb6-bf97-b5b7bec238f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:02.147144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ab7e082e-4617-4eb6-bf97-b5b7bec238f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:02.149055 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ab7e082e-4617-4eb6-bf97-b5b7bec238f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1753 microversion: 2.20 time: 0.203126 Aug 04 05:16:02.149615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1183/2366] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:01 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:16:02.756829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-eb2bdcc0-5d1c-4a78-ba34-b63a28738f51 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:02.757788 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-eb2bdcc0-5d1c-4a78-ba34-b63a28738f51 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:02.764825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb2bdcc0-5d1c-4a78-ba34-b63a28738f51 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:02.765378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb2bdcc0-5d1c-4a78-ba34-b63a28738f51 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:02.766233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb2bdcc0-5d1c-4a78-ba34-b63a28738f51 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:02.767037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-eb2bdcc0-5d1c-4a78-ba34-b63a28738f51 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:02.907351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-eb2bdcc0-5d1c-4a78-ba34-b63a28738f51 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:02.916411 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-eb2bdcc0-5d1c-4a78-ba34-b63a28738f51 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.163414 Aug 04 05:16:02.916923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1184/2367] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:02 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:03.172300 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-e74a9f57-d83b-4d9a-9405-04190bfd212e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:03.172837 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-e74a9f57-d83b-4d9a-9405-04190bfd212e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:03.179251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e74a9f57-d83b-4d9a-9405-04190bfd212e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:03.179707 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e74a9f57-d83b-4d9a-9405-04190bfd212e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:03.180466 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e74a9f57-d83b-4d9a-9405-04190bfd212e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:03.180914 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-e74a9f57-d83b-4d9a-9405-04190bfd212e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:03.313615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e74a9f57-d83b-4d9a-9405-04190bfd212e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:03.322610 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e74a9f57-d83b-4d9a-9405-04190bfd212e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:03.324130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-e74a9f57-d83b-4d9a-9405-04190bfd212e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:03.325302 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-e74a9f57-d83b-4d9a-9405-04190bfd212e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1755 microversion: 2.20 time: 0.156946 Aug 04 05:16:03.325879 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1184/2368] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:03 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1755 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:03.938593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-047fe17b-9ae4-42ec-a794-381d20abbd3b tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:03.939206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-047fe17b-9ae4-42ec-a794-381d20abbd3b tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:03.941523 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:03.948225 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-047fe17b-9ae4-42ec-a794-381d20abbd3b tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:03.948678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-047fe17b-9ae4-42ec-a794-381d20abbd3b tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:03.949448 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-047fe17b-9ae4-42ec-a794-381d20abbd3b tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:03.949911 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-047fe17b-9ae4-42ec-a794-381d20abbd3b tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:04.157144 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-047fe17b-9ae4-42ec-a794-381d20abbd3b tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:04.166107 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-047fe17b-9ae4-42ec-a794-381d20abbd3b tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.231164 Aug 04 05:16:04.166701 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1185/2369] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:03 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:04.349326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bf18ef78-e8b3-411e-9000-66618807062f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:04.350113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bf18ef78-e8b3-411e-9000-66618807062f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:04.357331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bf18ef78-e8b3-411e-9000-66618807062f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:04.357871 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bf18ef78-e8b3-411e-9000-66618807062f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:04.358636 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bf18ef78-e8b3-411e-9000-66618807062f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:04.359079 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bf18ef78-e8b3-411e-9000-66618807062f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:04.592060 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bf18ef78-e8b3-411e-9000-66618807062f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:04.601040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bf18ef78-e8b3-411e-9000-66618807062f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:04.602682 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bf18ef78-e8b3-411e-9000-66618807062f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:04.603849 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bf18ef78-e8b3-411e-9000-66618807062f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.258422 Aug 04 05:16:04.604399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1185/2370] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:04 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:05.187938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-295a95c0-369e-4845-9066-a618f980114a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:05.189280 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-295a95c0-369e-4845-9066-a618f980114a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:05.197588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-295a95c0-369e-4845-9066-a618f980114a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:05.198322 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-295a95c0-369e-4845-9066-a618f980114a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:05.199395 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-295a95c0-369e-4845-9066-a618f980114a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:05.199978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-295a95c0-369e-4845-9066-a618f980114a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:05.367117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-295a95c0-369e-4845-9066-a618f980114a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:05.375617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-295a95c0-369e-4845-9066-a618f980114a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.191683 Aug 04 05:16:05.376196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1186/2371] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:05 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:05.626964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ad4a906c-af49-4c7a-a055-489e1c082af9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:05.627749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ad4a906c-af49-4c7a-a055-489e1c082af9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:05.635581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ad4a906c-af49-4c7a-a055-489e1c082af9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:05.636073 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ad4a906c-af49-4c7a-a055-489e1c082af9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:05.636810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ad4a906c-af49-4c7a-a055-489e1c082af9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:05.637251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ad4a906c-af49-4c7a-a055-489e1c082af9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:05.791527 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ad4a906c-af49-4c7a-a055-489e1c082af9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:05.800018 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ad4a906c-af49-4c7a-a055-489e1c082af9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:05.801534 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ad4a906c-af49-4c7a-a055-489e1c082af9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:05.802704 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ad4a906c-af49-4c7a-a055-489e1c082af9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.179613 Aug 04 05:16:05.803256 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1186/2372] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:05 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:06.396360 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-10b437d8-9b0d-4b58-8db4-42ce02b49c9c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:06.396996 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-10b437d8-9b0d-4b58-8db4-42ce02b49c9c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:06.404733 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-10b437d8-9b0d-4b58-8db4-42ce02b49c9c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:06.405414 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-10b437d8-9b0d-4b58-8db4-42ce02b49c9c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:06.406348 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-10b437d8-9b0d-4b58-8db4-42ce02b49c9c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:06.406962 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-10b437d8-9b0d-4b58-8db4-42ce02b49c9c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:06.564527 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-10b437d8-9b0d-4b58-8db4-42ce02b49c9c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:06.572988 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-10b437d8-9b0d-4b58-8db4-42ce02b49c9c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.180504 Aug 04 05:16:06.573806 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1187/2373] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:06 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:06.827713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-66150c84-bb13-4327-8bb6-32d13cfaf3e3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:06.828238 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-66150c84-bb13-4327-8bb6-32d13cfaf3e3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:06.830617 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:06.835029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=6 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:06.837733 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66150c84-bb13-4327-8bb6-32d13cfaf3e3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:06.838178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66150c84-bb13-4327-8bb6-32d13cfaf3e3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:06.838943 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66150c84-bb13-4327-8bb6-32d13cfaf3e3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:06.839352 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66150c84-bb13-4327-8bb6-32d13cfaf3e3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:06.999483 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-66150c84-bb13-4327-8bb6-32d13cfaf3e3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:07.009916 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-66150c84-bb13-4327-8bb6-32d13cfaf3e3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:07.011432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-66150c84-bb13-4327-8bb6-32d13cfaf3e3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:07.012822 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-66150c84-bb13-4327-8bb6-32d13cfaf3e3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.189644 Aug 04 05:16:07.013398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1187/2374] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:06 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:07.591394 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:07.596851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-58de6fb3-bcfe-4d45-a3d3-3793d1c67657 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:07.597464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-58de6fb3-bcfe-4d45-a3d3-3793d1c67657 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:07.604714 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-58de6fb3-bcfe-4d45-a3d3-3793d1c67657 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:07.605161 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-58de6fb3-bcfe-4d45-a3d3-3793d1c67657 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:07.605950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-58de6fb3-bcfe-4d45-a3d3-3793d1c67657 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:07.606381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-58de6fb3-bcfe-4d45-a3d3-3793d1c67657 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:07.760099 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-58de6fb3-bcfe-4d45-a3d3-3793d1c67657 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:07.768319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-58de6fb3-bcfe-4d45-a3d3-3793d1c67657 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.177623 Aug 04 05:16:07.768896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1188/2375] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:07 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:08.037833 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-346936b8-f3a3-4857-b561-9b7f4b04d503 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:08.039210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-346936b8-f3a3-4857-b561-9b7f4b04d503 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:08.045119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-346936b8-f3a3-4857-b561-9b7f4b04d503 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:08.045690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-346936b8-f3a3-4857-b561-9b7f4b04d503 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:08.046473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-346936b8-f3a3-4857-b561-9b7f4b04d503 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:08.046928 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-346936b8-f3a3-4857-b561-9b7f4b04d503 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:08.192947 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-346936b8-f3a3-4857-b561-9b7f4b04d503 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:08.202501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-346936b8-f3a3-4857-b561-9b7f4b04d503 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:08.204050 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-346936b8-f3a3-4857-b561-9b7f4b04d503 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:08.205345 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-346936b8-f3a3-4857-b561-9b7f4b04d503 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.171665 Aug 04 05:16:08.206042 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1188/2376] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:08 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:08.791063 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-46dbe1dd-2672-48c8-aa8f-3158c6165c39 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:08.791679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-46dbe1dd-2672-48c8-aa8f-3158c6165c39 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:08.798327 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-46dbe1dd-2672-48c8-aa8f-3158c6165c39 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:08.798773 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-46dbe1dd-2672-48c8-aa8f-3158c6165c39 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:08.799538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-46dbe1dd-2672-48c8-aa8f-3158c6165c39 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:08.799969 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-46dbe1dd-2672-48c8-aa8f-3158c6165c39 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:08.958196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-46dbe1dd-2672-48c8-aa8f-3158c6165c39 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:08.968583 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-46dbe1dd-2672-48c8-aa8f-3158c6165c39 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.182929 Aug 04 05:16:08.969193 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1189/2377] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:08 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:09.230874 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0dc566d9-bb8b-4357-863c-00eb5293ed9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:09.231550 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0dc566d9-bb8b-4357-863c-00eb5293ed9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:09.238187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0dc566d9-bb8b-4357-863c-00eb5293ed9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:09.238972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0dc566d9-bb8b-4357-863c-00eb5293ed9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:09.239847 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0dc566d9-bb8b-4357-863c-00eb5293ed9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:09.240291 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0dc566d9-bb8b-4357-863c-00eb5293ed9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:09.399370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0dc566d9-bb8b-4357-863c-00eb5293ed9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:09.410575 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0dc566d9-bb8b-4357-863c-00eb5293ed9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:09.413935 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0dc566d9-bb8b-4357-863c-00eb5293ed9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:09.416137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0dc566d9-bb8b-4357-863c-00eb5293ed9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.189471 Aug 04 05:16:09.417395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1189/2378] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:09 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:09.989799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d9ec6d07-28ed-45f0-a3e9-afd5367b3e8f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:09.991662 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d9ec6d07-28ed-45f0-a3e9-afd5367b3e8f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:09.999292 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9ec6d07-28ed-45f0-a3e9-afd5367b3e8f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:10.000061 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9ec6d07-28ed-45f0-a3e9-afd5367b3e8f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:10.001193 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9ec6d07-28ed-45f0-a3e9-afd5367b3e8f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:10.001855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d9ec6d07-28ed-45f0-a3e9-afd5367b3e8f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:10.192476 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d9ec6d07-28ed-45f0-a3e9-afd5367b3e8f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:10.201041 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d9ec6d07-28ed-45f0-a3e9-afd5367b3e8f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.215407 Aug 04 05:16:10.201847 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1190/2379] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:09 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:10.440071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d3c04418-0cf0-4b9c-9391-5bd4bb05862c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:10.440681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d3c04418-0cf0-4b9c-9391-5bd4bb05862c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:10.448303 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3c04418-0cf0-4b9c-9391-5bd4bb05862c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:10.448759 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3c04418-0cf0-4b9c-9391-5bd4bb05862c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:10.449540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3c04418-0cf0-4b9c-9391-5bd4bb05862c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:10.450104 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d3c04418-0cf0-4b9c-9391-5bd4bb05862c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:10.664396 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d3c04418-0cf0-4b9c-9391-5bd4bb05862c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:10.675124 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d3c04418-0cf0-4b9c-9391-5bd4bb05862c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:10.677767 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d3c04418-0cf0-4b9c-9391-5bd4bb05862c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:10.679423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d3c04418-0cf0-4b9c-9391-5bd4bb05862c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.243081 Aug 04 05:16:10.680505 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1190/2380] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:10 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:11.221971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-81b842a1-3edf-4361-ab74-4afa2faf1918 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:11.223411 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-81b842a1-3edf-4361-ab74-4afa2faf1918 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:11.231560 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81b842a1-3edf-4361-ab74-4afa2faf1918 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:11.232012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81b842a1-3edf-4361-ab74-4afa2faf1918 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:11.232789 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81b842a1-3edf-4361-ab74-4afa2faf1918 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:11.233230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-81b842a1-3edf-4361-ab74-4afa2faf1918 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:11.390039 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-81b842a1-3edf-4361-ab74-4afa2faf1918 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:11.399445 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-81b842a1-3edf-4361-ab74-4afa2faf1918 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.181229 Aug 04 05:16:11.400029 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1191/2381] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:11 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:16:11.702775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f0860a0a-9aaf-4134-910a-27a2ae2f2b0c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:11.703398 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f0860a0a-9aaf-4134-910a-27a2ae2f2b0c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:11.710906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f0860a0a-9aaf-4134-910a-27a2ae2f2b0c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:11.711351 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f0860a0a-9aaf-4134-910a-27a2ae2f2b0c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:11.712152 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f0860a0a-9aaf-4134-910a-27a2ae2f2b0c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:11.712764 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f0860a0a-9aaf-4134-910a-27a2ae2f2b0c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:11.867830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f0860a0a-9aaf-4134-910a-27a2ae2f2b0c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:11.879404 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f0860a0a-9aaf-4134-910a-27a2ae2f2b0c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:11.880916 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f0860a0a-9aaf-4134-910a-27a2ae2f2b0c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:11.882665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f0860a0a-9aaf-4134-910a-27a2ae2f2b0c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.183858 Aug 04 05:16:11.883233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1191/2382] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:11 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:12.420593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-80fff77c-d5fa-4989-8b8c-2d7d12163238 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:12.421201 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-80fff77c-d5fa-4989-8b8c-2d7d12163238 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:12.427797 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80fff77c-d5fa-4989-8b8c-2d7d12163238 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:12.428272 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80fff77c-d5fa-4989-8b8c-2d7d12163238 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:12.429091 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80fff77c-d5fa-4989-8b8c-2d7d12163238 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:12.432851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80fff77c-d5fa-4989-8b8c-2d7d12163238 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:12.601501 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-80fff77c-d5fa-4989-8b8c-2d7d12163238 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:12.609397 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-80fff77c-d5fa-4989-8b8c-2d7d12163238 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.192847 Aug 04 05:16:12.610337 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1192/2383] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:12 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:12.905494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a22158db-ca74-4d47-bb29-5bf52b3606bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:12.906147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a22158db-ca74-4d47-bb29-5bf52b3606bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:12.913624 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a22158db-ca74-4d47-bb29-5bf52b3606bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:12.914121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a22158db-ca74-4d47-bb29-5bf52b3606bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:12.914921 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a22158db-ca74-4d47-bb29-5bf52b3606bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:12.915362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a22158db-ca74-4d47-bb29-5bf52b3606bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:13.054590 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a22158db-ca74-4d47-bb29-5bf52b3606bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:13.063280 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a22158db-ca74-4d47-bb29-5bf52b3606bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:13.064925 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a22158db-ca74-4d47-bb29-5bf52b3606bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:13.066144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a22158db-ca74-4d47-bb29-5bf52b3606bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.164590 Aug 04 05:16:13.066708 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1192/2384] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:12 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:13.630066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-58cda907-7ece-41fb-b8ba-253b4fbdfe19 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:13.630687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-58cda907-7ece-41fb-b8ba-253b4fbdfe19 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:13.637979 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-58cda907-7ece-41fb-b8ba-253b4fbdfe19 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:13.638434 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-58cda907-7ece-41fb-b8ba-253b4fbdfe19 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:13.639221 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-58cda907-7ece-41fb-b8ba-253b4fbdfe19 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:13.639643 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-58cda907-7ece-41fb-b8ba-253b4fbdfe19 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:13.779406 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-58cda907-7ece-41fb-b8ba-253b4fbdfe19 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:13.789362 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-58cda907-7ece-41fb-b8ba-253b4fbdfe19 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.163140 Aug 04 05:16:13.789974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1193/2385] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:13 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:14.089986 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-56da9615-3362-4cef-9f85-6ca542e1ce7c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:14.090577 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-56da9615-3362-4cef-9f85-6ca542e1ce7c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:14.097023 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-56da9615-3362-4cef-9f85-6ca542e1ce7c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:14.097479 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-56da9615-3362-4cef-9f85-6ca542e1ce7c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:14.098281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-56da9615-3362-4cef-9f85-6ca542e1ce7c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:14.098713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-56da9615-3362-4cef-9f85-6ca542e1ce7c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:14.227121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-56da9615-3362-4cef-9f85-6ca542e1ce7c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:14.236007 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-56da9615-3362-4cef-9f85-6ca542e1ce7c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:14.237493 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-56da9615-3362-4cef-9f85-6ca542e1ce7c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:14.238659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-56da9615-3362-4cef-9f85-6ca542e1ce7c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.152550 Aug 04 05:16:14.239205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1193/2386] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:14 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:14.813354 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-61012ab1-cf5b-4577-acc2-e3329e5f14d9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:14.814017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-61012ab1-cf5b-4577-acc2-e3329e5f14d9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:14.821165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-61012ab1-cf5b-4577-acc2-e3329e5f14d9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:14.821639 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-61012ab1-cf5b-4577-acc2-e3329e5f14d9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:14.822416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-61012ab1-cf5b-4577-acc2-e3329e5f14d9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:14.822854 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-61012ab1-cf5b-4577-acc2-e3329e5f14d9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:14.826952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:14.962715 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-61012ab1-cf5b-4577-acc2-e3329e5f14d9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:14.970706 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-61012ab1-cf5b-4577-acc2-e3329e5f14d9 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.161125 Aug 04 05:16:14.971282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1194/2387] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:14 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:15.262300 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2a1f01bb-8312-4e90-98ce-ac14e33070a3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:15.263108 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2a1f01bb-8312-4e90-98ce-ac14e33070a3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:15.269397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2a1f01bb-8312-4e90-98ce-ac14e33070a3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:15.269949 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2a1f01bb-8312-4e90-98ce-ac14e33070a3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:15.270657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2a1f01bb-8312-4e90-98ce-ac14e33070a3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:15.271225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2a1f01bb-8312-4e90-98ce-ac14e33070a3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:15.406293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2a1f01bb-8312-4e90-98ce-ac14e33070a3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:15.415528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2a1f01bb-8312-4e90-98ce-ac14e33070a3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:15.417016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2a1f01bb-8312-4e90-98ce-ac14e33070a3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:15.418201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2a1f01bb-8312-4e90-98ce-ac14e33070a3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.160577 Aug 04 05:16:15.418748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1194/2388] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:15 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:15.992378 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a85762b8-5f14-4edd-b17f-1411d39b6de4 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:15.993247 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a85762b8-5f14-4edd-b17f-1411d39b6de4 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:15.999992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a85762b8-5f14-4edd-b17f-1411d39b6de4 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:16.000439 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a85762b8-5f14-4edd-b17f-1411d39b6de4 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:16.001206 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a85762b8-5f14-4edd-b17f-1411d39b6de4 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:16.001666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a85762b8-5f14-4edd-b17f-1411d39b6de4 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:16.165033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a85762b8-5f14-4edd-b17f-1411d39b6de4 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:16.172588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a85762b8-5f14-4edd-b17f-1411d39b6de4 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.184157 Aug 04 05:16:16.173191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1195/2389] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:15 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:16.441325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bc519a4c-f77c-4341-9db4-e6ee22d75346 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:16.442031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bc519a4c-f77c-4341-9db4-e6ee22d75346 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:16.448454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc519a4c-f77c-4341-9db4-e6ee22d75346 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:16.448897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc519a4c-f77c-4341-9db4-e6ee22d75346 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:16.449677 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc519a4c-f77c-4341-9db4-e6ee22d75346 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:16.450258 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bc519a4c-f77c-4341-9db4-e6ee22d75346 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:16.589380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bc519a4c-f77c-4341-9db4-e6ee22d75346 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:16.598041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bc519a4c-f77c-4341-9db4-e6ee22d75346 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:16.599562 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bc519a4c-f77c-4341-9db4-e6ee22d75346 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:16.601461 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bc519a4c-f77c-4341-9db4-e6ee22d75346 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.164005 Aug 04 05:16:16.602046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1195/2390] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:16 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:17.194467 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3652eb14-4343-4354-866d-d70267183aa8 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:17.195074 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3652eb14-4343-4354-866d-d70267183aa8 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:17.201859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3652eb14-4343-4354-866d-d70267183aa8 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:17.202310 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3652eb14-4343-4354-866d-d70267183aa8 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:17.203057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3652eb14-4343-4354-866d-d70267183aa8 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:17.203486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3652eb14-4343-4354-866d-d70267183aa8 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:17.333136 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3652eb14-4343-4354-866d-d70267183aa8 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:17.343609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3652eb14-4343-4354-866d-d70267183aa8 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.151083 Aug 04 05:16:17.344254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1196/2391] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:17 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:17.624612 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-525feebf-7777-456f-90a9-de816d80592e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:17.625226 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-525feebf-7777-456f-90a9-de816d80592e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:17.632538 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-525feebf-7777-456f-90a9-de816d80592e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:17.633020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-525feebf-7777-456f-90a9-de816d80592e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:17.633818 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-525feebf-7777-456f-90a9-de816d80592e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:17.634262 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-525feebf-7777-456f-90a9-de816d80592e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:17.649939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:17.775672 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-525feebf-7777-456f-90a9-de816d80592e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:17.784003 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-525feebf-7777-456f-90a9-de816d80592e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:17.785488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-525feebf-7777-456f-90a9-de816d80592e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:17.786930 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-525feebf-7777-456f-90a9-de816d80592e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.165990 Aug 04 05:16:17.787475 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1196/2392] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:17 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:18.051440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-c595eb02-34ea-4daf-ac62-5b54912fa856 req-eb7efdd4-9a58-47f1-89cc-9aec331e39b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd63e685-c924-4940-ba66-4128dead0a60", "name": "network-vif-plugged", "status": "completed", "tag": "753b26da-a0d7-412a-b173-7ac7d5ad56de"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:18.063502 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-c595eb02-34ea-4daf-ac62-5b54912fa856 req-eb7efdd4-9a58-47f1-89cc-9aec331e39b3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:18.064374 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-c595eb02-34ea-4daf-ac62-5b54912fa856 req-eb7efdd4-9a58-47f1-89cc-9aec331e39b3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:18.077033 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-c595eb02-34ea-4daf-ac62-5b54912fa856 req-eb7efdd4-9a58-47f1-89cc-9aec331e39b3 service nova] Creating event network-vif-plugged:753b26da-a0d7-412a-b173-7ac7d5ad56de for instance bd63e685-c924-4940-ba66-4128dead0a60 on hv-cinder-85127 Aug 04 05:16:18.082799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-c595eb02-34ea-4daf-ac62-5b54912fa856 req-eb7efdd4-9a58-47f1-89cc-9aec331e39b3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034820 Aug 04 05:16:18.083576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1197/2393] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:16:18.364232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d78f961d-d18c-4464-9cc5-fd9fce76faf2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:18.364847 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d78f961d-d18c-4464-9cc5-fd9fce76faf2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:18.371779 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d78f961d-d18c-4464-9cc5-fd9fce76faf2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:18.372228 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d78f961d-d18c-4464-9cc5-fd9fce76faf2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:18.372984 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d78f961d-d18c-4464-9cc5-fd9fce76faf2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:18.373418 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d78f961d-d18c-4464-9cc5-fd9fce76faf2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:18.510227 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d78f961d-d18c-4464-9cc5-fd9fce76faf2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:18.517665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d78f961d-d18c-4464-9cc5-fd9fce76faf2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.157283 Aug 04 05:16:18.518225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1197/2394] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:18 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:18.810462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ff31e9d7-9dc0-4e01-a0e5-0ffe665d737b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:18.811154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ff31e9d7-9dc0-4e01-a0e5-0ffe665d737b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:18.817752 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff31e9d7-9dc0-4e01-a0e5-0ffe665d737b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:18.818198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff31e9d7-9dc0-4e01-a0e5-0ffe665d737b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:18.818976 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff31e9d7-9dc0-4e01-a0e5-0ffe665d737b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:18.819408 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ff31e9d7-9dc0-4e01-a0e5-0ffe665d737b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:18.947219 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ff31e9d7-9dc0-4e01-a0e5-0ffe665d737b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:18.955730 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ff31e9d7-9dc0-4e01-a0e5-0ffe665d737b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:18.957625 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ff31e9d7-9dc0-4e01-a0e5-0ffe665d737b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:18.958782 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ff31e9d7-9dc0-4e01-a0e5-0ffe665d737b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.152606 Aug 04 05:16:18.959905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1198/2395] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:18 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:19.538893 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-14a92320-6a79-47eb-9ef5-71e54fd4080c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:19.539498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-14a92320-6a79-47eb-9ef5-71e54fd4080c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:19.546084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-14a92320-6a79-47eb-9ef5-71e54fd4080c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:19.546526 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-14a92320-6a79-47eb-9ef5-71e54fd4080c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:19.547271 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-14a92320-6a79-47eb-9ef5-71e54fd4080c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:19.547699 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-14a92320-6a79-47eb-9ef5-71e54fd4080c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:19.685945 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-14a92320-6a79-47eb-9ef5-71e54fd4080c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:19.693557 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-14a92320-6a79-47eb-9ef5-71e54fd4080c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1257 microversion: 2.1 time: 0.159332 Aug 04 05:16:19.694160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1198/2396] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:19 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1257 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:19.984475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-67d77044-7bd8-4752-93de-137fa68ed471 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:19.985120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-67d77044-7bd8-4752-93de-137fa68ed471 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:19.991583 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-67d77044-7bd8-4752-93de-137fa68ed471 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:19.992030 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-67d77044-7bd8-4752-93de-137fa68ed471 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:19.992780 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-67d77044-7bd8-4752-93de-137fa68ed471 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:19.993211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-67d77044-7bd8-4752-93de-137fa68ed471 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:20.122344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-67d77044-7bd8-4752-93de-137fa68ed471 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:20.130640 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-67d77044-7bd8-4752-93de-137fa68ed471 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:20.132777 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-67d77044-7bd8-4752-93de-137fa68ed471 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:20.133953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-67d77044-7bd8-4752-93de-137fa68ed471 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.153310 Aug 04 05:16:20.134503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1199/2397] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:19 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:20.713638 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-84daf63b-8ce1-4868-8091-16ec96c17046 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:20.714371 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-84daf63b-8ce1-4868-8091-16ec96c17046 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:20.720942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84daf63b-8ce1-4868-8091-16ec96c17046 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:20.721390 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84daf63b-8ce1-4868-8091-16ec96c17046 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:20.722187 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84daf63b-8ce1-4868-8091-16ec96c17046 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:20.722656 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-84daf63b-8ce1-4868-8091-16ec96c17046 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:20.857802 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-84daf63b-8ce1-4868-8091-16ec96c17046 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:20.865224 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-84daf63b-8ce1-4868-8091-16ec96c17046 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1441 microversion: 2.1 time: 0.155556 Aug 04 05:16:20.865850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1199/2398] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:20 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1441 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:20.885820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-390d5b19-a8d4-4bb0-ab93-cdf583a87337 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:20.886441 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-390d5b19-a8d4-4bb0-ab93-cdf583a87337 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:20.892419 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-390d5b19-a8d4-4bb0-ab93-cdf583a87337 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:20.892870 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-390d5b19-a8d4-4bb0-ab93-cdf583a87337 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:20.893657 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-390d5b19-a8d4-4bb0-ab93-cdf583a87337 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:20.894093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-390d5b19-a8d4-4bb0-ab93-cdf583a87337 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:21.031814 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-390d5b19-a8d4-4bb0-ab93-cdf583a87337 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:21.040476 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-390d5b19-a8d4-4bb0-ab93-cdf583a87337 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1441 microversion: 2.1 time: 0.159205 Aug 04 05:16:21.041056 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1200/2399] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:16:20 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1441 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:16:21.156488 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f63a4a19-959f-4bfd-9524-dd4eca2494a0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:21.157096 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f63a4a19-959f-4bfd-9524-dd4eca2494a0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:21.168205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f63a4a19-959f-4bfd-9524-dd4eca2494a0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:21.168795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f63a4a19-959f-4bfd-9524-dd4eca2494a0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:21.170278 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f63a4a19-959f-4bfd-9524-dd4eca2494a0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:21.170898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f63a4a19-959f-4bfd-9524-dd4eca2494a0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:21.334946 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f63a4a19-959f-4bfd-9524-dd4eca2494a0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:21.344536 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f63a4a19-959f-4bfd-9524-dd4eca2494a0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:21.346079 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f63a4a19-959f-4bfd-9524-dd4eca2494a0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:21.347272 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f63a4a19-959f-4bfd-9524-dd4eca2494a0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.194729 Aug 04 05:16:21.347844 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1200/2400] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:21 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:22.373539 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e8537a61-1be2-49b6-85b2-9b0538381fdd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:22.375017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e8537a61-1be2-49b6-85b2-9b0538381fdd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:22.384950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8537a61-1be2-49b6-85b2-9b0538381fdd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:22.385587 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8537a61-1be2-49b6-85b2-9b0538381fdd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:22.386679 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8537a61-1be2-49b6-85b2-9b0538381fdd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:22.387421 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e8537a61-1be2-49b6-85b2-9b0538381fdd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:22.552516 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e8537a61-1be2-49b6-85b2-9b0538381fdd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:22.562377 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e8537a61-1be2-49b6-85b2-9b0538381fdd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:22.563894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e8537a61-1be2-49b6-85b2-9b0538381fdd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:22.565055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e8537a61-1be2-49b6-85b2-9b0538381fdd tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.196899 Aug 04 05:16:22.565737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1201/2401] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:22 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:22.844102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-fc2e9a50-ea0e-4f2c-96f7-6977c071b7ce req-511b7a94-bf0e-45b8-8660-c17d650cfa3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd63e685-c924-4940-ba66-4128dead0a60", "tag": "753b26da-a0d7-412a-b173-7ac7d5ad56de"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:22.854530 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-fc2e9a50-ea0e-4f2c-96f7-6977c071b7ce req-511b7a94-bf0e-45b8-8660-c17d650cfa3c service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:22.855089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-fc2e9a50-ea0e-4f2c-96f7-6977c071b7ce req-511b7a94-bf0e-45b8-8660-c17d650cfa3c service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:22.867082 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-fc2e9a50-ea0e-4f2c-96f7-6977c071b7ce req-511b7a94-bf0e-45b8-8660-c17d650cfa3c service nova] Creating event network-changed:753b26da-a0d7-412a-b173-7ac7d5ad56de for instance bd63e685-c924-4940-ba66-4128dead0a60 on hv-cinder-85127 Aug 04 05:16:22.872310 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-fc2e9a50-ea0e-4f2c-96f7-6977c071b7ce req-511b7a94-bf0e-45b8-8660-c17d650cfa3c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031960 Aug 04 05:16:22.873181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1201/2402] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:16:23.589032 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-be80328b-8f50-481e-8c4f-b4b9aa0cb860 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:23.589731 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-be80328b-8f50-481e-8c4f-b4b9aa0cb860 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:23.596250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be80328b-8f50-481e-8c4f-b4b9aa0cb860 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:23.596770 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be80328b-8f50-481e-8c4f-b4b9aa0cb860 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:23.597536 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be80328b-8f50-481e-8c4f-b4b9aa0cb860 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:23.598003 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-be80328b-8f50-481e-8c4f-b4b9aa0cb860 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:23.751815 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-be80328b-8f50-481e-8c4f-b4b9aa0cb860 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:23.760983 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-be80328b-8f50-481e-8c4f-b4b9aa0cb860 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:23.762521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-be80328b-8f50-481e-8c4f-b4b9aa0cb860 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:23.763677 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-be80328b-8f50-481e-8c4f-b4b9aa0cb860 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.179436 Aug 04 05:16:23.764225 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1202/2403] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:23 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:24.114236 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-9b91de79-bd33-47d5-9c7a-7bd29c230160 req-0257d08e-4a9b-409c-9781-57cbba3cdf22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226cfa69-f0ad-40f0-bbf2-65a99c5f9824", "name": "network-vif-plugged", "status": "completed", "tag": "3c938bb8-c645-4f88-8ca8-d8188999f813"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:16:24.124415 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-9b91de79-bd33-47d5-9c7a-7bd29c230160 req-0257d08e-4a9b-409c-9781-57cbba3cdf22 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:24.124913 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-9b91de79-bd33-47d5-9c7a-7bd29c230160 req-0257d08e-4a9b-409c-9781-57cbba3cdf22 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:24.136528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-9b91de79-bd33-47d5-9c7a-7bd29c230160 req-0257d08e-4a9b-409c-9781-57cbba3cdf22 service nova] Creating event network-vif-plugged:3c938bb8-c645-4f88-8ca8-d8188999f813 for instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 on hv-cinder-85127 Aug 04 05:16:24.141763 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-9b91de79-bd33-47d5-9c7a-7bd29c230160 req-0257d08e-4a9b-409c-9781-57cbba3cdf22 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032040 Aug 04 05:16:24.142363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1202/2404] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:16:24.788447 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-623c054b-5a7c-40e5-9ede-796a4856843c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:24.789076 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-623c054b-5a7c-40e5-9ede-796a4856843c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:24.795626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-623c054b-5a7c-40e5-9ede-796a4856843c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:24.796109 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-623c054b-5a7c-40e5-9ede-796a4856843c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:24.796878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-623c054b-5a7c-40e5-9ede-796a4856843c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:24.797314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-623c054b-5a7c-40e5-9ede-796a4856843c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:24.934179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-623c054b-5a7c-40e5-9ede-796a4856843c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:24.942540 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-623c054b-5a7c-40e5-9ede-796a4856843c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:24.944955 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-623c054b-5a7c-40e5-9ede-796a4856843c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:24.946032 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-623c054b-5a7c-40e5-9ede-796a4856843c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.162165 Aug 04 05:16:24.946592 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1203/2405] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:24 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:25.970108 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-003a2b2e-84fb-4d3c-8aab-d1410047ced0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:25.970816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-003a2b2e-84fb-4d3c-8aab-d1410047ced0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:25.978172 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-003a2b2e-84fb-4d3c-8aab-d1410047ced0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:25.978630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-003a2b2e-84fb-4d3c-8aab-d1410047ced0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:25.979401 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-003a2b2e-84fb-4d3c-8aab-d1410047ced0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:25.979839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-003a2b2e-84fb-4d3c-8aab-d1410047ced0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:26.129455 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-003a2b2e-84fb-4d3c-8aab-d1410047ced0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:26.139521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-003a2b2e-84fb-4d3c-8aab-d1410047ced0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:26.141301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-003a2b2e-84fb-4d3c-8aab-d1410047ced0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:26.142511 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-003a2b2e-84fb-4d3c-8aab-d1410047ced0 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1811 microversion: 2.20 time: 0.178056 Aug 04 05:16:26.151859 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1203/2406] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:25 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1811 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:27.167309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5eed59bc-b2f6-4be4-98b3-666119e1628d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:27.167924 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5eed59bc-b2f6-4be4-98b3-666119e1628d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:27.174428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5eed59bc-b2f6-4be4-98b3-666119e1628d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:27.174966 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5eed59bc-b2f6-4be4-98b3-666119e1628d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:27.175723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5eed59bc-b2f6-4be4-98b3-666119e1628d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:27.176155 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5eed59bc-b2f6-4be4-98b3-666119e1628d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:27.309778 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5eed59bc-b2f6-4be4-98b3-666119e1628d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:27.318220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5eed59bc-b2f6-4be4-98b3-666119e1628d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:27.320308 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5eed59bc-b2f6-4be4-98b3-666119e1628d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:16:27.321792 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5eed59bc-b2f6-4be4-98b3-666119e1628d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1798 microversion: 2.20 time: 0.158861 Aug 04 05:16:27.322355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1204/2407] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:16:27 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1798 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:16:59.986245 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-08433975-3422-4f64-ac11-555f0f02e24a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:16:59.986805 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-08433975-3422-4f64-ac11-555f0f02e24a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:16:59.989060 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=49 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:59.989735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=37 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:16:59.997139 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-08433975-3422-4f64-ac11-555f0f02e24a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:59.997614 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-08433975-3422-4f64-ac11-555f0f02e24a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:16:59.998435 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-08433975-3422-4f64-ac11-555f0f02e24a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:16:59.998877 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-08433975-3422-4f64-ac11-555f0f02e24a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:00.028348 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-08433975-3422-4f64-ac11-555f0f02e24a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/os-volume_attachments/66cec82a-7990-44a9-a541-973723dde642" status: 200 len: 194 microversion: 2.20 time: 0.046107 Aug 04 05:17:00.028915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1204/2408] 10.222.0.47 () {60 vars in 1454 bytes} [Thu Aug 4 05:16:59 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/os-volume_attachments/66cec82a-7990-44a9-a541-973723dde642 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:17:00.096309 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2781c2ae-07b5-4ac1-a719-19e5f6a26f84 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:00.096833 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2781c2ae-07b5-4ac1-a719-19e5f6a26f84 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:00.099066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=39 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:00.099716 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=60 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:00.106088 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2781c2ae-07b5-4ac1-a719-19e5f6a26f84 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:00.106542 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2781c2ae-07b5-4ac1-a719-19e5f6a26f84 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:00.107303 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2781c2ae-07b5-4ac1-a719-19e5f6a26f84 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:00.107742 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2781c2ae-07b5-4ac1-a719-19e5f6a26f84 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:00.187763 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-2781c2ae-07b5-4ac1-a719-19e5f6a26f84 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lazy-loading 'services' on Instance uuid 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:17:00.259194 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2781c2ae-07b5-4ac1-a719-19e5f6a26f84 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "DELETE /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/os-volume_attachments/66cec82a-7990-44a9-a541-973723dde642" status: 202 len: 0 microversion: 2.20 time: 0.166250 Aug 04 05:17:00.259771 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1205/2409] 10.222.0.47 () {60 vars in 1457 bytes} [Thu Aug 4 05:17:00 2022] DELETE /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/os-volume_attachments/66cec82a-7990-44a9-a541-973723dde642 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:17:00.268280 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9e57f433-db89-42dc-8bfe-77443b952f75 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:00.270434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9e57f433-db89-42dc-8bfe-77443b952f75 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:00.276789 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9e57f433-db89-42dc-8bfe-77443b952f75 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:00.277276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9e57f433-db89-42dc-8bfe-77443b952f75 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:00.278185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9e57f433-db89-42dc-8bfe-77443b952f75 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:00.278631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9e57f433-db89-42dc-8bfe-77443b952f75 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:00.309567 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9e57f433-db89-42dc-8bfe-77443b952f75 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045232 Aug 04 05:17:00.310261 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1205/2410] 10.222.0.47 () {60 vars in 1343 bytes} [Thu Aug 4 05:17:00 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:17:01.323848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-29650fb3-d690-49f8-97bb-0116b04df4f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:01.326244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-29650fb3-d690-49f8-97bb-0116b04df4f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:01.332521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-29650fb3-d690-49f8-97bb-0116b04df4f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:01.332975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-29650fb3-d690-49f8-97bb-0116b04df4f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:01.333765 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-29650fb3-d690-49f8-97bb-0116b04df4f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:01.334203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-29650fb3-d690-49f8-97bb-0116b04df4f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:01.363570 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-29650fb3-d690-49f8-97bb-0116b04df4f2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045374 Aug 04 05:17:01.364122 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1206/2411] 10.222.0.47 () {60 vars in 1343 bytes} [Thu Aug 4 05:17:01 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:01.427012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-55b57161-93a7-459e-98ae-175d21bb4218 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:01.427495 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-55b57161-93a7-459e-98ae-175d21bb4218 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:01.434657 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-55b57161-93a7-459e-98ae-175d21bb4218 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:01.435101 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-55b57161-93a7-459e-98ae-175d21bb4218 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:01.435847 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-55b57161-93a7-459e-98ae-175d21bb4218 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:01.436276 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-55b57161-93a7-459e-98ae-175d21bb4218 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:01.461882 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-55b57161-93a7-459e-98ae-175d21bb4218 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Going to try to terminate instance {{(pid=134884) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:17:01.537027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-55b57161-93a7-459e-98ae-175d21bb4218 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "DELETE /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 204 len: 0 microversion: 2.20 time: 0.113579 Aug 04 05:17:01.537886 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1206/2412] 10.222.0.47 () {60 vars in 1280 bytes} [Thu Aug 4 05:17:01 2022] DELETE /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 05:17:01.546227 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0c066491-f1e3-4b31-b274-8257caf2c651 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:01.546825 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0c066491-f1e3-4b31-b274-8257caf2c651 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:01.552784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c066491-f1e3-4b31-b274-8257caf2c651 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:01.553228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c066491-f1e3-4b31-b274-8257caf2c651 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:01.554011 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c066491-f1e3-4b31-b274-8257caf2c651 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:01.554436 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0c066491-f1e3-4b31-b274-8257caf2c651 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:01.689773 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0c066491-f1e3-4b31-b274-8257caf2c651 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:01.698485 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0c066491-f1e3-4b31-b274-8257caf2c651 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:01.699991 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0c066491-f1e3-4b31-b274-8257caf2c651 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:01.701156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0c066491-f1e3-4b31-b274-8257caf2c651 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1726 microversion: 2.20 time: 0.158870 Aug 04 05:17:01.701727 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1207/2413] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:17:01 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:17:02.724810 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0ab93b14-a685-4ff1-8a92-144f91ed6442 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:02.725503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0ab93b14-a685-4ff1-8a92-144f91ed6442 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:02.732816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ab93b14-a685-4ff1-8a92-144f91ed6442 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:02.733268 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ab93b14-a685-4ff1-8a92-144f91ed6442 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:02.734064 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ab93b14-a685-4ff1-8a92-144f91ed6442 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:02.734529 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0ab93b14-a685-4ff1-8a92-144f91ed6442 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:02.867354 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0ab93b14-a685-4ff1-8a92-144f91ed6442 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:02.875573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0ab93b14-a685-4ff1-8a92-144f91ed6442 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:02.877071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0ab93b14-a685-4ff1-8a92-144f91ed6442 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:02.878257 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0ab93b14-a685-4ff1-8a92-144f91ed6442 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1726 microversion: 2.20 time: 0.157784 Aug 04 05:17:02.878814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1207/2414] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:17:02 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:17:03.902552 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d6b381af-2f46-4221-a697-8886c43c6853 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:03.903857 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d6b381af-2f46-4221-a697-8886c43c6853 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:03.910284 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d6b381af-2f46-4221-a697-8886c43c6853 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:03.911011 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d6b381af-2f46-4221-a697-8886c43c6853 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:03.911796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d6b381af-2f46-4221-a697-8886c43c6853 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:03.912238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d6b381af-2f46-4221-a697-8886c43c6853 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:03.941062 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-082bf3a2-fd63-40a0-bbb3-2502622f594d req-a7bed0c4-4078-4462-b161-6557e813e214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226cfa69-f0ad-40f0-bbf2-65a99c5f9824", "name": "network-vif-deleted", "tag": "3c938bb8-c645-4f88-8ca8-d8188999f813"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:03.961062 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-082bf3a2-fd63-40a0-bbb3-2502622f594d req-a7bed0c4-4078-4462-b161-6557e813e214 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:03.962395 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-082bf3a2-fd63-40a0-bbb3-2502622f594d req-a7bed0c4-4078-4462-b161-6557e813e214 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:03.975447 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-082bf3a2-fd63-40a0-bbb3-2502622f594d req-a7bed0c4-4078-4462-b161-6557e813e214 service nova] Creating event network-vif-deleted:3c938bb8-c645-4f88-8ca8-d8188999f813 for instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 on hv-cinder-85127 Aug 04 05:17:03.982298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-082bf3a2-fd63-40a0-bbb3-2502622f594d req-a7bed0c4-4078-4462-b161-6557e813e214 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044738 Aug 04 05:17:03.983283 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1208/2415] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:17:03.994070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d6b381af-2f46-4221-a697-8886c43c6853 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:04.003084 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d6b381af-2f46-4221-a697-8886c43c6853 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:04.004604 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d6b381af-2f46-4221-a697-8886c43c6853 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:04.005799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d6b381af-2f46-4221-a697-8886c43c6853 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 200 len: 1658 microversion: 2.20 time: 0.107875 Aug 04 05:17:04.006358 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1208/2416] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:17:03 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 1658 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:17:05.030931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c5b2e0d8-86be-4c18-bb8c-5df3cdb99518 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:05.031629 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c5b2e0d8-86be-4c18-bb8c-5df3cdb99518 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:05.038105 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c5b2e0d8-86be-4c18-bb8c-5df3cdb99518 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:05.038552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c5b2e0d8-86be-4c18-bb8c-5df3cdb99518 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:05.039813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c5b2e0d8-86be-4c18-bb8c-5df3cdb99518 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:05.040880 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c5b2e0d8-86be-4c18-bb8c-5df3cdb99518 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:05.053847 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-c5b2e0d8-86be-4c18-bb8c-5df3cdb99518 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] HTTP exception thrown: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c5b2e0d8-86be-4c18-bb8c-5df3cdb99518 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Request method failure captured: Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 HTTP/1.1 Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi61W9anpa4fczbUpfvMTekzd0t9WtJLqri3o0w5k7oHbx7HNurEnNUvnlXhXOoStt4wdJWbdW1HBz3SWcizlrzZ-xdol9Fjvh0EHdFAm8qE_oWgknYbhB49HJndraj6NyRcJqZ0Buw4iYjEYBHb4ZoIrqGcn4_3KGuQY26prkT5lobVU Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: c27540203cac4353859078edecd89b4d Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:17:05.056586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:17:05.058045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c27540203cac4353859078edecd89b4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c27540203cac4353859078edecd89b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c27540203cac4353859078edecd89b4d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c27540203cac4353859078edecd89b4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:17:05.058045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:17:05.058045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: c27540203cac4353859078edecd89b4d Aug 04 05:17:05.058045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:17:05.058045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeShelveTestJSON-1230091245-project Aug 04 05:17:05.058045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:17:05.058045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:17:05.058045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 28bf7f4d000248c9b40c1b4e596b5d3a Aug 04 05:17:05.058045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1230091245-project Aug 04 05:17:05.058045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:17:05.058045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:17:05.058045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '226cfa69-f0ad-40f0-bbf2-65a99c5f9824'} Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:17:05.058839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:17:05.060033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:17:05.061111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c5b2e0d8-86be-4c18-bb8c-5df3cdb99518 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Returning 404 to user: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:17:05.061111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c5b2e0d8-86be-4c18-bb8c-5df3cdb99518 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 404 len: 111 microversion: 2.20 time: 0.031743 Aug 04 05:17:05.061111 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1209/2417] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:17:05 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:17:05.066909 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9cef14b7-fae5-4ec3-9270-13ed81b40467 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '.version_select at 0x7fc942050790>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:05.071642 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9cef14b7-fae5-4ec3-9270-13ed81b40467 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [d47c0f69-9f6c-42d1-a7d6-7f2f63ae1178] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 05:17:06.079317 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [None req-9cef14b7-fae5-4ec3-9270-13ed81b40467 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [d47c0f69-9f6c-42d1-a7d6-7f2f63ae1178] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 42698. Aug 04 05:17:06.097445 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9cef14b7-fae5-4ec3-9270-13ed81b40467 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444407129" status: 204 len: 0 microversion: 2.20 time: 1.034297 Aug 04 05:17:06.098089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1209/2418] 10.222.0.47 () {60 vars in 1262 bytes} [Thu Aug 4 05:17:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444407129 => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 05:17:06.941915 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-99cd235b-13f0-4551-88bc-530f05bcc242 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Action: 'create', calling method: .version_select at 0x7fc94212d5e0>, body: {"keypair": {"name": "tempest-keypair-1004555052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoejmBHTcLYX8posbstLxvAwc/rVwNZ8i74yMyEeMM0KG3NW6f2gigUnBsuX3P2n8tcb09TfIlS0VpmbOhu7V45MZ2daTUNArNiu2aSToDVHn5bJ2ZcaOSnz2qvNZP0TQ=="}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:06.958057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-99cd235b-13f0-4551-88bc-530f05bcc242 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Getting quotas for project c27540203cac4353859078edecd89b4d. Resources: {'key_pairs'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:17:06.961885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-99cd235b-13f0-4551-88bc-530f05bcc242 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Getting quotas for user 28bf7f4d000248c9b40c1b4e596b5d3a and project c27540203cac4353859078edecd89b4d. Resources: {'key_pairs'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:17:06.984301 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-99cd235b-13f0-4551-88bc-530f05bcc242 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046404 Aug 04 05:17:06.984961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1210/2419] 10.222.0.47 () {62 vars in 1200 bytes} [Thu Aug 4 05:17:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 05:17:08.259460 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1538832171", "imageRef": "2524adbe-6b97-430f-add9-5b4cafcda0d2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff238d07-f6c9-4435-8f56-c4790b739f8b"}], "security_groups": [{"name": "tempest-securitygroup--1777432749"}], "key_name": "tempest-keypair-1004555052", "user_data": "}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:08.364921 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] validate_networks() for [('ff238d07-f6c9-4435-8f56-c4790b739f8b', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:17:08.738697 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:17:08.739133 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:17:08.739637 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:17:08.740113 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:17:08.740551 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:17:08.752029 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:08.752687 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:08.753517 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:08.753986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:08.771071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Getting quotas for project c27540203cac4353859078edecd89b4d. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:17:08.776193 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Getting quotas for user 28bf7f4d000248c9b40c1b4e596b5d3a and project c27540203cac4353859078edecd89b4d. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:17:08.787820 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:17:08.790681 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2524adbe-6b97-430f-add9-5b4cafcda0d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:17:08.838368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-84017e3a-f52a-4bc1-b88f-d3d52b49e18e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.584612 Aug 04 05:17:08.839009 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1210/2420] 10.222.0.47 () {62 vars in 1188 bytes} [Thu Aug 4 05:17:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 05:17:08.849961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-072f7f62-49a5-4f31-a429-fb26efa71f00 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:08.850734 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-072f7f62-49a5-4f31-a429-fb26efa71f00 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:08.907244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-072f7f62-49a5-4f31-a429-fb26efa71f00 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:08.915114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-072f7f62-49a5-4f31-a429-fb26efa71f00 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:08.916648 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-072f7f62-49a5-4f31-a429-fb26efa71f00 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:08.917775 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-072f7f62-49a5-4f31-a429-fb26efa71f00 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1282 microversion: 2.20 time: 0.071923 Aug 04 05:17:08.931645 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1211/2421] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:17:08 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:17:09.940663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-86cd45f4-6cf1-41fa-9701-5d8f4fef1c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:09.941259 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-86cd45f4-6cf1-41fa-9701-5d8f4fef1c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:09.947748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86cd45f4-6cf1-41fa-9701-5d8f4fef1c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:09.948198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86cd45f4-6cf1-41fa-9701-5d8f4fef1c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:09.948960 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86cd45f4-6cf1-41fa-9701-5d8f4fef1c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:09.949395 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-86cd45f4-6cf1-41fa-9701-5d8f4fef1c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:10.034611 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-86cd45f4-6cf1-41fa-9701-5d8f4fef1c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:10.043743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-86cd45f4-6cf1-41fa-9701-5d8f4fef1c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:10.045243 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-86cd45f4-6cf1-41fa-9701-5d8f4fef1c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:10.046383 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-86cd45f4-6cf1-41fa-9701-5d8f4fef1c58 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1340 microversion: 2.20 time: 0.110112 Aug 04 05:17:10.046933 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1211/2422] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:17:09 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1340 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:17:11.069315 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-45c33317-88de-4a11-8ca3-386cf7fa5a8b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:11.071418 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-45c33317-88de-4a11-8ca3-386cf7fa5a8b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:11.077724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-45c33317-88de-4a11-8ca3-386cf7fa5a8b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:11.078169 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-45c33317-88de-4a11-8ca3-386cf7fa5a8b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:11.078929 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-45c33317-88de-4a11-8ca3-386cf7fa5a8b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:11.079363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-45c33317-88de-4a11-8ca3-386cf7fa5a8b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:11.117188 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-6cda3f27-fecc-4ab7-9c08-e6001e2397fe req-c2e79197-6d95-441c-a907-839de95ec340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55a20351-3bba-4e9f-9291-141d8db265c0", "tag": "c7d845bb-700b-4c12-9596-4c246d13b053"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:11.129667 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-6cda3f27-fecc-4ab7-9c08-e6001e2397fe req-c2e79197-6d95-441c-a907-839de95ec340 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:11.130328 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-6cda3f27-fecc-4ab7-9c08-e6001e2397fe req-c2e79197-6d95-441c-a907-839de95ec340 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:11.143134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-6cda3f27-fecc-4ab7-9c08-e6001e2397fe req-c2e79197-6d95-441c-a907-839de95ec340 service nova] Creating event network-changed:c7d845bb-700b-4c12-9596-4c246d13b053 for instance 55a20351-3bba-4e9f-9291-141d8db265c0 on hv-cinder-85127 Aug 04 05:17:11.148101 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-6cda3f27-fecc-4ab7-9c08-e6001e2397fe req-c2e79197-6d95-441c-a907-839de95ec340 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035326 Aug 04 05:17:11.149584 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1212/2423] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:17:11.358080 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-45c33317-88de-4a11-8ca3-386cf7fa5a8b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:11.365974 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-45c33317-88de-4a11-8ca3-386cf7fa5a8b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:11.368547 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-45c33317-88de-4a11-8ca3-386cf7fa5a8b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:11.369705 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-45c33317-88de-4a11-8ca3-386cf7fa5a8b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1408 microversion: 2.20 time: 0.304265 Aug 04 05:17:11.370264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1212/2424] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:17:11 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1408 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:17:12.392840 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8163ac33-0eee-4098-9661-4ccbfcd12bfe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:12.393538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8163ac33-0eee-4098-9661-4ccbfcd12bfe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:12.400666 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8163ac33-0eee-4098-9661-4ccbfcd12bfe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:12.401129 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8163ac33-0eee-4098-9661-4ccbfcd12bfe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:12.401927 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8163ac33-0eee-4098-9661-4ccbfcd12bfe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:12.402365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8163ac33-0eee-4098-9661-4ccbfcd12bfe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:12.613723 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8163ac33-0eee-4098-9661-4ccbfcd12bfe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:12.622060 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8163ac33-0eee-4098-9661-4ccbfcd12bfe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:12.623683 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8163ac33-0eee-4098-9661-4ccbfcd12bfe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:12.624818 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8163ac33-0eee-4098-9661-4ccbfcd12bfe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1408 microversion: 2.20 time: 0.236253 Aug 04 05:17:12.625376 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1213/2425] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:17:12 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:17:13.647902 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-20cdd178-21e0-466b-926d-afb57283ae5d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:13.649130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-20cdd178-21e0-466b-926d-afb57283ae5d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:13.655262 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20cdd178-21e0-466b-926d-afb57283ae5d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:13.655730 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20cdd178-21e0-466b-926d-afb57283ae5d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:13.656509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20cdd178-21e0-466b-926d-afb57283ae5d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:13.656941 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-20cdd178-21e0-466b-926d-afb57283ae5d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:13.794318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-20cdd178-21e0-466b-926d-afb57283ae5d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:13.802113 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-20cdd178-21e0-466b-926d-afb57283ae5d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:13.803605 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-20cdd178-21e0-466b-926d-afb57283ae5d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:13.804791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-20cdd178-21e0-466b-926d-afb57283ae5d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1408 microversion: 2.20 time: 0.160824 Aug 04 05:17:13.805424 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1213/2426] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:17:13 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:17:14.826970 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-edcff475-a6c7-41d5-925d-ba276d89af7a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:14.827579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-edcff475-a6c7-41d5-925d-ba276d89af7a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:14.834097 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-edcff475-a6c7-41d5-925d-ba276d89af7a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:14.834544 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-edcff475-a6c7-41d5-925d-ba276d89af7a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:14.835302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-edcff475-a6c7-41d5-925d-ba276d89af7a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:14.835739 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-edcff475-a6c7-41d5-925d-ba276d89af7a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:14.965629 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-edcff475-a6c7-41d5-925d-ba276d89af7a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:14.973382 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-edcff475-a6c7-41d5-925d-ba276d89af7a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:14.974908 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-edcff475-a6c7-41d5-925d-ba276d89af7a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:14.975986 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-edcff475-a6c7-41d5-925d-ba276d89af7a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1408 microversion: 2.20 time: 0.152948 Aug 04 05:17:14.977437 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1214/2427] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:17:14 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:17:15.998856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f550587d-75f3-48bf-a5e8-f5bc0c89cc07 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:15.999460 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f550587d-75f3-48bf-a5e8-f5bc0c89cc07 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:16.006724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f550587d-75f3-48bf-a5e8-f5bc0c89cc07 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:16.006724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f550587d-75f3-48bf-a5e8-f5bc0c89cc07 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:16.007208 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f550587d-75f3-48bf-a5e8-f5bc0c89cc07 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:16.008233 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f550587d-75f3-48bf-a5e8-f5bc0c89cc07 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:16.141164 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f550587d-75f3-48bf-a5e8-f5bc0c89cc07 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:16.149703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f550587d-75f3-48bf-a5e8-f5bc0c89cc07 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:16.151221 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f550587d-75f3-48bf-a5e8-f5bc0c89cc07 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:16.152315 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f550587d-75f3-48bf-a5e8-f5bc0c89cc07 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1408 microversion: 2.20 time: 0.157384 Aug 04 05:17:16.152866 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1214/2428] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:17:15 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:17:16.416829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-d0d77f08-3421-434c-b132-6f09076b8add req-41a8bb13-fb97-4213-90c3-0de71c5143e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a20351-3bba-4e9f-9291-141d8db265c0", "name": "network-vif-plugged", "status": "completed", "tag": "c7d845bb-700b-4c12-9596-4c246d13b053"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:16.427092 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-d0d77f08-3421-434c-b132-6f09076b8add req-41a8bb13-fb97-4213-90c3-0de71c5143e7 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:16.427536 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-d0d77f08-3421-434c-b132-6f09076b8add req-41a8bb13-fb97-4213-90c3-0de71c5143e7 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:16.441264 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-d0d77f08-3421-434c-b132-6f09076b8add req-41a8bb13-fb97-4213-90c3-0de71c5143e7 service nova] Creating event network-vif-plugged:c7d845bb-700b-4c12-9596-4c246d13b053 for instance 55a20351-3bba-4e9f-9291-141d8db265c0 on hv-cinder-85127 Aug 04 05:17:16.447027 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-d0d77f08-3421-434c-b132-6f09076b8add req-41a8bb13-fb97-4213-90c3-0de71c5143e7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034083 Aug 04 05:17:16.447805 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1215/2429] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:17:17.174298 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-88aa7929-dd69-4a51-a639-4a73e5021577 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:17.174863 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-88aa7929-dd69-4a51-a639-4a73e5021577 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:17.182671 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88aa7929-dd69-4a51-a639-4a73e5021577 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:17.183114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88aa7929-dd69-4a51-a639-4a73e5021577 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:17.183879 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88aa7929-dd69-4a51-a639-4a73e5021577 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:17.184318 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-88aa7929-dd69-4a51-a639-4a73e5021577 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:17.316292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-88aa7929-dd69-4a51-a639-4a73e5021577 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:17.326012 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-88aa7929-dd69-4a51-a639-4a73e5021577 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:17.327517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-88aa7929-dd69-4a51-a639-4a73e5021577 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:17.328618 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-88aa7929-dd69-4a51-a639-4a73e5021577 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1408 microversion: 2.20 time: 0.158364 Aug 04 05:17:17.329175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1215/2430] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:17:17 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:17:18.351504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-9ecf5460-5b68-42fe-b12d-d35ea756a646 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:18.352195 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-9ecf5460-5b68-42fe-b12d-d35ea756a646 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:18.358461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9ecf5460-5b68-42fe-b12d-d35ea756a646 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:18.358902 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9ecf5460-5b68-42fe-b12d-d35ea756a646 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:18.359648 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9ecf5460-5b68-42fe-b12d-d35ea756a646 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:18.360078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-9ecf5460-5b68-42fe-b12d-d35ea756a646 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:18.489650 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9ecf5460-5b68-42fe-b12d-d35ea756a646 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:18.497579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9ecf5460-5b68-42fe-b12d-d35ea756a646 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:18.499031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-9ecf5460-5b68-42fe-b12d-d35ea756a646 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:18.500180 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-9ecf5460-5b68-42fe-b12d-d35ea756a646 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1601 microversion: 2.20 time: 0.153332 Aug 04 05:17:18.500734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1216/2431] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:17:18 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:17:18.524151 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f4cdc496-7c24-49d2-bd3d-290f37d01be7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:18.524756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f4cdc496-7c24-49d2-bd3d-290f37d01be7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:18.531283 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4cdc496-7c24-49d2-bd3d-290f37d01be7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:18.531733 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4cdc496-7c24-49d2-bd3d-290f37d01be7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:18.532491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4cdc496-7c24-49d2-bd3d-290f37d01be7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:18.532925 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f4cdc496-7c24-49d2-bd3d-290f37d01be7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:18.609663 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f4cdc496-7c24-49d2-bd3d-290f37d01be7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090618 Aug 04 05:17:18.610314 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1216/2432] 10.222.0.47 () {60 vars in 1316 bytes} [Thu Aug 4 05:17:18 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:17:19.801949 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-1adda849-f5c5-48d2-98f0-f60bdf90d4d5 req-36d8bbba-0487-4b6c-9336-2162ee8eb4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55a20351-3bba-4e9f-9291-141d8db265c0", "tag": "c7d845bb-700b-4c12-9596-4c246d13b053"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:19.807399 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:19.808198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=6 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:19.815576 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-1adda849-f5c5-48d2-98f0-f60bdf90d4d5 req-36d8bbba-0487-4b6c-9336-2162ee8eb4d2 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:19.816018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-1adda849-f5c5-48d2-98f0-f60bdf90d4d5 req-36d8bbba-0487-4b6c-9336-2162ee8eb4d2 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:19.833502 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-1adda849-f5c5-48d2-98f0-f60bdf90d4d5 req-36d8bbba-0487-4b6c-9336-2162ee8eb4d2 service nova] Creating event network-changed:c7d845bb-700b-4c12-9596-4c246d13b053 for instance 55a20351-3bba-4e9f-9291-141d8db265c0 on hv-cinder-85127 Aug 04 05:17:19.839341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-1adda849-f5c5-48d2-98f0-f60bdf90d4d5 req-36d8bbba-0487-4b6c-9336-2162ee8eb4d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040985 Aug 04 05:17:19.840234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1217/2433] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:17:21.621428 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=6 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:21.626031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ff117552-18f7-478a-8e82-75ea720e2eb4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:21.626566 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ff117552-18f7-478a-8e82-75ea720e2eb4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:21.633890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ff117552-18f7-478a-8e82-75ea720e2eb4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:21.634347 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ff117552-18f7-478a-8e82-75ea720e2eb4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:21.635110 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ff117552-18f7-478a-8e82-75ea720e2eb4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:21.635552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ff117552-18f7-478a-8e82-75ea720e2eb4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:21.661145 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ff117552-18f7-478a-8e82-75ea720e2eb4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Going to try to terminate instance {{(pid=134884) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:17:21.736023 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ff117552-18f7-478a-8e82-75ea720e2eb4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 204 len: 0 microversion: 2.1 time: 0.115171 Aug 04 05:17:21.736713 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1217/2434] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 05:17:21 2022] DELETE /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:17:21.747836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d287e143-8e04-4ab0-82c4-407274fe7dba tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:21.748524 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d287e143-8e04-4ab0-82c4-407274fe7dba tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:21.754964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d287e143-8e04-4ab0-82c4-407274fe7dba tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:21.755463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d287e143-8e04-4ab0-82c4-407274fe7dba tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:21.756198 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d287e143-8e04-4ab0-82c4-407274fe7dba tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:21.756632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d287e143-8e04-4ab0-82c4-407274fe7dba tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:21.902936 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d287e143-8e04-4ab0-82c4-407274fe7dba tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:21.910700 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d287e143-8e04-4ab0-82c4-407274fe7dba tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1578 microversion: 2.1 time: 0.168571 Aug 04 05:17:21.911260 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1218/2435] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:21 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:22.934202 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3b7fd625-641e-4b28-81a2-f5f2410d314e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:22.934889 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3b7fd625-641e-4b28-81a2-f5f2410d314e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:22.941288 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3b7fd625-641e-4b28-81a2-f5f2410d314e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:22.941776 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3b7fd625-641e-4b28-81a2-f5f2410d314e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:22.942533 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3b7fd625-641e-4b28-81a2-f5f2410d314e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:22.942972 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3b7fd625-641e-4b28-81a2-f5f2410d314e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:23.077137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3b7fd625-641e-4b28-81a2-f5f2410d314e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:23.084805 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3b7fd625-641e-4b28-81a2-f5f2410d314e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1578 microversion: 2.1 time: 0.155488 Aug 04 05:17:23.085993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1218/2436] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:22 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:24.059984 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-c3a964ec-58e3-4f20-b332-8db813808bc1 req-2425b3db-499b-4912-9559-56f463148a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd146ac-9a7e-4703-bb98-74e43843451e", "name": "network-vif-deleted", "tag": "95a9dccb-4598-4eb7-84c0-b38f2e41c65c"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:24.072578 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-c3a964ec-58e3-4f20-b332-8db813808bc1 req-2425b3db-499b-4912-9559-56f463148a0e service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:24.073260 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-c3a964ec-58e3-4f20-b332-8db813808bc1 req-2425b3db-499b-4912-9559-56f463148a0e service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:24.085758 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-c3a964ec-58e3-4f20-b332-8db813808bc1 req-2425b3db-499b-4912-9559-56f463148a0e service nova] Creating event network-vif-deleted:95a9dccb-4598-4eb7-84c0-b38f2e41c65c for instance 8bd146ac-9a7e-4703-bb98-74e43843451e on hv-cinder-85127 Aug 04 05:17:24.091810 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-c3a964ec-58e3-4f20-b332-8db813808bc1 req-2425b3db-499b-4912-9559-56f463148a0e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036424 Aug 04 05:17:24.092415 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1219/2437] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:17:24.106611 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5b566742-201f-469f-9352-3468ad0fa57c tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:24.107243 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5b566742-201f-469f-9352-3468ad0fa57c tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:24.114177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5b566742-201f-469f-9352-3468ad0fa57c tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:24.114630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5b566742-201f-469f-9352-3468ad0fa57c tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:24.115410 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5b566742-201f-469f-9352-3468ad0fa57c tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:24.115853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5b566742-201f-469f-9352-3468ad0fa57c tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:24.190909 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5b566742-201f-469f-9352-3468ad0fa57c tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:24.199210 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5b566742-201f-469f-9352-3468ad0fa57c tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 200 len: 1226 microversion: 2.1 time: 0.096682 Aug 04 05:17:24.199791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1219/2438] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:24 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:25.221561 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-22e3b233-8a11-4a7e-b3c9-df43daf5e02d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:25.222275 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-22e3b233-8a11-4a7e-b3c9-df43daf5e02d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:25.229506 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-22e3b233-8a11-4a7e-b3c9-df43daf5e02d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:25.229982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-22e3b233-8a11-4a7e-b3c9-df43daf5e02d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:25.230740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-22e3b233-8a11-4a7e-b3c9-df43daf5e02d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:25.231177 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-22e3b233-8a11-4a7e-b3c9-df43daf5e02d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:25.244837 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-22e3b233-8a11-4a7e-b3c9-df43daf5e02d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] HTTP exception thrown: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-22e3b233-8a11-4a7e-b3c9-df43daf5e02d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Request method failure captured: Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e HTTP/1.1 Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi61WsLPOTQu-M3Dbssy7s6eRo314qI3D_BmYaqNCeAhG2qCzyvrjGR6JVVpTRbSFFgMKYQDv--X8QFUuLfOxuohH4jspMA1IslNCQhX4Pq9tLPI7erkE8xXkocHnqbkEVPuTm40ReuTwSUMQzpDwsGgRjOJF6AuJsKS6KQSYaYIpf8eo Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 731637c0b96a4f1f8d9edb1af69e98cb Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:17:25.246471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:17:25.247593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_731637c0b96a4f1f8d9edb1af69e98cb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:17:25.247593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:17:25.247593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 731637c0b96a4f1f8d9edb1af69e98cb Aug 04 05:17:25.247593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:17:25.247593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-TestVolumeBootPattern-1698193638-project Aug 04 05:17:25.247593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:17:25.247593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:17:25.247593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 30c0ff27c5a84ebd8615fb4608fc3882 Aug 04 05:17:25.247593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-TestVolumeBootPattern-1698193638-project Aug 04 05:17:25.247593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 05:17:25.247593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:17:25.247593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': '8bd146ac-9a7e-4703-bb98-74e43843451e'} Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:17:25.248233 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:17:25.249320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:17:25.250244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-22e3b233-8a11-4a7e-b3c9-df43daf5e02d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Returning 404 to user: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:17:25.250244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-22e3b233-8a11-4a7e-b3c9-df43daf5e02d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 404 len: 111 microversion: 2.1 time: 0.030552 Aug 04 05:17:25.250244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1220/2439] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:25 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:17:25.355285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-908776957", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1187330075", "security_groups": [{"name": "tempest-secgroup-smoke-1777883312"}], "block_device_mapping_v2": [{"uuid": "9ea3a266-5226-48a1-8d9e-cbe901b3578a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "863cf01d-dc84-403c-86c5-61b4b6d33a3b"}]}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:25.471582 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.network.neutron [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] validate_networks() for [('863cf01d-dc84-403c-86c5-61b4b6d33a3b', None, None, None, None, None)] {{(pid=134884) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:17:25.834406 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Flavor limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:17:25.834826 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Image limits 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:17:25.835292 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Flavor pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:17:25.836032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Image pref 0:0:0 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:17:25.836143 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.virt.hardware [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:17:25.844795 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:25.845238 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:25.846058 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:25.846490 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:25.872589 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Getting quotas for project 731637c0b96a4f1f8d9edb1af69e98cb. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:17:25.876538 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.quota [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Getting quotas for user 30c0ff27c5a84ebd8615fb4608fc3882 and project 731637c0b96a4f1f8d9edb1af69e98cb. Resources: {'ram', 'cores', 'instances'} {{(pid=134884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:17:25.934484 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Going to run 1 instances... {{(pid=134884) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:17:25.936532 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ea3a266-5226-48a1-8d9e-cbe901b3578a',volume_size=None,volume_type=None)] {{(pid=134884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:17:26.063366 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4cd2c543-b88b-481b-bbe0-da7662049bd7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712998 Aug 04 05:17:26.064008 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1220/2440] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 05:17:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:17:26.074793 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d8bd07e7-5b58-4fc6-b231-72fe9134aedc tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:26.075405 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d8bd07e7-5b58-4fc6-b231-72fe9134aedc tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:26.129294 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d8bd07e7-5b58-4fc6-b231-72fe9134aedc tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:26.136238 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d8bd07e7-5b58-4fc6-b231-72fe9134aedc tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1094 microversion: 2.1 time: 0.065215 Aug 04 05:17:26.136799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1221/2441] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:26 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:27.158909 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ba45f188-c435-4864-a28f-23ab32816908 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:27.159540 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ba45f188-c435-4864-a28f-23ab32816908 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:27.166735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba45f188-c435-4864-a28f-23ab32816908 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:27.167189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba45f188-c435-4864-a28f-23ab32816908 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:27.167960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba45f188-c435-4864-a28f-23ab32816908 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:27.168401 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ba45f188-c435-4864-a28f-23ab32816908 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:27.186890 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:27.248659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ba45f188-c435-4864-a28f-23ab32816908 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:27.262952 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ba45f188-c435-4864-a28f-23ab32816908 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1210 microversion: 2.1 time: 0.107980 Aug 04 05:17:27.264002 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1221/2442] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:27 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:28.295685 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bc21aa5b-5a91-4c12-bd8d-cd4044d240c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:28.296855 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-bc21aa5b-5a91-4c12-bd8d-cd4044d240c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:28.306122 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bc21aa5b-5a91-4c12-bd8d-cd4044d240c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:28.306582 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bc21aa5b-5a91-4c12-bd8d-cd4044d240c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:28.307350 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bc21aa5b-5a91-4c12-bd8d-cd4044d240c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:28.307938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bc21aa5b-5a91-4c12-bd8d-cd4044d240c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:28.324442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-ea71d2a4-fe56-4b08-ab5e-4bd586545969 req-b0067796-f200-4a1b-9705-b0e46b36337b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc11b935-45b3-44f8-9ae7-2337626e4bfe", "tag": "7e816285-de19-41d3-9d24-e689ba4e635b"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:28.338185 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-ea71d2a4-fe56-4b08-ab5e-4bd586545969 req-b0067796-f200-4a1b-9705-b0e46b36337b service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:28.339112 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-ea71d2a4-fe56-4b08-ab5e-4bd586545969 req-b0067796-f200-4a1b-9705-b0e46b36337b service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:28.351998 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-ea71d2a4-fe56-4b08-ab5e-4bd586545969 req-b0067796-f200-4a1b-9705-b0e46b36337b service nova] Creating event network-changed:7e816285-de19-41d3-9d24-e689ba4e635b for instance dc11b935-45b3-44f8-9ae7-2337626e4bfe on hv-cinder-85127 Aug 04 05:17:28.357267 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-ea71d2a4-fe56-4b08-ab5e-4bd586545969 req-b0067796-f200-4a1b-9705-b0e46b36337b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036505 Aug 04 05:17:28.358081 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1222/2443] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:17:28.574361 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-bc21aa5b-5a91-4c12-bd8d-cd4044d240c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:28.581892 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-bc21aa5b-5a91-4c12-bd8d-cd4044d240c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1266 microversion: 2.1 time: 0.290620 Aug 04 05:17:28.582482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1222/2444] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:28 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:29.605095 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9a9d3aab-6989-4a52-b427-0e9f9afd4496 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:29.605847 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9a9d3aab-6989-4a52-b427-0e9f9afd4496 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:29.611991 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a9d3aab-6989-4a52-b427-0e9f9afd4496 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:29.612439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a9d3aab-6989-4a52-b427-0e9f9afd4496 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:29.613200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a9d3aab-6989-4a52-b427-0e9f9afd4496 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:29.613660 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a9d3aab-6989-4a52-b427-0e9f9afd4496 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:29.851100 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9a9d3aab-6989-4a52-b427-0e9f9afd4496 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:29.858560 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9a9d3aab-6989-4a52-b427-0e9f9afd4496 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1266 microversion: 2.1 time: 0.258757 Aug 04 05:17:29.859128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1223/2445] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:29 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:17:30.879549 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-16d96bcb-efa6-41c6-8022-aa7a2377a138 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:30.880166 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-16d96bcb-efa6-41c6-8022-aa7a2377a138 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:30.883566 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:30.888934 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-16d96bcb-efa6-41c6-8022-aa7a2377a138 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:30.889387 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-16d96bcb-efa6-41c6-8022-aa7a2377a138 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:30.890179 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-16d96bcb-efa6-41c6-8022-aa7a2377a138 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:30.890622 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-16d96bcb-efa6-41c6-8022-aa7a2377a138 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:30.895328 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:31.028220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-16d96bcb-efa6-41c6-8022-aa7a2377a138 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:31.035829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-16d96bcb-efa6-41c6-8022-aa7a2377a138 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1266 microversion: 2.1 time: 0.159843 Aug 04 05:17:31.036376 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1223/2446] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:30 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:32.056825 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2ff98d26-dfbf-4f35-b101-74d8ec3aac72 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:32.057455 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2ff98d26-dfbf-4f35-b101-74d8ec3aac72 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:32.059907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:32.065806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2ff98d26-dfbf-4f35-b101-74d8ec3aac72 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:32.066286 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2ff98d26-dfbf-4f35-b101-74d8ec3aac72 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:32.067035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2ff98d26-dfbf-4f35-b101-74d8ec3aac72 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:32.067466 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2ff98d26-dfbf-4f35-b101-74d8ec3aac72 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:32.210406 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2ff98d26-dfbf-4f35-b101-74d8ec3aac72 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:32.218422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2ff98d26-dfbf-4f35-b101-74d8ec3aac72 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1266 microversion: 2.1 time: 0.165428 Aug 04 05:17:32.218996 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1224/2447] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:32 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:33.239292 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-280c1e9b-d66f-4c39-aee1-34a2bf2a0d20 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:33.239907 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-280c1e9b-d66f-4c39-aee1-34a2bf2a0d20 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:33.246905 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-280c1e9b-d66f-4c39-aee1-34a2bf2a0d20 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:33.247354 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-280c1e9b-d66f-4c39-aee1-34a2bf2a0d20 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:33.248112 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-280c1e9b-d66f-4c39-aee1-34a2bf2a0d20 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:33.248546 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-280c1e9b-d66f-4c39-aee1-34a2bf2a0d20 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:33.414118 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-280c1e9b-d66f-4c39-aee1-34a2bf2a0d20 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:33.421952 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-280c1e9b-d66f-4c39-aee1-34a2bf2a0d20 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1266 microversion: 2.1 time: 0.186480 Aug 04 05:17:33.422528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1224/2448] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:33 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:34.442694 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3da18124-cefc-4258-bb0f-92d40f6dea86 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:34.443462 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3da18124-cefc-4258-bb0f-92d40f6dea86 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:34.449992 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3da18124-cefc-4258-bb0f-92d40f6dea86 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:34.450446 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3da18124-cefc-4258-bb0f-92d40f6dea86 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:34.451223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3da18124-cefc-4258-bb0f-92d40f6dea86 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:34.451756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3da18124-cefc-4258-bb0f-92d40f6dea86 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:34.599178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3da18124-cefc-4258-bb0f-92d40f6dea86 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:34.608177 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3da18124-cefc-4258-bb0f-92d40f6dea86 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1266 microversion: 2.1 time: 0.169293 Aug 04 05:17:34.608748 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1225/2449] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:34 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:35.629245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-6468dce8-3295-4870-8ebb-5119d295c273 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:35.629884 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-6468dce8-3295-4870-8ebb-5119d295c273 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:35.636433 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6468dce8-3295-4870-8ebb-5119d295c273 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:35.636881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6468dce8-3295-4870-8ebb-5119d295c273 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:35.637660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6468dce8-3295-4870-8ebb-5119d295c273 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:35.638092 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-6468dce8-3295-4870-8ebb-5119d295c273 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:35.768787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-6468dce8-3295-4870-8ebb-5119d295c273 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:35.776299 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-6468dce8-3295-4870-8ebb-5119d295c273 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1266 microversion: 2.1 time: 0.150840 Aug 04 05:17:35.776860 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1225/2450] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:35 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:36.797656 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d78a5c75-94f6-4e22-91be-eb64b81e4d16 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:36.798269 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d78a5c75-94f6-4e22-91be-eb64b81e4d16 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:36.800518 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:36.801165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=6 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:36.807835 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d78a5c75-94f6-4e22-91be-eb64b81e4d16 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:36.808286 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d78a5c75-94f6-4e22-91be-eb64b81e4d16 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:36.809041 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d78a5c75-94f6-4e22-91be-eb64b81e4d16 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:36.809476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d78a5c75-94f6-4e22-91be-eb64b81e4d16 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:36.942439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d78a5c75-94f6-4e22-91be-eb64b81e4d16 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:36.950730 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d78a5c75-94f6-4e22-91be-eb64b81e4d16 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1266 microversion: 2.1 time: 0.156997 Aug 04 05:17:36.951290 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1226/2451] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:36 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:37.971617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-51581f9e-3b7c-4345-b75f-c17e8f2f8265 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:37.972262 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-51581f9e-3b7c-4345-b75f-c17e8f2f8265 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:37.974120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:17:37.980305 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-51581f9e-3b7c-4345-b75f-c17e8f2f8265 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:37.980757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-51581f9e-3b7c-4345-b75f-c17e8f2f8265 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:37.981520 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-51581f9e-3b7c-4345-b75f-c17e8f2f8265 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:37.981981 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-51581f9e-3b7c-4345-b75f-c17e8f2f8265 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:38.111803 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-51581f9e-3b7c-4345-b75f-c17e8f2f8265 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:38.119322 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-51581f9e-3b7c-4345-b75f-c17e8f2f8265 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1266 microversion: 2.1 time: 0.151512 Aug 04 05:17:38.119881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1226/2452] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:37 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:39.140519 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9cd2c1e0-28e7-4771-a6d8-41385ecc30d2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:39.141045 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9cd2c1e0-28e7-4771-a6d8-41385ecc30d2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:39.148230 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9cd2c1e0-28e7-4771-a6d8-41385ecc30d2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:39.148678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9cd2c1e0-28e7-4771-a6d8-41385ecc30d2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:39.149433 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9cd2c1e0-28e7-4771-a6d8-41385ecc30d2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:39.149887 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9cd2c1e0-28e7-4771-a6d8-41385ecc30d2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:39.282548 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9cd2c1e0-28e7-4771-a6d8-41385ecc30d2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:39.290547 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9cd2c1e0-28e7-4771-a6d8-41385ecc30d2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1266 microversion: 2.1 time: 0.154048 Aug 04 05:17:39.291119 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1227/2453] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:39 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:40.311835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d4d90381-6655-4bae-a5f3-d776574cd4f1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:40.312452 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d4d90381-6655-4bae-a5f3-d776574cd4f1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:40.319022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d4d90381-6655-4bae-a5f3-d776574cd4f1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:40.319501 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d4d90381-6655-4bae-a5f3-d776574cd4f1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:40.320252 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d4d90381-6655-4bae-a5f3-d776574cd4f1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:40.320682 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d4d90381-6655-4bae-a5f3-d776574cd4f1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:40.461892 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d4d90381-6655-4bae-a5f3-d776574cd4f1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:40.469313 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d4d90381-6655-4bae-a5f3-d776574cd4f1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1266 microversion: 2.1 time: 0.161274 Aug 04 05:17:40.469934 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1227/2454] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:40 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:40.500021 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-53b54e4d-e569-4fd4-ac59-25907afb13eb req-3c641cc4-9b47-4077-b52f-7b0252ef4ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc11b935-45b3-44f8-9ae7-2337626e4bfe", "name": "network-vif-plugged", "status": "completed", "tag": "7e816285-de19-41d3-9d24-e689ba4e635b"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:40.516369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-53b54e4d-e569-4fd4-ac59-25907afb13eb req-3c641cc4-9b47-4077-b52f-7b0252ef4ccc service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:40.517137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-53b54e4d-e569-4fd4-ac59-25907afb13eb req-3c641cc4-9b47-4077-b52f-7b0252ef4ccc service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:40.532703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-53b54e4d-e569-4fd4-ac59-25907afb13eb req-3c641cc4-9b47-4077-b52f-7b0252ef4ccc service nova] Creating event network-vif-plugged:7e816285-de19-41d3-9d24-e689ba4e635b for instance dc11b935-45b3-44f8-9ae7-2337626e4bfe on hv-cinder-85127 Aug 04 05:17:40.538494 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-53b54e4d-e569-4fd4-ac59-25907afb13eb req-3c641cc4-9b47-4077-b52f-7b0252ef4ccc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043091 Aug 04 05:17:40.539503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1228/2455] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:17:41.490965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c2f224f9-e2a2-4e23-a1d2-aca2d3bc083a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:41.491554 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c2f224f9-e2a2-4e23-a1d2-aca2d3bc083a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:41.498871 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c2f224f9-e2a2-4e23-a1d2-aca2d3bc083a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:41.499329 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c2f224f9-e2a2-4e23-a1d2-aca2d3bc083a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:41.500073 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c2f224f9-e2a2-4e23-a1d2-aca2d3bc083a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:41.500503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c2f224f9-e2a2-4e23-a1d2-aca2d3bc083a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:41.635071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c2f224f9-e2a2-4e23-a1d2-aca2d3bc083a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:41.642624 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c2f224f9-e2a2-4e23-a1d2-aca2d3bc083a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1266 microversion: 2.1 time: 0.155508 Aug 04 05:17:41.643186 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1228/2456] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:41 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:42.664746 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7efe5819-b9c0-4ec0-a1b1-90b2317287b9 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:42.665476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7efe5819-b9c0-4ec0-a1b1-90b2317287b9 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:42.671740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7efe5819-b9c0-4ec0-a1b1-90b2317287b9 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:42.672192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7efe5819-b9c0-4ec0-a1b1-90b2317287b9 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:42.672947 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7efe5819-b9c0-4ec0-a1b1-90b2317287b9 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:42.673381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7efe5819-b9c0-4ec0-a1b1-90b2317287b9 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:42.808573 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7efe5819-b9c0-4ec0-a1b1-90b2317287b9 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:42.816146 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7efe5819-b9c0-4ec0-a1b1-90b2317287b9 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1452 microversion: 2.1 time: 0.156466 Aug 04 05:17:42.816712 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1229/2457] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:42 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:42.837144 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b6f66221-5b21-42d7-be01-30025bdc9c8b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:17:42.837859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b6f66221-5b21-42d7-be01-30025bdc9c8b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:17:42.844530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6f66221-5b21-42d7-be01-30025bdc9c8b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:42.845213 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6f66221-5b21-42d7-be01-30025bdc9c8b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:42.846197 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6f66221-5b21-42d7-be01-30025bdc9c8b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:42.846647 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b6f66221-5b21-42d7-be01-30025bdc9c8b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:42.984172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b6f66221-5b21-42d7-be01-30025bdc9c8b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:17:42.992389 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b6f66221-5b21-42d7-be01-30025bdc9c8b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1452 microversion: 2.1 time: 0.159117 Aug 04 05:17:42.992972 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1229/2458] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:17:42 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:17:44.683080 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-bbb15a51-0ade-4004-96de-a6ac1a2d5f16 req-9ac46020-ffb3-4a85-b0d3-6c5daae5d21f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc11b935-45b3-44f8-9ae7-2337626e4bfe", "tag": "7e816285-de19-41d3-9d24-e689ba4e635b"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:17:44.693390 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-bbb15a51-0ade-4004-96de-a6ac1a2d5f16 req-9ac46020-ffb3-4a85-b0d3-6c5daae5d21f service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:17:44.693867 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-bbb15a51-0ade-4004-96de-a6ac1a2d5f16 req-9ac46020-ffb3-4a85-b0d3-6c5daae5d21f service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:17:44.705348 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-bbb15a51-0ade-4004-96de-a6ac1a2d5f16 req-9ac46020-ffb3-4a85-b0d3-6c5daae5d21f service nova] Creating event network-changed:7e816285-de19-41d3-9d24-e689ba4e635b for instance dc11b935-45b3-44f8-9ae7-2337626e4bfe on hv-cinder-85127 Aug 04 05:17:44.711273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-bbb15a51-0ade-4004-96de-a6ac1a2d5f16 req-9ac46020-ffb3-4a85-b0d3-6c5daae5d21f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031903 Aug 04 05:17:44.711989 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1230/2459] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:19.357577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=13 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:19.358341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=41 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:19.362852 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-80071b23-a65e-434e-bb00-1c59f889d72a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:19.363409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-80071b23-a65e-434e-bb00-1c59f889d72a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:19.370776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80071b23-a65e-434e-bb00-1c59f889d72a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:19.371220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80071b23-a65e-434e-bb00-1c59f889d72a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:19.371974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80071b23-a65e-434e-bb00-1c59f889d72a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:19.372414 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-80071b23-a65e-434e-bb00-1c59f889d72a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:19.396050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-80071b23-a65e-434e-bb00-1c59f889d72a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lazy-loading 'flavor' on Instance uuid bd63e685-c924-4940-ba66-4128dead0a60 {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:18:19.485321 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-80071b23-a65e-434e-bb00-1c59f889d72a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "POST /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60/action" status: 202 len: 0 microversion: 2.1 time: 0.128613 Aug 04 05:18:19.485974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1230/2460] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 05:18:19 2022] POST /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:18:19.497399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-36e782e5-4f92-4fe3-bbd1-8ece658d95b5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:19.498154 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-36e782e5-4f92-4fe3-bbd1-8ece658d95b5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:19.501481 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=13 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:19.502156 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=44 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:19.507756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-36e782e5-4f92-4fe3-bbd1-8ece658d95b5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:19.507756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-36e782e5-4f92-4fe3-bbd1-8ece658d95b5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:19.508326 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-36e782e5-4f92-4fe3-bbd1-8ece658d95b5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:19.508815 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-36e782e5-4f92-4fe3-bbd1-8ece658d95b5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:19.659826 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-36e782e5-4f92-4fe3-bbd1-8ece658d95b5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:19.668366 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-36e782e5-4f92-4fe3-bbd1-8ece658d95b5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1566 microversion: 2.1 time: 0.175314 Aug 04 05:18:19.668939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1231/2461] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:19 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:18:20.692759 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-143ab1a9-f954-42b7-a1a6-714282fb5767 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:20.693487 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-143ab1a9-f954-42b7-a1a6-714282fb5767 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:20.702796 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-143ab1a9-f954-42b7-a1a6-714282fb5767 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:20.703244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-143ab1a9-f954-42b7-a1a6-714282fb5767 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:20.704017 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-143ab1a9-f954-42b7-a1a6-714282fb5767 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:20.704448 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-143ab1a9-f954-42b7-a1a6-714282fb5767 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:20.858289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-143ab1a9-f954-42b7-a1a6-714282fb5767 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:20.867878 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-143ab1a9-f954-42b7-a1a6-714282fb5767 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1566 microversion: 2.1 time: 0.179867 Aug 04 05:18:20.868482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1231/2462] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:20 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:21.889702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-5a8f94aa-2bc0-40e7-ad16-b64deb99e216 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:21.890337 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-5a8f94aa-2bc0-40e7-ad16-b64deb99e216 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:21.896923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a8f94aa-2bc0-40e7-ad16-b64deb99e216 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:21.897362 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a8f94aa-2bc0-40e7-ad16-b64deb99e216 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:21.898151 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a8f94aa-2bc0-40e7-ad16-b64deb99e216 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:21.898587 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-5a8f94aa-2bc0-40e7-ad16-b64deb99e216 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:22.043384 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-5a8f94aa-2bc0-40e7-ad16-b64deb99e216 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:22.051126 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-5a8f94aa-2bc0-40e7-ad16-b64deb99e216 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1566 microversion: 2.1 time: 0.165369 Aug 04 05:18:22.051690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1232/2463] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:21 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:22.560982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-736f99c0-0254-497e-ab38-681581014df1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:22.561563 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-736f99c0-0254-497e-ab38-681581014df1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:22.569421 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-736f99c0-0254-497e-ab38-681581014df1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:22.569890 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-736f99c0-0254-497e-ab38-681581014df1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:22.570663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-736f99c0-0254-497e-ab38-681581014df1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:22.571093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-736f99c0-0254-497e-ab38-681581014df1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:22.594454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-736f99c0-0254-497e-ab38-681581014df1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/ips" status: 200 len: 153 microversion: 2.20 time: 0.037374 Aug 04 05:18:22.595031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1232/2464] 10.222.0.47 () {60 vars in 1289 bytes} [Thu Aug 4 05:18:22 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 05:18:23.073791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0f46890b-99bf-4c5a-8518-b631c3d84281 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:23.074394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0f46890b-99bf-4c5a-8518-b631c3d84281 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:23.081089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f46890b-99bf-4c5a-8518-b631c3d84281 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:23.081535 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f46890b-99bf-4c5a-8518-b631c3d84281 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:23.082323 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f46890b-99bf-4c5a-8518-b631c3d84281 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:23.082753 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f46890b-99bf-4c5a-8518-b631c3d84281 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:23.230126 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0f46890b-99bf-4c5a-8518-b631c3d84281 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:23.238215 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0f46890b-99bf-4c5a-8518-b631c3d84281 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1566 microversion: 2.1 time: 0.168242 Aug 04 05:18:23.238818 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1233/2465] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:23 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:24.261593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f3c16cfe-9f08-4352-952a-e4d72ea3d733 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:24.262116 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f3c16cfe-9f08-4352-952a-e4d72ea3d733 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:24.268647 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f3c16cfe-9f08-4352-952a-e4d72ea3d733 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:24.269093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f3c16cfe-9f08-4352-952a-e4d72ea3d733 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:24.270717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f3c16cfe-9f08-4352-952a-e4d72ea3d733 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:24.270717 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f3c16cfe-9f08-4352-952a-e4d72ea3d733 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:24.418482 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f3c16cfe-9f08-4352-952a-e4d72ea3d733 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:24.432392 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f3c16cfe-9f08-4352-952a-e4d72ea3d733 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1566 microversion: 2.1 time: 0.174347 Aug 04 05:18:24.433295 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1233/2466] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:24 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:18:24.476140 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-858d51b6-58ea-4cbb-9f97-a38aed2a2e1f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:24.476721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-858d51b6-58ea-4cbb-9f97-a38aed2a2e1f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:24.484786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-858d51b6-58ea-4cbb-9f97-a38aed2a2e1f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:24.485243 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-858d51b6-58ea-4cbb-9f97-a38aed2a2e1f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:24.486060 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-858d51b6-58ea-4cbb-9f97-a38aed2a2e1f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:24.486504 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-858d51b6-58ea-4cbb-9f97-a38aed2a2e1f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:24.517313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.objects.instance [None req-858d51b6-58ea-4cbb-9f97-a38aed2a2e1f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lazy-loading 'flavor' on Instance uuid 55a20351-3bba-4e9f-9291-141d8db265c0 {{(pid=134884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:18:24.772211 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-858d51b6-58ea-4cbb-9f97-a38aed2a2e1f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "POST /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/action" status: 202 len: 0 microversion: 2.20 time: 0.299997 Aug 04 05:18:24.772747 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1234/2467] 10.222.0.47 () {62 vars in 1319 bytes} [Thu Aug 4 05:18:24 2022] POST /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 05:18:24.780835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a0ec77db-f680-4962-bf6e-980377dafb88 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:24.781567 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a0ec77db-f680-4962-bf6e-980377dafb88 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:24.789253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0ec77db-f680-4962-bf6e-980377dafb88 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:24.789454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0ec77db-f680-4962-bf6e-980377dafb88 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:24.790228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0ec77db-f680-4962-bf6e-980377dafb88 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:24.790673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a0ec77db-f680-4962-bf6e-980377dafb88 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:24.937278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a0ec77db-f680-4962-bf6e-980377dafb88 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:24.945663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a0ec77db-f680-4962-bf6e-980377dafb88 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:24.947159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a0ec77db-f680-4962-bf6e-980377dafb88 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:24.948341 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a0ec77db-f680-4962-bf6e-980377dafb88 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.171399 Aug 04 05:18:24.948897 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1234/2468] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:24 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:25.454955 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-66a65e80-1868-4c77-94c1-a92d95d0dc3f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:25.455646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-66a65e80-1868-4c77-94c1-a92d95d0dc3f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:25.463389 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66a65e80-1868-4c77-94c1-a92d95d0dc3f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:25.463843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66a65e80-1868-4c77-94c1-a92d95d0dc3f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:25.465385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66a65e80-1868-4c77-94c1-a92d95d0dc3f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:25.465385 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66a65e80-1868-4c77-94c1-a92d95d0dc3f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:25.596635 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-66a65e80-1868-4c77-94c1-a92d95d0dc3f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:25.608867 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-66a65e80-1868-4c77-94c1-a92d95d0dc3f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1566 microversion: 2.1 time: 0.158069 Aug 04 05:18:25.609440 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1235/2469] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:25 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:25.972528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c7344989-34a4-4bb5-90ba-39d79c58b108 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:25.973039 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c7344989-34a4-4bb5-90ba-39d79c58b108 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:25.980278 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7344989-34a4-4bb5-90ba-39d79c58b108 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:25.980731 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7344989-34a4-4bb5-90ba-39d79c58b108 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:25.981494 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7344989-34a4-4bb5-90ba-39d79c58b108 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:25.981964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c7344989-34a4-4bb5-90ba-39d79c58b108 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:26.122605 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c7344989-34a4-4bb5-90ba-39d79c58b108 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:26.134099 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c7344989-34a4-4bb5-90ba-39d79c58b108 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:26.135618 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c7344989-34a4-4bb5-90ba-39d79c58b108 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:26.136794 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c7344989-34a4-4bb5-90ba-39d79c58b108 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.168242 Aug 04 05:18:26.137344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1235/2470] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:25 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:26.630544 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-138b3c58-7c55-4270-936f-f0b76d5b3438 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:26.631154 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-138b3c58-7c55-4270-936f-f0b76d5b3438 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:26.637630 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-138b3c58-7c55-4270-936f-f0b76d5b3438 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:26.638067 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-138b3c58-7c55-4270-936f-f0b76d5b3438 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:26.638811 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-138b3c58-7c55-4270-936f-f0b76d5b3438 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:26.639240 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-138b3c58-7c55-4270-936f-f0b76d5b3438 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:26.775964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-138b3c58-7c55-4270-936f-f0b76d5b3438 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:26.784232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-138b3c58-7c55-4270-936f-f0b76d5b3438 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1566 microversion: 2.1 time: 0.157730 Aug 04 05:18:26.785070 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1236/2471] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:26 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:27.159949 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-26815b83-573e-428c-90d6-9fcaa728c424 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:27.160604 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-26815b83-573e-428c-90d6-9fcaa728c424 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:27.167596 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26815b83-573e-428c-90d6-9fcaa728c424 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:27.168054 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26815b83-573e-428c-90d6-9fcaa728c424 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:27.168836 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26815b83-573e-428c-90d6-9fcaa728c424 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:27.169276 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-26815b83-573e-428c-90d6-9fcaa728c424 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:27.310065 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-26815b83-573e-428c-90d6-9fcaa728c424 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:27.319285 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-26815b83-573e-428c-90d6-9fcaa728c424 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:27.320804 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-26815b83-573e-428c-90d6-9fcaa728c424 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:27.322078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-26815b83-573e-428c-90d6-9fcaa728c424 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.166328 Aug 04 05:18:27.322649 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1236/2472] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:27 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:27.805857 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a50060d7-c224-41fa-99fe-8061ddb057bd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:27.806445 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a50060d7-c224-41fa-99fe-8061ddb057bd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:27.813051 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a50060d7-c224-41fa-99fe-8061ddb057bd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:27.813500 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a50060d7-c224-41fa-99fe-8061ddb057bd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:27.814279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a50060d7-c224-41fa-99fe-8061ddb057bd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:27.814704 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a50060d7-c224-41fa-99fe-8061ddb057bd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:27.953263 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a50060d7-c224-41fa-99fe-8061ddb057bd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:27.962415 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a50060d7-c224-41fa-99fe-8061ddb057bd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1566 microversion: 2.1 time: 0.160440 Aug 04 05:18:27.963114 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1237/2473] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:27 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:28.345353 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-72a33cba-b392-40b4-8db8-2bc9b850acb6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:28.345987 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-72a33cba-b392-40b4-8db8-2bc9b850acb6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:28.352518 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72a33cba-b392-40b4-8db8-2bc9b850acb6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:28.352963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72a33cba-b392-40b4-8db8-2bc9b850acb6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:28.353750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72a33cba-b392-40b4-8db8-2bc9b850acb6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:28.354182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-72a33cba-b392-40b4-8db8-2bc9b850acb6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:28.507963 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-72a33cba-b392-40b4-8db8-2bc9b850acb6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:28.516757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-72a33cba-b392-40b4-8db8-2bc9b850acb6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:28.518303 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-72a33cba-b392-40b4-8db8-2bc9b850acb6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:28.519503 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-72a33cba-b392-40b4-8db8-2bc9b850acb6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.178172 Aug 04 05:18:28.520059 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1237/2474] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:28 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:28.986159 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7db0a025-4d05-44ca-b86e-fff2adfb171e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:28.986872 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7db0a025-4d05-44ca-b86e-fff2adfb171e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:28.994193 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7db0a025-4d05-44ca-b86e-fff2adfb171e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:28.994640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7db0a025-4d05-44ca-b86e-fff2adfb171e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:28.995438 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7db0a025-4d05-44ca-b86e-fff2adfb171e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:28.995904 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7db0a025-4d05-44ca-b86e-fff2adfb171e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:29.159916 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-7db0a025-4d05-44ca-b86e-fff2adfb171e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:29.171317 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7db0a025-4d05-44ca-b86e-fff2adfb171e tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1566 microversion: 2.1 time: 0.189148 Aug 04 05:18:29.171906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1238/2475] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:28 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:29.554552 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-31ebacef-1c38-4a4f-9718-55fa558fd35a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:29.555172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-31ebacef-1c38-4a4f-9718-55fa558fd35a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:29.562199 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31ebacef-1c38-4a4f-9718-55fa558fd35a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:29.562643 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31ebacef-1c38-4a4f-9718-55fa558fd35a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:29.563416 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31ebacef-1c38-4a4f-9718-55fa558fd35a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:29.563851 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31ebacef-1c38-4a4f-9718-55fa558fd35a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:29.707071 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-31ebacef-1c38-4a4f-9718-55fa558fd35a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:29.716160 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-31ebacef-1c38-4a4f-9718-55fa558fd35a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:29.717695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-31ebacef-1c38-4a4f-9718-55fa558fd35a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:29.718887 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-31ebacef-1c38-4a4f-9718-55fa558fd35a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.169021 Aug 04 05:18:29.719444 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1238/2476] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:29 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:30.202933 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-65ab46ad-57b2-49b0-bb95-b94edca73af2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:30.204091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-65ab46ad-57b2-49b0-bb95-b94edca73af2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:30.216084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-65ab46ad-57b2-49b0-bb95-b94edca73af2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:30.216825 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-65ab46ad-57b2-49b0-bb95-b94edca73af2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:30.218168 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-65ab46ad-57b2-49b0-bb95-b94edca73af2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:30.218898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-65ab46ad-57b2-49b0-bb95-b94edca73af2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:30.393382 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-65ab46ad-57b2-49b0-bb95-b94edca73af2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:30.402130 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-65ab46ad-57b2-49b0-bb95-b94edca73af2 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1566 microversion: 2.1 time: 0.206179 Aug 04 05:18:30.402715 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1239/2477] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:30 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:30.754237 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-1819cc3f-649d-4351-8c7e-47b171977a26 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:30.755329 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-1819cc3f-649d-4351-8c7e-47b171977a26 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:30.762677 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1819cc3f-649d-4351-8c7e-47b171977a26 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:30.763057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1819cc3f-649d-4351-8c7e-47b171977a26 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:30.763816 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1819cc3f-649d-4351-8c7e-47b171977a26 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:30.764254 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-1819cc3f-649d-4351-8c7e-47b171977a26 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:30.899589 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1819cc3f-649d-4351-8c7e-47b171977a26 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:30.908073 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1819cc3f-649d-4351-8c7e-47b171977a26 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:30.909881 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-1819cc3f-649d-4351-8c7e-47b171977a26 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:30.911662 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-1819cc3f-649d-4351-8c7e-47b171977a26 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.160879 Aug 04 05:18:30.912237 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1239/2478] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:30 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:31.424998 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f8d64342-f9c4-4a26-858d-54e019b61651 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:31.425643 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f8d64342-f9c4-4a26-858d-54e019b61651 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:31.433525 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8d64342-f9c4-4a26-858d-54e019b61651 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:31.434078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8d64342-f9c4-4a26-858d-54e019b61651 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:31.434928 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8d64342-f9c4-4a26-858d-54e019b61651 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:31.435569 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f8d64342-f9c4-4a26-858d-54e019b61651 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:31.580399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f8d64342-f9c4-4a26-858d-54e019b61651 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:31.588498 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f8d64342-f9c4-4a26-858d-54e019b61651 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1566 microversion: 2.1 time: 0.167327 Aug 04 05:18:31.589289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1240/2479] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:31 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:31.934440 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dcb68420-c010-4a71-a480-a2c7fc5d93d6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:31.935144 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dcb68420-c010-4a71-a480-a2c7fc5d93d6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:31.941597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dcb68420-c010-4a71-a480-a2c7fc5d93d6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:31.942047 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dcb68420-c010-4a71-a480-a2c7fc5d93d6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:31.943610 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dcb68420-c010-4a71-a480-a2c7fc5d93d6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:31.944307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dcb68420-c010-4a71-a480-a2c7fc5d93d6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.081933 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dcb68420-c010-4a71-a480-a2c7fc5d93d6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:32.091471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dcb68420-c010-4a71-a480-a2c7fc5d93d6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:32.092975 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dcb68420-c010-4a71-a480-a2c7fc5d93d6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:32.094169 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dcb68420-c010-4a71-a480-a2c7fc5d93d6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.163682 Aug 04 05:18:32.094810 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1240/2480] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:31 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:32.610392 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0f54a520-1bd9-442b-93a4-803ebcb99436 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:32.611020 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0f54a520-1bd9-442b-93a4-803ebcb99436 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:32.618508 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f54a520-1bd9-442b-93a4-803ebcb99436 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.618961 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f54a520-1bd9-442b-93a4-803ebcb99436 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.619740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f54a520-1bd9-442b-93a4-803ebcb99436 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.620175 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0f54a520-1bd9-442b-93a4-803ebcb99436 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.757820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0f54a520-1bd9-442b-93a4-803ebcb99436 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:32.765383 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0f54a520-1bd9-442b-93a4-803ebcb99436 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1507 microversion: 2.1 time: 0.158822 Aug 04 05:18:32.771449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1241/2481] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:32 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:32.786608 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e0a83f6f-120c-480f-a3f4-0d918385396a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:32.787362 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e0a83f6f-120c-480f-a3f4-0d918385396a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:32.793395 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e0a83f6f-120c-480f-a3f4-0d918385396a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.793953 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e0a83f6f-120c-480f-a3f4-0d918385396a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.794713 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e0a83f6f-120c-480f-a3f4-0d918385396a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.795151 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e0a83f6f-120c-480f-a3f4-0d918385396a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.826772 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e0a83f6f-120c-480f-a3f4-0d918385396a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134883) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 05:18:32.900957 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e0a83f6f-120c-480f-a3f4-0d918385396a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "POST /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60/action" status: 202 len: 0 microversion: 2.1 time: 0.119054 Aug 04 05:18:32.901597 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1241/2482] 10.222.0.47 () {60 vars in 1278 bytes} [Thu Aug 4 05:18:32 2022] POST /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:18:32.910427 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d8148aac-e348-426d-9233-3a9083c90e1c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:32.912551 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d8148aac-e348-426d-9233-3a9083c90e1c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:32.920149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d8148aac-e348-426d-9233-3a9083c90e1c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.920595 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d8148aac-e348-426d-9233-3a9083c90e1c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:32.921373 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d8148aac-e348-426d-9233-3a9083c90e1c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:32.921839 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d8148aac-e348-426d-9233-3a9083c90e1c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:33.086726 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d8148aac-e348-426d-9233-3a9083c90e1c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:33.097015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d8148aac-e348-426d-9233-3a9083c90e1c tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1515 microversion: 2.1 time: 0.191030 Aug 04 05:18:33.097649 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1242/2483] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:32 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:33.120932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-22e6b60d-a8fd-4772-a865-c5087c5c3aea tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:33.120932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-22e6b60d-a8fd-4772-a865-c5087c5c3aea tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:33.126292 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-22e6b60d-a8fd-4772-a865-c5087c5c3aea tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:33.126748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-22e6b60d-a8fd-4772-a865-c5087c5c3aea tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:33.127569 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-22e6b60d-a8fd-4772-a865-c5087c5c3aea tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:33.128012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-22e6b60d-a8fd-4772-a865-c5087c5c3aea tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:33.283593 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-22e6b60d-a8fd-4772-a865-c5087c5c3aea tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:33.293244 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-22e6b60d-a8fd-4772-a865-c5087c5c3aea tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:33.294791 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-22e6b60d-a8fd-4772-a865-c5087c5c3aea tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:33.295978 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-22e6b60d-a8fd-4772-a865-c5087c5c3aea tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.182629 Aug 04 05:18:33.296532 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1242/2484] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:33 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:34.123978 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-57d4b8dd-c91a-46d6-9c4c-56e599c5a31a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:34.124622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-57d4b8dd-c91a-46d6-9c4c-56e599c5a31a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:34.132464 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-57d4b8dd-c91a-46d6-9c4c-56e599c5a31a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:34.132988 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-57d4b8dd-c91a-46d6-9c4c-56e599c5a31a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:34.133753 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-57d4b8dd-c91a-46d6-9c4c-56e599c5a31a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:34.134289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-57d4b8dd-c91a-46d6-9c4c-56e599c5a31a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:34.302394 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-57d4b8dd-c91a-46d6-9c4c-56e599c5a31a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:34.318101 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-57d4b8dd-c91a-46d6-9c4c-56e599c5a31a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1517 microversion: 2.1 time: 0.197257 Aug 04 05:18:34.319091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1243/2485] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:34 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1517 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:18:34.329257 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-2e8a9b1d-09f2-4ee1-b874-b37181b78bb3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:34.329853 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-2e8a9b1d-09f2-4ee1-b874-b37181b78bb3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:34.339602 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2e8a9b1d-09f2-4ee1-b874-b37181b78bb3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:34.340377 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2e8a9b1d-09f2-4ee1-b874-b37181b78bb3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:34.341690 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2e8a9b1d-09f2-4ee1-b874-b37181b78bb3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:34.342157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-2e8a9b1d-09f2-4ee1-b874-b37181b78bb3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:34.514171 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2e8a9b1d-09f2-4ee1-b874-b37181b78bb3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:34.518711 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:34.525529 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2e8a9b1d-09f2-4ee1-b874-b37181b78bb3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:34.536739 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-2e8a9b1d-09f2-4ee1-b874-b37181b78bb3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:34.538225 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-2e8a9b1d-09f2-4ee1-b874-b37181b78bb3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.219978 Aug 04 05:18:34.538913 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1243/2486] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:34 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:35.339750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d996277f-27ab-428f-a778-8eed0892d9a5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:35.340620 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d996277f-27ab-428f-a778-8eed0892d9a5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:35.347753 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d996277f-27ab-428f-a778-8eed0892d9a5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:35.348201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d996277f-27ab-428f-a778-8eed0892d9a5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:35.349032 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d996277f-27ab-428f-a778-8eed0892d9a5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:35.349468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d996277f-27ab-428f-a778-8eed0892d9a5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:35.572338 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-13afc7dd-326a-46cf-b7b9-92587426f7b9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:35.572338 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-13afc7dd-326a-46cf-b7b9-92587426f7b9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:35.579617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13afc7dd-326a-46cf-b7b9-92587426f7b9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:35.580077 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13afc7dd-326a-46cf-b7b9-92587426f7b9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:35.580877 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13afc7dd-326a-46cf-b7b9-92587426f7b9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:35.581318 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-13afc7dd-326a-46cf-b7b9-92587426f7b9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:35.615370 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d996277f-27ab-428f-a778-8eed0892d9a5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:35.639724 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d996277f-27ab-428f-a778-8eed0892d9a5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1573 microversion: 2.1 time: 0.303766 Aug 04 05:18:35.640782 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1244/2487] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:35 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1573 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:35.877131 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-13afc7dd-326a-46cf-b7b9-92587426f7b9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:35.887965 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-13afc7dd-326a-46cf-b7b9-92587426f7b9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:35.889757 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-13afc7dd-326a-46cf-b7b9-92587426f7b9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:35.891127 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-13afc7dd-326a-46cf-b7b9-92587426f7b9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.326125 Aug 04 05:18:35.891733 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1244/2488] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:35 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:18:36.664267 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c27ccbbd-94ac-4493-8f15-2483feb11a4f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:36.664896 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c27ccbbd-94ac-4493-8f15-2483feb11a4f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:36.671921 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c27ccbbd-94ac-4493-8f15-2483feb11a4f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:36.672368 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c27ccbbd-94ac-4493-8f15-2483feb11a4f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:36.673144 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c27ccbbd-94ac-4493-8f15-2483feb11a4f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:36.673601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c27ccbbd-94ac-4493-8f15-2483feb11a4f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:36.700432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:36.835412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-c27ccbbd-94ac-4493-8f15-2483feb11a4f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:36.843135 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c27ccbbd-94ac-4493-8f15-2483feb11a4f tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1573 microversion: 2.1 time: 0.183948 Aug 04 05:18:36.844181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1245/2489] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:36 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1573 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:36.874228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-df08c2ad-fbb8-4b42-a2ef-6de4d789e9cc req-9b1fa1f3-1c86-45ee-b4fd-a95013d3758f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd63e685-c924-4940-ba66-4128dead0a60", "name": "network-vif-unplugged", "status": "completed", "tag": "753b26da-a0d7-412a-b173-7ac7d5ad56de"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:36.887159 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-df08c2ad-fbb8-4b42-a2ef-6de4d789e9cc req-9b1fa1f3-1c86-45ee-b4fd-a95013d3758f service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:36.887675 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-df08c2ad-fbb8-4b42-a2ef-6de4d789e9cc req-9b1fa1f3-1c86-45ee-b4fd-a95013d3758f service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:36.901776 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-df08c2ad-fbb8-4b42-a2ef-6de4d789e9cc req-9b1fa1f3-1c86-45ee-b4fd-a95013d3758f service nova] Creating event network-vif-unplugged:753b26da-a0d7-412a-b173-7ac7d5ad56de for instance bd63e685-c924-4940-ba66-4128dead0a60 on hv-cinder-85127 Aug 04 05:18:36.908565 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-df08c2ad-fbb8-4b42-a2ef-6de4d789e9cc req-9b1fa1f3-1c86-45ee-b4fd-a95013d3758f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037775 Aug 04 05:18:36.909807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1245/2490] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:18:36.925381 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-2f0af3da-edc0-46a7-9ef4-35a11cc8c2e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:36.926107 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-2f0af3da-edc0-46a7-9ef4-35a11cc8c2e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:36.932441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f0af3da-edc0-46a7-9ef4-35a11cc8c2e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:36.932896 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f0af3da-edc0-46a7-9ef4-35a11cc8c2e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:36.933719 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f0af3da-edc0-46a7-9ef4-35a11cc8c2e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:36.934163 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-2f0af3da-edc0-46a7-9ef4-35a11cc8c2e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:37.098777 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2f0af3da-edc0-46a7-9ef4-35a11cc8c2e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:37.107225 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2f0af3da-edc0-46a7-9ef4-35a11cc8c2e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:37.108829 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-2f0af3da-edc0-46a7-9ef4-35a11cc8c2e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:37.110054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-2f0af3da-edc0-46a7-9ef4-35a11cc8c2e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.189313 Aug 04 05:18:37.110628 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1246/2491] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:36 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:37.867221 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f112132a-188d-49b9-97a0-816d5c5d39b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:37.867942 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f112132a-188d-49b9-97a0-816d5c5d39b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:37.876003 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f112132a-188d-49b9-97a0-816d5c5d39b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:37.876720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f112132a-188d-49b9-97a0-816d5c5d39b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:37.877222 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f112132a-188d-49b9-97a0-816d5c5d39b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:37.877703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f112132a-188d-49b9-97a0-816d5c5d39b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:38.063101 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f112132a-188d-49b9-97a0-816d5c5d39b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:38.074557 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f112132a-188d-49b9-97a0-816d5c5d39b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1573 microversion: 2.1 time: 0.211453 Aug 04 05:18:38.075571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1246/2492] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:37 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1573 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:38.134553 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ef6e5e0f-ead4-46a5-8a76-4310bc02a43e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:38.135349 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ef6e5e0f-ead4-46a5-8a76-4310bc02a43e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:38.142992 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef6e5e0f-ead4-46a5-8a76-4310bc02a43e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:38.143606 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef6e5e0f-ead4-46a5-8a76-4310bc02a43e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:38.144593 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef6e5e0f-ead4-46a5-8a76-4310bc02a43e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:38.145815 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ef6e5e0f-ead4-46a5-8a76-4310bc02a43e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:38.306521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ef6e5e0f-ead4-46a5-8a76-4310bc02a43e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:38.314964 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ef6e5e0f-ead4-46a5-8a76-4310bc02a43e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:38.316467 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ef6e5e0f-ead4-46a5-8a76-4310bc02a43e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:38.318245 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ef6e5e0f-ead4-46a5-8a76-4310bc02a43e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.189312 Aug 04 05:18:38.318812 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1247/2493] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:38 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:39.106445 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-66ce0504-0d47-48d5-b3e5-8a62ef3343c7 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:39.107087 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-66ce0504-0d47-48d5-b3e5-8a62ef3343c7 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:39.115025 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-66ce0504-0d47-48d5-b3e5-8a62ef3343c7 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:39.115588 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-66ce0504-0d47-48d5-b3e5-8a62ef3343c7 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:39.116372 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-66ce0504-0d47-48d5-b3e5-8a62ef3343c7 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:39.116807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-66ce0504-0d47-48d5-b3e5-8a62ef3343c7 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:39.261883 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-66ce0504-0d47-48d5-b3e5-8a62ef3343c7 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:39.269916 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-66ce0504-0d47-48d5-b3e5-8a62ef3343c7 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1573 microversion: 2.1 time: 0.167234 Aug 04 05:18:39.271344 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1247/2494] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:39 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:18:39.347188 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b69e0857-2c92-46b7-9731-9dac46be7203 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:39.347805 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b69e0857-2c92-46b7-9731-9dac46be7203 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:39.354721 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b69e0857-2c92-46b7-9731-9dac46be7203 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:39.355171 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b69e0857-2c92-46b7-9731-9dac46be7203 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:39.355953 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b69e0857-2c92-46b7-9731-9dac46be7203 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:39.356397 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b69e0857-2c92-46b7-9731-9dac46be7203 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:39.516471 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b69e0857-2c92-46b7-9731-9dac46be7203 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:39.529211 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b69e0857-2c92-46b7-9731-9dac46be7203 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:39.531544 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b69e0857-2c92-46b7-9731-9dac46be7203 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:39.533205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b69e0857-2c92-46b7-9731-9dac46be7203 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.191506 Aug 04 05:18:39.534120 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1248/2495] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:39 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:40.293264 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d256e0bf-4257-466a-bdbc-eb02bcbfeed5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:40.294276 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d256e0bf-4257-466a-bdbc-eb02bcbfeed5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:40.301739 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d256e0bf-4257-466a-bdbc-eb02bcbfeed5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:40.302261 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d256e0bf-4257-466a-bdbc-eb02bcbfeed5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:40.303038 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d256e0bf-4257-466a-bdbc-eb02bcbfeed5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:40.303475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d256e0bf-4257-466a-bdbc-eb02bcbfeed5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:40.492746 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-d256e0bf-4257-466a-bdbc-eb02bcbfeed5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:40.501384 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d256e0bf-4257-466a-bdbc-eb02bcbfeed5 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1573 microversion: 2.1 time: 0.212017 Aug 04 05:18:40.502115 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1248/2496] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:40 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1573 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:40.569990 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4475b9d3-6bf9-4200-8515-4cbdb7ed8ae1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:40.570735 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4475b9d3-6bf9-4200-8515-4cbdb7ed8ae1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:40.577980 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4475b9d3-6bf9-4200-8515-4cbdb7ed8ae1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:40.578426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4475b9d3-6bf9-4200-8515-4cbdb7ed8ae1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:40.579194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4475b9d3-6bf9-4200-8515-4cbdb7ed8ae1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:40.579632 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4475b9d3-6bf9-4200-8515-4cbdb7ed8ae1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:40.769127 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4475b9d3-6bf9-4200-8515-4cbdb7ed8ae1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:40.778373 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4475b9d3-6bf9-4200-8515-4cbdb7ed8ae1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:40.779950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4475b9d3-6bf9-4200-8515-4cbdb7ed8ae1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:40.781183 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4475b9d3-6bf9-4200-8515-4cbdb7ed8ae1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.216274 Aug 04 05:18:40.781860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1249/2497] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:40 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:18:41.539270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f99446b3-3d33-4128-ab03-511705be8717 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:41.540351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f99446b3-3d33-4128-ab03-511705be8717 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:41.552600 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f99446b3-3d33-4128-ab03-511705be8717 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:41.553386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f99446b3-3d33-4128-ab03-511705be8717 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:41.554811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f99446b3-3d33-4128-ab03-511705be8717 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:41.555584 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f99446b3-3d33-4128-ab03-511705be8717 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:41.730307 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f99446b3-3d33-4128-ab03-511705be8717 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:41.744040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f99446b3-3d33-4128-ab03-511705be8717 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1573 microversion: 2.1 time: 0.212085 Aug 04 05:18:41.745026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1249/2498] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:41 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1573 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:41.806749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a61856b0-11ec-40b9-baf2-17ad10fcb9b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:41.807340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a61856b0-11ec-40b9-baf2-17ad10fcb9b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:41.813444 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a61856b0-11ec-40b9-baf2-17ad10fcb9b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:41.813923 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a61856b0-11ec-40b9-baf2-17ad10fcb9b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:41.814678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a61856b0-11ec-40b9-baf2-17ad10fcb9b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:41.815112 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a61856b0-11ec-40b9-baf2-17ad10fcb9b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:42.005363 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a61856b0-11ec-40b9-baf2-17ad10fcb9b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:42.015943 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a61856b0-11ec-40b9-baf2-17ad10fcb9b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:42.017539 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a61856b0-11ec-40b9-baf2-17ad10fcb9b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:42.018793 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a61856b0-11ec-40b9-baf2-17ad10fcb9b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.216226 Aug 04 05:18:42.019423 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1250/2499] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:41 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:42.777425 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8d39eead-8e88-42ea-8d07-34972b13981a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:42.778232 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8d39eead-8e88-42ea-8d07-34972b13981a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:42.785073 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d39eead-8e88-42ea-8d07-34972b13981a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:42.786140 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d39eead-8e88-42ea-8d07-34972b13981a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:42.786896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d39eead-8e88-42ea-8d07-34972b13981a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:42.787326 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8d39eead-8e88-42ea-8d07-34972b13981a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:42.975971 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8d39eead-8e88-42ea-8d07-34972b13981a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:42.987714 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8d39eead-8e88-42ea-8d07-34972b13981a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1573 microversion: 2.1 time: 0.214160 Aug 04 05:18:42.988392 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1250/2500] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:42 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1573 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:43.047979 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-3a377b73-bc2a-49e6-8f45-b4551a26d1b7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:43.048856 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-3a377b73-bc2a-49e6-8f45-b4551a26d1b7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:43.055960 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3a377b73-bc2a-49e6-8f45-b4551a26d1b7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:43.056473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3a377b73-bc2a-49e6-8f45-b4551a26d1b7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:43.057281 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3a377b73-bc2a-49e6-8f45-b4551a26d1b7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:43.057792 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-3a377b73-bc2a-49e6-8f45-b4551a26d1b7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:43.229181 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3a377b73-bc2a-49e6-8f45-b4551a26d1b7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:43.244405 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3a377b73-bc2a-49e6-8f45-b4551a26d1b7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:43.247316 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-3a377b73-bc2a-49e6-8f45-b4551a26d1b7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:43.249412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-3a377b73-bc2a-49e6-8f45-b4551a26d1b7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.208239 Aug 04 05:18:43.250414 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1251/2501] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:43 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:18:44.026316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f6bad637-8983-42b8-9c47-34cad1c32819 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:44.027450 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f6bad637-8983-42b8-9c47-34cad1c32819 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:44.038811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6bad637-8983-42b8-9c47-34cad1c32819 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:44.039609 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6bad637-8983-42b8-9c47-34cad1c32819 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:44.040958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6bad637-8983-42b8-9c47-34cad1c32819 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:44.041753 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f6bad637-8983-42b8-9c47-34cad1c32819 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:44.249809 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f6bad637-8983-42b8-9c47-34cad1c32819 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:44.259664 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f6bad637-8983-42b8-9c47-34cad1c32819 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1560 microversion: 2.1 time: 0.241097 Aug 04 05:18:44.260370 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1251/2502] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:18:44 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1560 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:18:44.291472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-69ca4764-9bd4-4005-a125-25cab6fbac15 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:44.292622 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-69ca4764-9bd4-4005-a125-25cab6fbac15 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:44.305651 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-69ca4764-9bd4-4005-a125-25cab6fbac15 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:44.306399 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-69ca4764-9bd4-4005-a125-25cab6fbac15 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:44.307740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-69ca4764-9bd4-4005-a125-25cab6fbac15 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:44.308478 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-69ca4764-9bd4-4005-a125-25cab6fbac15 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:44.495047 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-69ca4764-9bd4-4005-a125-25cab6fbac15 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:44.511468 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-69ca4764-9bd4-4005-a125-25cab6fbac15 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:44.514315 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-69ca4764-9bd4-4005-a125-25cab6fbac15 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:44.516433 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-69ca4764-9bd4-4005-a125-25cab6fbac15 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.232877 Aug 04 05:18:44.517440 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1252/2503] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:44 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:45.559519 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-3be04b55-d612-488e-af00-68a67875adec tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:45.560626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-3be04b55-d612-488e-af00-68a67875adec tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:45.572546 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3be04b55-d612-488e-af00-68a67875adec tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:45.573533 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3be04b55-d612-488e-af00-68a67875adec tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:45.574893 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3be04b55-d612-488e-af00-68a67875adec tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:45.575663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-3be04b55-d612-488e-af00-68a67875adec tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:45.797632 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3be04b55-d612-488e-af00-68a67875adec tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:45.809008 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3be04b55-d612-488e-af00-68a67875adec tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:45.811681 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-3be04b55-d612-488e-af00-68a67875adec tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:45.813736 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-3be04b55-d612-488e-af00-68a67875adec tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1747 microversion: 2.20 time: 0.261235 Aug 04 05:18:45.814700 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1252/2504] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:45 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1747 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:46.850916 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f51601c6-69f5-4455-86e6-60d7928e567f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:46.852030 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f51601c6-69f5-4455-86e6-60d7928e567f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:46.863377 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f51601c6-69f5-4455-86e6-60d7928e567f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:46.864435 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f51601c6-69f5-4455-86e6-60d7928e567f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:46.865819 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f51601c6-69f5-4455-86e6-60d7928e567f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:46.866640 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f51601c6-69f5-4455-86e6-60d7928e567f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:47.072903 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f51601c6-69f5-4455-86e6-60d7928e567f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:47.088939 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f51601c6-69f5-4455-86e6-60d7928e567f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:47.091691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-f51601c6-69f5-4455-86e6-60d7928e567f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:47.093691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f51601c6-69f5-4455-86e6-60d7928e567f tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1747 microversion: 2.20 time: 0.249930 Aug 04 05:18:47.094621 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1253/2505] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:46 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1747 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:47.164316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-f343fe3e-411d-45e8-bb41-86aae24a9d3b req-33b482f7-095c-4858-856b-fcdae09c6eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd63e685-c924-4940-ba66-4128dead0a60", "name": "network-vif-plugged", "status": "completed", "tag": "753b26da-a0d7-412a-b173-7ac7d5ad56de"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:47.181132 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-f343fe3e-411d-45e8-bb41-86aae24a9d3b req-33b482f7-095c-4858-856b-fcdae09c6eb3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:47.181964 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-f343fe3e-411d-45e8-bb41-86aae24a9d3b req-33b482f7-095c-4858-856b-fcdae09c6eb3 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:47.203065 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-f343fe3e-411d-45e8-bb41-86aae24a9d3b req-33b482f7-095c-4858-856b-fcdae09c6eb3 service nova] Creating event network-vif-plugged:753b26da-a0d7-412a-b173-7ac7d5ad56de for instance bd63e685-c924-4940-ba66-4128dead0a60 on hv-cinder-85127 Aug 04 05:18:47.211868 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-f343fe3e-411d-45e8-bb41-86aae24a9d3b req-33b482f7-095c-4858-856b-fcdae09c6eb3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054787 Aug 04 05:18:47.212894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1253/2506] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:48.129380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-793545ac-dd9a-4360-a090-b472aa47bc80 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:48.130473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-793545ac-dd9a-4360-a090-b472aa47bc80 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:48.140690 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-793545ac-dd9a-4360-a090-b472aa47bc80 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:48.141437 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-793545ac-dd9a-4360-a090-b472aa47bc80 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:48.142876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-793545ac-dd9a-4360-a090-b472aa47bc80 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:48.143641 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-793545ac-dd9a-4360-a090-b472aa47bc80 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:48.402847 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-793545ac-dd9a-4360-a090-b472aa47bc80 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:48.432756 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-793545ac-dd9a-4360-a090-b472aa47bc80 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:48.436414 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-793545ac-dd9a-4360-a090-b472aa47bc80 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:48.440806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-793545ac-dd9a-4360-a090-b472aa47bc80 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1742 microversion: 2.20 time: 0.314468 Aug 04 05:18:48.440806 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1254/2507] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:48 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1742 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:18:49.238156 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-df6c0d7b-3041-4ae5-af72-6f90bc92fee3 req-1b72567b-837c-4a91-b8aa-7a8d7063d683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a20351-3bba-4e9f-9291-141d8db265c0", "name": "network-vif-plugged", "status": "completed", "tag": "c7d845bb-700b-4c12-9596-4c246d13b053"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:18:49.259066 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-df6c0d7b-3041-4ae5-af72-6f90bc92fee3 req-1b72567b-837c-4a91-b8aa-7a8d7063d683 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:49.259801 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-df6c0d7b-3041-4ae5-af72-6f90bc92fee3 req-1b72567b-837c-4a91-b8aa-7a8d7063d683 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:49.280662 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-df6c0d7b-3041-4ae5-af72-6f90bc92fee3 req-1b72567b-837c-4a91-b8aa-7a8d7063d683 service nova] Creating event network-vif-plugged:c7d845bb-700b-4c12-9596-4c246d13b053 for instance 55a20351-3bba-4e9f-9291-141d8db265c0 on hv-cinder-85127 Aug 04 05:18:49.289178 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-df6c0d7b-3041-4ae5-af72-6f90bc92fee3 req-1b72567b-837c-4a91-b8aa-7a8d7063d683 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059706 Aug 04 05:18:49.290211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1254/2508] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:18:49.478647 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-a30dbc6a-bcdb-4131-af7f-aec1e825e5d1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:49.479746 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-a30dbc6a-bcdb-4131-af7f-aec1e825e5d1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:49.491097 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a30dbc6a-bcdb-4131-af7f-aec1e825e5d1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:49.492160 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a30dbc6a-bcdb-4131-af7f-aec1e825e5d1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:49.493676 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a30dbc6a-bcdb-4131-af7f-aec1e825e5d1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:49.494556 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-a30dbc6a-bcdb-4131-af7f-aec1e825e5d1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:49.713138 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a30dbc6a-bcdb-4131-af7f-aec1e825e5d1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:49.727449 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a30dbc6a-bcdb-4131-af7f-aec1e825e5d1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:49.729386 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-a30dbc6a-bcdb-4131-af7f-aec1e825e5d1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:49.735044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-a30dbc6a-bcdb-4131-af7f-aec1e825e5d1 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1742 microversion: 2.20 time: 0.259619 Aug 04 05:18:49.735044 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1255/2509] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:49 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1742 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:50.770393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4086dabe-d98d-4470-9f3c-c5224b0c95b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:50.771744 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4086dabe-d98d-4470-9f3c-c5224b0c95b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:50.773872 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:50.780191 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4086dabe-d98d-4470-9f3c-c5224b0c95b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:50.780648 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4086dabe-d98d-4470-9f3c-c5224b0c95b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:50.781484 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4086dabe-d98d-4470-9f3c-c5224b0c95b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:50.781947 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4086dabe-d98d-4470-9f3c-c5224b0c95b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:51.007349 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4086dabe-d98d-4470-9f3c-c5224b0c95b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:51.019203 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4086dabe-d98d-4470-9f3c-c5224b0c95b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:51.022950 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4086dabe-d98d-4470-9f3c-c5224b0c95b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:51.025175 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4086dabe-d98d-4470-9f3c-c5224b0c95b2 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1742 microversion: 2.20 time: 0.263973 Aug 04 05:18:51.026227 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1255/2510] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:50 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1742 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:18:52.062547 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-39f61822-7ffc-4cea-9b2f-47f36e1ee4b4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:52.068576 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-39f61822-7ffc-4cea-9b2f-47f36e1ee4b4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:52.074882 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=51 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:18:52.084017 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39f61822-7ffc-4cea-9b2f-47f36e1ee4b4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:52.084800 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39f61822-7ffc-4cea-9b2f-47f36e1ee4b4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:52.086342 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39f61822-7ffc-4cea-9b2f-47f36e1ee4b4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:52.087272 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-39f61822-7ffc-4cea-9b2f-47f36e1ee4b4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:52.322264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-39f61822-7ffc-4cea-9b2f-47f36e1ee4b4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:52.332366 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-39f61822-7ffc-4cea-9b2f-47f36e1ee4b4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:52.333919 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-39f61822-7ffc-4cea-9b2f-47f36e1ee4b4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:52.335416 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-39f61822-7ffc-4cea-9b2f-47f36e1ee4b4 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1742 microversion: 2.20 time: 0.279900 Aug 04 05:18:52.336661 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1256/2511] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:52 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1742 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:53.379051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e5d6747b-7dfc-4094-bcb8-cf55017e885e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:53.381863 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e5d6747b-7dfc-4094-bcb8-cf55017e885e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:53.396601 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e5d6747b-7dfc-4094-bcb8-cf55017e885e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:53.397351 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e5d6747b-7dfc-4094-bcb8-cf55017e885e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:53.398997 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e5d6747b-7dfc-4094-bcb8-cf55017e885e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:53.400117 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e5d6747b-7dfc-4094-bcb8-cf55017e885e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:53.629935 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e5d6747b-7dfc-4094-bcb8-cf55017e885e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:53.645034 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e5d6747b-7dfc-4094-bcb8-cf55017e885e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:53.648423 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e5d6747b-7dfc-4094-bcb8-cf55017e885e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:53.650886 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e5d6747b-7dfc-4094-bcb8-cf55017e885e tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1742 microversion: 2.20 time: 0.280405 Aug 04 05:18:53.652062 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1256/2512] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:53 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1742 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:54.694166 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-29a8e4df-1c4c-4695-9c4f-64d6cf153f3a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:54.695094 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-29a8e4df-1c4c-4695-9c4f-64d6cf153f3a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:54.715898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29a8e4df-1c4c-4695-9c4f-64d6cf153f3a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:54.716718 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29a8e4df-1c4c-4695-9c4f-64d6cf153f3a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:54.718149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29a8e4df-1c4c-4695-9c4f-64d6cf153f3a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:54.718943 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-29a8e4df-1c4c-4695-9c4f-64d6cf153f3a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:54.984158 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-29a8e4df-1c4c-4695-9c4f-64d6cf153f3a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:54.999359 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-29a8e4df-1c4c-4695-9c4f-64d6cf153f3a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:55.002132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-29a8e4df-1c4c-4695-9c4f-64d6cf153f3a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:55.004773 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-29a8e4df-1c4c-4695-9c4f-64d6cf153f3a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1742 microversion: 2.20 time: 0.318175 Aug 04 05:18:55.006125 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1257/2513] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:54 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1742 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:56.055607 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-dd3bd36b-69a7-4837-a55e-07d9c70f4d22 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:56.059473 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-dd3bd36b-69a7-4837-a55e-07d9c70f4d22 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:56.071431 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dd3bd36b-69a7-4837-a55e-07d9c70f4d22 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:56.072148 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dd3bd36b-69a7-4837-a55e-07d9c70f4d22 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:56.073368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dd3bd36b-69a7-4837-a55e-07d9c70f4d22 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:56.074103 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-dd3bd36b-69a7-4837-a55e-07d9c70f4d22 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:56.322299 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dd3bd36b-69a7-4837-a55e-07d9c70f4d22 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:56.336207 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dd3bd36b-69a7-4837-a55e-07d9c70f4d22 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:56.339319 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-dd3bd36b-69a7-4837-a55e-07d9c70f4d22 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:56.341270 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-dd3bd36b-69a7-4837-a55e-07d9c70f4d22 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1742 microversion: 2.20 time: 0.301740 Aug 04 05:18:56.342027 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1257/2514] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:56 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1742 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:57.377253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-bd31a8d0-e5d1-4fbe-a308-9501b7f2d679 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:57.378970 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-bd31a8d0-e5d1-4fbe-a308-9501b7f2d679 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:57.388579 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd31a8d0-e5d1-4fbe-a308-9501b7f2d679 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:57.389027 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd31a8d0-e5d1-4fbe-a308-9501b7f2d679 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:57.389830 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd31a8d0-e5d1-4fbe-a308-9501b7f2d679 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:57.390269 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-bd31a8d0-e5d1-4fbe-a308-9501b7f2d679 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:57.632869 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bd31a8d0-e5d1-4fbe-a308-9501b7f2d679 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:57.641484 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bd31a8d0-e5d1-4fbe-a308-9501b7f2d679 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:57.643093 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-bd31a8d0-e5d1-4fbe-a308-9501b7f2d679 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:57.645477 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-bd31a8d0-e5d1-4fbe-a308-9501b7f2d679 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1742 microversion: 2.20 time: 0.273698 Aug 04 05:18:57.646503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1258/2515] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:57 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1742 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:18:58.685388 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a4569bef-29a5-48e3-bc5e-4b192756c689 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:58.686580 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a4569bef-29a5-48e3-bc5e-4b192756c689 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:58.695402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a4569bef-29a5-48e3-bc5e-4b192756c689 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:58.695982 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a4569bef-29a5-48e3-bc5e-4b192756c689 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:58.696850 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a4569bef-29a5-48e3-bc5e-4b192756c689 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:58.697371 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a4569bef-29a5-48e3-bc5e-4b192756c689 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:58.880157 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a4569bef-29a5-48e3-bc5e-4b192756c689 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:58.900548 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a4569bef-29a5-48e3-bc5e-4b192756c689 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:58.903154 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-a4569bef-29a5-48e3-bc5e-4b192756c689 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:18:58.905340 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a4569bef-29a5-48e3-bc5e-4b192756c689 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1742 microversion: 2.20 time: 0.226802 Aug 04 05:18:58.906158 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1258/2516] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:58 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1742 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:18:59.944897 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-837f18c2-4cab-4344-9ae7-435a0c5d84bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:18:59.945831 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-837f18c2-4cab-4344-9ae7-435a0c5d84bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:18:59.954673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-837f18c2-4cab-4344-9ae7-435a0c5d84bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:59.955273 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-837f18c2-4cab-4344-9ae7-435a0c5d84bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:18:59.956308 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-837f18c2-4cab-4344-9ae7-435a0c5d84bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:18:59.956957 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-837f18c2-4cab-4344-9ae7-435a0c5d84bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:00.119325 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-837f18c2-4cab-4344-9ae7-435a0c5d84bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:00.130903 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-837f18c2-4cab-4344-9ae7-435a0c5d84bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:00.133084 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-837f18c2-4cab-4344-9ae7-435a0c5d84bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:00.134885 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-837f18c2-4cab-4344-9ae7-435a0c5d84bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1724 microversion: 2.20 time: 0.196646 Aug 04 05:19:00.135451 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1259/2517] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:18:59 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:01.162130 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c6ed93a8-ea95-471d-8ca5-9ceefdfd32cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:01.163134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c6ed93a8-ea95-471d-8ca5-9ceefdfd32cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:01.170139 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c6ed93a8-ea95-471d-8ca5-9ceefdfd32cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:01.170594 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c6ed93a8-ea95-471d-8ca5-9ceefdfd32cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:01.171363 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c6ed93a8-ea95-471d-8ca5-9ceefdfd32cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:01.171809 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c6ed93a8-ea95-471d-8ca5-9ceefdfd32cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:01.329722 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c6ed93a8-ea95-471d-8ca5-9ceefdfd32cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:01.344750 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c6ed93a8-ea95-471d-8ca5-9ceefdfd32cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:01.347031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c6ed93a8-ea95-471d-8ca5-9ceefdfd32cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:01.348879 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c6ed93a8-ea95-471d-8ca5-9ceefdfd32cb tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1724 microversion: 2.20 time: 0.191483 Aug 04 05:19:01.349700 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1259/2518] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:01 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:02.383703 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9a4b2c63-fb64-48c0-99f3-1a871a319249 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:02.384556 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9a4b2c63-fb64-48c0-99f3-1a871a319249 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:02.392117 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a4b2c63-fb64-48c0-99f3-1a871a319249 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:02.392545 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a4b2c63-fb64-48c0-99f3-1a871a319249 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:02.393334 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a4b2c63-fb64-48c0-99f3-1a871a319249 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:02.393883 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9a4b2c63-fb64-48c0-99f3-1a871a319249 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:02.553192 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9a4b2c63-fb64-48c0-99f3-1a871a319249 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:02.561674 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9a4b2c63-fb64-48c0-99f3-1a871a319249 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:02.563517 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-9a4b2c63-fb64-48c0-99f3-1a871a319249 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:02.565472 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9a4b2c63-fb64-48c0-99f3-1a871a319249 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1667 microversion: 2.20 time: 0.186987 Aug 04 05:19:02.566893 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1260/2519] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:02 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1667 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:02.600230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-880e435d-2b49-482f-acbc-f2ad8f2e59a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cec3aa0-dab1-46bb-919b-df41079e3935"}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:02.603390 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-880e435d-2b49-482f-acbc-f2ad8f2e59a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:02.610640 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-880e435d-2b49-482f-acbc-f2ad8f2e59a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:02.611093 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-880e435d-2b49-482f-acbc-f2ad8f2e59a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:02.611859 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-880e435d-2b49-482f-acbc-f2ad8f2e59a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:02.612299 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-880e435d-2b49-482f-acbc-f2ad8f2e59a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:02.847626 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:02.980894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-880e435d-2b49-482f-acbc-f2ad8f2e59a6 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "POST /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.387753 Aug 04 05:19:02.981633 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1260/2520] 10.222.0.47 () {62 vars in 1364 bytes} [Thu Aug 4 05:19:02 2022] POST /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/os-volume_attachments => generated 188 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 05:19:03.028853 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-91b72823-82ef-45ce-b4a6-aebdc4111c04 req-08a6a51b-a846-44d6-96da-ecfc9756abd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a20351-3bba-4e9f-9291-141d8db265c0", "name": "network-vif-unplugged", "status": "completed", "tag": "c7d845bb-700b-4c12-9596-4c246d13b053"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:03.054491 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-91b72823-82ef-45ce-b4a6-aebdc4111c04 req-08a6a51b-a846-44d6-96da-ecfc9756abd7 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:03.055079 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-91b72823-82ef-45ce-b4a6-aebdc4111c04 req-08a6a51b-a846-44d6-96da-ecfc9756abd7 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:03.074106 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.compute.server_external_events [req-91b72823-82ef-45ce-b4a6-aebdc4111c04 req-08a6a51b-a846-44d6-96da-ecfc9756abd7 service nova] Unable to find a host for instance 55a20351-3bba-4e9f-9291-141d8db265c0. Dropping event network-vif-unplugged {{(pid=134884) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 05:19:03.075332 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-91b72823-82ef-45ce-b4a6-aebdc4111c04 req-08a6a51b-a846-44d6-96da-ecfc9756abd7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051741 Aug 04 05:19:03.076348 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1261/2521] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 05:19:03.169352 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8a716c54-6f1f-42d8-a787-336382b09849 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:03.170393 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8a716c54-6f1f-42d8-a787-336382b09849 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:03.181132 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a716c54-6f1f-42d8-a787-336382b09849 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:03.181731 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a716c54-6f1f-42d8-a787-336382b09849 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:03.183182 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a716c54-6f1f-42d8-a787-336382b09849 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:03.184320 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8a716c54-6f1f-42d8-a787-336382b09849 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:03.653876 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8a716c54-6f1f-42d8-a787-336382b09849 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "DELETE /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/os-volume_attachments/7cec3aa0-dab1-46bb-919b-df41079e3935" status: 202 len: 0 microversion: 2.20 time: 0.491346 Aug 04 05:19:03.655036 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1261/2522] 10.222.0.47 () {60 vars in 1457 bytes} [Thu Aug 4 05:19:03 2022] DELETE /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/os-volume_attachments/7cec3aa0-dab1-46bb-919b-df41079e3935 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:19:03.736059 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-f743071d-f397-4a78-b56a-6da49364d3b3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:03.736686 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f743071d-f397-4a78-b56a-6da49364d3b3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:03.743617 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f743071d-f397-4a78-b56a-6da49364d3b3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:03.744067 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f743071d-f397-4a78-b56a-6da49364d3b3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:03.744843 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f743071d-f397-4a78-b56a-6da49364d3b3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:03.745284 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-f743071d-f397-4a78-b56a-6da49364d3b3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:03.800994 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-f743071d-f397-4a78-b56a-6da49364d3b3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=134884) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 05:19:03.828389 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=100 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:03.879591 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-f743071d-f397-4a78-b56a-6da49364d3b3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "POST /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/action" status: 202 len: 0 microversion: 2.20 time: 0.147450 Aug 04 05:19:03.880204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1262/2523] 10.222.0.47 () {62 vars in 1319 bytes} [Thu Aug 4 05:19:03 2022] POST /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:19:03.888471 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-145afce8-c1f2-40b1-baab-5d4f841bc533 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:03.889381 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-145afce8-c1f2-40b1-baab-5d4f841bc533 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:03.898031 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-145afce8-c1f2-40b1-baab-5d4f841bc533 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:03.898590 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-145afce8-c1f2-40b1-baab-5d4f841bc533 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:03.899555 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-145afce8-c1f2-40b1-baab-5d4f841bc533 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:03.900106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-145afce8-c1f2-40b1-baab-5d4f841bc533 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:04.119719 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-145afce8-c1f2-40b1-baab-5d4f841bc533 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:04.134477 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-145afce8-c1f2-40b1-baab-5d4f841bc533 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:04.137428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-145afce8-c1f2-40b1-baab-5d4f841bc533 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:04.139636 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-145afce8-c1f2-40b1-baab-5d4f841bc533 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1675 microversion: 2.20 time: 0.254926 Aug 04 05:19:04.141089 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1262/2524] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:03 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1675 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:05.176822 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-31dbb5ca-a8f7-4dd2-b365-dd8be0962318 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:05.177635 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-31dbb5ca-a8f7-4dd2-b365-dd8be0962318 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:05.184251 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-31dbb5ca-a8f7-4dd2-b365-dd8be0962318 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:05.184702 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-31dbb5ca-a8f7-4dd2-b365-dd8be0962318 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:05.185503 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-31dbb5ca-a8f7-4dd2-b365-dd8be0962318 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:05.185962 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-31dbb5ca-a8f7-4dd2-b365-dd8be0962318 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:05.653957 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-31dbb5ca-a8f7-4dd2-b365-dd8be0962318 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:05.664051 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-31dbb5ca-a8f7-4dd2-b365-dd8be0962318 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:05.665601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-31dbb5ca-a8f7-4dd2-b365-dd8be0962318 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:05.666790 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-31dbb5ca-a8f7-4dd2-b365-dd8be0962318 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.495441 Aug 04 05:19:05.667358 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1263/2525] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:05 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:06.698829 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-8bb19cb8-b319-4491-888d-5bd9902351f7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:06.700223 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-8bb19cb8-b319-4491-888d-5bd9902351f7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:06.709230 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8bb19cb8-b319-4491-888d-5bd9902351f7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:06.710234 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8bb19cb8-b319-4491-888d-5bd9902351f7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:06.711417 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8bb19cb8-b319-4491-888d-5bd9902351f7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:06.712120 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-8bb19cb8-b319-4491-888d-5bd9902351f7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:06.905410 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8bb19cb8-b319-4491-888d-5bd9902351f7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:06.920377 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8bb19cb8-b319-4491-888d-5bd9902351f7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:06.922366 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-8bb19cb8-b319-4491-888d-5bd9902351f7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:06.924399 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-8bb19cb8-b319-4491-888d-5bd9902351f7 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.233904 Aug 04 05:19:06.926505 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1263/2526] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:06 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:07.959254 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6adf6a8b-dfdf-4c74-942a-46e67314d349 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:07.960054 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6adf6a8b-dfdf-4c74-942a-46e67314d349 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:07.966942 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6adf6a8b-dfdf-4c74-942a-46e67314d349 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:07.967382 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6adf6a8b-dfdf-4c74-942a-46e67314d349 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:07.967937 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6adf6a8b-dfdf-4c74-942a-46e67314d349 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:07.968521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6adf6a8b-dfdf-4c74-942a-46e67314d349 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:08.186772 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6adf6a8b-dfdf-4c74-942a-46e67314d349 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:08.199965 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6adf6a8b-dfdf-4c74-942a-46e67314d349 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:08.201501 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-6adf6a8b-dfdf-4c74-942a-46e67314d349 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:08.203552 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6adf6a8b-dfdf-4c74-942a-46e67314d349 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.248951 Aug 04 05:19:08.204313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1264/2527] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:07 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:19:09.236289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0f610702-a1cc-461e-b79c-fc995538ce14 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:09.238225 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0f610702-a1cc-461e-b79c-fc995538ce14 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:09.249988 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0f610702-a1cc-461e-b79c-fc995538ce14 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:09.250848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0f610702-a1cc-461e-b79c-fc995538ce14 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:09.254097 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0f610702-a1cc-461e-b79c-fc995538ce14 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:09.254973 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0f610702-a1cc-461e-b79c-fc995538ce14 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:09.455282 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0f610702-a1cc-461e-b79c-fc995538ce14 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:09.465072 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0f610702-a1cc-461e-b79c-fc995538ce14 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:09.466841 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-0f610702-a1cc-461e-b79c-fc995538ce14 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:09.468003 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0f610702-a1cc-461e-b79c-fc995538ce14 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.238990 Aug 04 05:19:09.468568 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1264/2528] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:09 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:10.497476 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-02dc368c-95f3-428b-b90a-9c428d101984 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:10.498456 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-02dc368c-95f3-428b-b90a-9c428d101984 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:10.507539 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02dc368c-95f3-428b-b90a-9c428d101984 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:10.508774 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02dc368c-95f3-428b-b90a-9c428d101984 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:10.510409 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02dc368c-95f3-428b-b90a-9c428d101984 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:10.513328 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-02dc368c-95f3-428b-b90a-9c428d101984 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:10.876737 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-02dc368c-95f3-428b-b90a-9c428d101984 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:10.886510 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-02dc368c-95f3-428b-b90a-9c428d101984 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:10.888153 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-02dc368c-95f3-428b-b90a-9c428d101984 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:10.889439 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-02dc368c-95f3-428b-b90a-9c428d101984 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.396598 Aug 04 05:19:10.890396 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1265/2529] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:10 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:11.914702 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-56f0256e-735d-4bb7-84bd-f4d6c7b667e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:11.915577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-56f0256e-735d-4bb7-84bd-f4d6c7b667e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:11.921954 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56f0256e-735d-4bb7-84bd-f4d6c7b667e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:11.922412 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56f0256e-735d-4bb7-84bd-f4d6c7b667e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:11.923196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56f0256e-735d-4bb7-84bd-f4d6c7b667e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:11.923671 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-56f0256e-735d-4bb7-84bd-f4d6c7b667e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:12.119386 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-56f0256e-735d-4bb7-84bd-f4d6c7b667e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:12.133289 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-56f0256e-735d-4bb7-84bd-f4d6c7b667e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:12.135044 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-56f0256e-735d-4bb7-84bd-f4d6c7b667e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:12.136239 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-56f0256e-735d-4bb7-84bd-f4d6c7b667e8 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.225530 Aug 04 05:19:12.153756 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1265/2530] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:11 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:13.162665 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-8fd68822-1cd5-40c3-9dc7-123cb80a4c01 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:13.163512 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-8fd68822-1cd5-40c3-9dc7-123cb80a4c01 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:13.170519 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8fd68822-1cd5-40c3-9dc7-123cb80a4c01 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:13.170971 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8fd68822-1cd5-40c3-9dc7-123cb80a4c01 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:13.171760 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8fd68822-1cd5-40c3-9dc7-123cb80a4c01 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:13.172232 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-8fd68822-1cd5-40c3-9dc7-123cb80a4c01 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:13.406253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8fd68822-1cd5-40c3-9dc7-123cb80a4c01 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:13.417726 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8fd68822-1cd5-40c3-9dc7-123cb80a4c01 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:13.419162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-8fd68822-1cd5-40c3-9dc7-123cb80a4c01 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:13.420361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-8fd68822-1cd5-40c3-9dc7-123cb80a4c01 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.262789 Aug 04 05:19:13.420850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1266/2531] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:13 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:14.466748 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-02405881-52c1-4a9e-8566-24e0c3b5a511 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:14.467611 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-02405881-52c1-4a9e-8566-24e0c3b5a511 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:14.475204 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-02405881-52c1-4a9e-8566-24e0c3b5a511 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:14.476032 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-02405881-52c1-4a9e-8566-24e0c3b5a511 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:14.477106 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-02405881-52c1-4a9e-8566-24e0c3b5a511 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:14.477787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-02405881-52c1-4a9e-8566-24e0c3b5a511 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:14.740127 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-02405881-52c1-4a9e-8566-24e0c3b5a511 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:14.748917 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-02405881-52c1-4a9e-8566-24e0c3b5a511 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:14.750461 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-02405881-52c1-4a9e-8566-24e0c3b5a511 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:14.751663 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-02405881-52c1-4a9e-8566-24e0c3b5a511 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.289342 Aug 04 05:19:14.752228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1266/2532] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:14 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:15.777561 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1ad8d463-d1b5-4811-9b46-8097f9a3c4fe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:15.778131 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1ad8d463-d1b5-4811-9b46-8097f9a3c4fe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:15.787046 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ad8d463-d1b5-4811-9b46-8097f9a3c4fe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:15.787673 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ad8d463-d1b5-4811-9b46-8097f9a3c4fe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:15.788454 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ad8d463-d1b5-4811-9b46-8097f9a3c4fe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:15.788895 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1ad8d463-d1b5-4811-9b46-8097f9a3c4fe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:15.929512 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1ad8d463-d1b5-4811-9b46-8097f9a3c4fe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:15.937650 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1ad8d463-d1b5-4811-9b46-8097f9a3c4fe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:15.939162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-1ad8d463-d1b5-4811-9b46-8097f9a3c4fe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:15.940427 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1ad8d463-d1b5-4811-9b46-8097f9a3c4fe tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.168253 Aug 04 05:19:15.941128 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1267/2533] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:15 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:16.964449 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-b21bbd9c-f6ab-4eeb-867a-2d5b8eed6973 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:16.965170 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-b21bbd9c-f6ab-4eeb-867a-2d5b8eed6973 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:16.972532 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b21bbd9c-f6ab-4eeb-867a-2d5b8eed6973 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:16.972990 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b21bbd9c-f6ab-4eeb-867a-2d5b8eed6973 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:16.973794 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b21bbd9c-f6ab-4eeb-867a-2d5b8eed6973 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:16.974250 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-b21bbd9c-f6ab-4eeb-867a-2d5b8eed6973 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:17.130824 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b21bbd9c-f6ab-4eeb-867a-2d5b8eed6973 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:17.139720 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b21bbd9c-f6ab-4eeb-867a-2d5b8eed6973 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:17.141290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-b21bbd9c-f6ab-4eeb-867a-2d5b8eed6973 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:17.142490 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-b21bbd9c-f6ab-4eeb-867a-2d5b8eed6973 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.182253 Aug 04 05:19:17.143181 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1267/2534] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:16 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:18.167551 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-ae48b673-578e-4edd-8a95-872f026db1a9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:18.168178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-ae48b673-578e-4edd-8a95-872f026db1a9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:18.175195 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ae48b673-578e-4edd-8a95-872f026db1a9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:18.175740 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ae48b673-578e-4edd-8a95-872f026db1a9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:18.176427 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ae48b673-578e-4edd-8a95-872f026db1a9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:18.176867 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-ae48b673-578e-4edd-8a95-872f026db1a9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:18.340464 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ae48b673-578e-4edd-8a95-872f026db1a9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:18.350642 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ae48b673-578e-4edd-8a95-872f026db1a9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:18.352412 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-ae48b673-578e-4edd-8a95-872f026db1a9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:18.354087 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-ae48b673-578e-4edd-8a95-872f026db1a9 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.190151 Aug 04 05:19:18.355063 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1268/2535] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:18 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:19.387943 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e97b0a4f-d778-4e50-9a74-5969e9117d8c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:19.388659 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e97b0a4f-d778-4e50-9a74-5969e9117d8c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:19.401315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e97b0a4f-d778-4e50-9a74-5969e9117d8c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:19.401315 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e97b0a4f-d778-4e50-9a74-5969e9117d8c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:19.403326 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e97b0a4f-d778-4e50-9a74-5969e9117d8c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:19.403462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e97b0a4f-d778-4e50-9a74-5969e9117d8c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:19.605614 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e97b0a4f-d778-4e50-9a74-5969e9117d8c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:19.614704 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e97b0a4f-d778-4e50-9a74-5969e9117d8c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:19.616458 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e97b0a4f-d778-4e50-9a74-5969e9117d8c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:19.617718 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e97b0a4f-d778-4e50-9a74-5969e9117d8c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.236059 Aug 04 05:19:19.618273 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1268/2536] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:19 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:19:20.641258 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fba3a2f6-b6ba-4061-b635-e085cdea43e5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:20.642063 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fba3a2f6-b6ba-4061-b635-e085cdea43e5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:20.650040 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fba3a2f6-b6ba-4061-b635-e085cdea43e5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:20.650572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fba3a2f6-b6ba-4061-b635-e085cdea43e5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:20.651343 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fba3a2f6-b6ba-4061-b635-e085cdea43e5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:20.651781 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fba3a2f6-b6ba-4061-b635-e085cdea43e5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:20.808997 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fba3a2f6-b6ba-4061-b635-e085cdea43e5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:20.819121 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fba3a2f6-b6ba-4061-b635-e085cdea43e5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:20.820738 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fba3a2f6-b6ba-4061-b635-e085cdea43e5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:20.822092 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fba3a2f6-b6ba-4061-b635-e085cdea43e5 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.184919 Aug 04 05:19:20.822749 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1269/2537] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:20 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:21.127695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-96d04977-7d20-449d-b2e1-c39baa497996 req-b43f5e54-0db8-463f-a984-8db36f58fd2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a20351-3bba-4e9f-9291-141d8db265c0", "name": "network-vif-plugged", "status": "completed", "tag": "c7d845bb-700b-4c12-9596-4c246d13b053"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:21.135771 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=28 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:21.145864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-96d04977-7d20-449d-b2e1-c39baa497996 req-b43f5e54-0db8-463f-a984-8db36f58fd2c service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:21.146658 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-96d04977-7d20-449d-b2e1-c39baa497996 req-b43f5e54-0db8-463f-a984-8db36f58fd2c service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:21.161989 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-96d04977-7d20-449d-b2e1-c39baa497996 req-b43f5e54-0db8-463f-a984-8db36f58fd2c service nova] Creating event network-vif-plugged:c7d845bb-700b-4c12-9596-4c246d13b053 for instance 55a20351-3bba-4e9f-9291-141d8db265c0 on hv-cinder-85127 Aug 04 05:19:21.167251 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-96d04977-7d20-449d-b2e1-c39baa497996 req-b43f5e54-0db8-463f-a984-8db36f58fd2c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044109 Aug 04 05:19:21.168109 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1269/2538] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:19:21.847424 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-0cff41da-fdcc-45e3-9ec8-e10561aa35bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:21.848105 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-0cff41da-fdcc-45e3-9ec8-e10561aa35bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:21.854924 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0cff41da-fdcc-45e3-9ec8-e10561aa35bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:21.855371 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0cff41da-fdcc-45e3-9ec8-e10561aa35bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:21.856137 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0cff41da-fdcc-45e3-9ec8-e10561aa35bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:21.856678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-0cff41da-fdcc-45e3-9ec8-e10561aa35bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:22.004086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0cff41da-fdcc-45e3-9ec8-e10561aa35bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:22.012355 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0cff41da-fdcc-45e3-9ec8-e10561aa35bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:22.013896 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-0cff41da-fdcc-45e3-9ec8-e10561aa35bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:22.015055 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-0cff41da-fdcc-45e3-9ec8-e10561aa35bc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.171761 Aug 04 05:19:22.015808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1270/2539] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:21 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:23.040678 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-057a20d0-1723-4a40-812e-bc120c8ac0be tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:23.041396 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-057a20d0-1723-4a40-812e-bc120c8ac0be tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:23.048827 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-057a20d0-1723-4a40-812e-bc120c8ac0be tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:23.049428 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-057a20d0-1723-4a40-812e-bc120c8ac0be tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:23.050302 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-057a20d0-1723-4a40-812e-bc120c8ac0be tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:23.050652 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-057a20d0-1723-4a40-812e-bc120c8ac0be tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:23.243504 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-057a20d0-1723-4a40-812e-bc120c8ac0be tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:23.253402 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-057a20d0-1723-4a40-812e-bc120c8ac0be tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:23.255099 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-057a20d0-1723-4a40-812e-bc120c8ac0be tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:23.256267 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-057a20d0-1723-4a40-812e-bc120c8ac0be tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1733 microversion: 2.20 time: 0.220723 Aug 04 05:19:23.257128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1270/2540] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:23 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1733 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:24.280253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-23c638e1-d4e6-401a-a2b7-2fafca471d51 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:24.280858 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-23c638e1-d4e6-401a-a2b7-2fafca471d51 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:24.285801 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:24.295898 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-23c638e1-d4e6-401a-a2b7-2fafca471d51 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:24.296377 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-23c638e1-d4e6-401a-a2b7-2fafca471d51 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:24.297132 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-23c638e1-d4e6-401a-a2b7-2fafca471d51 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:24.297572 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-23c638e1-d4e6-401a-a2b7-2fafca471d51 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:24.443823 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-23c638e1-d4e6-401a-a2b7-2fafca471d51 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:24.457603 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-23c638e1-d4e6-401a-a2b7-2fafca471d51 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:24.460697 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-23c638e1-d4e6-401a-a2b7-2fafca471d51 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:24.467987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-23c638e1-d4e6-401a-a2b7-2fafca471d51 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1720 microversion: 2.20 time: 0.186291 Aug 04 05:19:24.467987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1271/2541] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:24 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:32.719137 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1837571871", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1187330075", "security_groups": [{"name": "tempest-secgroup-smoke-1777883312"}], "block_device_mapping_v2": [{"uuid": "a8a211da-b532-4c10-9702-d021a2d7e730", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "863cf01d-dc84-403c-86c5-61b4b6d33a3b"}]}} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:32.866006 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.network.neutron [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] validate_networks() for [('863cf01d-dc84-403c-86c5-61b4b6d33a3b', None, None, None, None, None)] {{(pid=134883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 05:19:33.249464 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=68,nova_cell1:UPDATE=6 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:33.349858 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Flavor limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 05:19:33.350285 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Image limits 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 05:19:33.350785 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Flavor pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 05:19:33.351220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Image pref 0:0:0 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 05:19:33.351660 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.virt.hardware [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 05:19:33.362123 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:33.363090 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:33.363743 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:33.364196 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:33.384799 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Getting quotas for project 731637c0b96a4f1f8d9edb1af69e98cb. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 05:19:33.392463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.quota [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Getting quotas for user 30c0ff27c5a84ebd8615fb4608fc3882 and project 731637c0b96a4f1f8d9edb1af69e98cb. Resources: {'ram', 'cores', 'instances'} {{(pid=134883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 05:19:33.476418 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Going to run 1 instances... {{(pid=134883) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 05:19:33.478571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a8a211da-b532-4c10-9702-d021a2d7e730',volume_size=None,volume_type=None)] {{(pid=134883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 05:19:33.634569 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-edbdf497-4a74-49b7-a616-99630adadd6f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.919279 Aug 04 05:19:33.635355 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1271/2542] 10.222.0.47 () {60 vars in 1147 bytes} [Thu Aug 4 05:19:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 05:19:33.646889 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fd75fdb2-d838-420a-8d37-a9aaf482dd65 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:33.648165 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fd75fdb2-d838-420a-8d37-a9aaf482dd65 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:33.731827 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fd75fdb2-d838-420a-8d37-a9aaf482dd65 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:33.740786 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fd75fdb2-d838-420a-8d37-a9aaf482dd65 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1095 microversion: 2.1 time: 0.098628 Aug 04 05:19:33.741627 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1272/2543] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:33 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1095 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:19:34.765053 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-f7dcb36f-7ad3-483d-bf04-9fac51cccf8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:34.766375 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-f7dcb36f-7ad3-483d-bf04-9fac51cccf8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:34.773938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7dcb36f-7ad3-483d-bf04-9fac51cccf8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:34.774868 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7dcb36f-7ad3-483d-bf04-9fac51cccf8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:34.775816 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7dcb36f-7ad3-483d-bf04-9fac51cccf8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:34.776475 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-f7dcb36f-7ad3-483d-bf04-9fac51cccf8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:34.885695 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-f7dcb36f-7ad3-483d-bf04-9fac51cccf8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:34.906368 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-f7dcb36f-7ad3-483d-bf04-9fac51cccf8a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1201 microversion: 2.1 time: 0.145272 Aug 04 05:19:34.907528 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1272/2544] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:34 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1201 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:19:35.931266 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-44609db6-570f-43f9-a700-0cdf2098cfaa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:35.933667 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-44609db6-570f-43f9-a700-0cdf2098cfaa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:35.937329 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:35.944205 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44609db6-570f-43f9-a700-0cdf2098cfaa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:35.944651 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44609db6-570f-43f9-a700-0cdf2098cfaa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:35.945432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44609db6-570f-43f9-a700-0cdf2098cfaa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:35.947067 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-44609db6-570f-43f9-a700-0cdf2098cfaa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:36.155229 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-44609db6-570f-43f9-a700-0cdf2098cfaa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:36.166134 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-44609db6-570f-43f9-a700-0cdf2098cfaa tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1267 microversion: 2.1 time: 0.240247 Aug 04 05:19:36.166729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1273/2545] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:35 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:36.584057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-3c8ac0de-be0b-4cfe-9834-930a7747804f req-9b3bbd6e-bcce-46e5-be32-f2d4b507de9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7537d3-c816-4ce2-91c3-47b54921121b", "tag": "955d2115-bc55-4b69-ba83-ae7e50ba0eba"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:36.595903 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-3c8ac0de-be0b-4cfe-9834-930a7747804f req-9b3bbd6e-bcce-46e5-be32-f2d4b507de9f service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:36.596357 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-3c8ac0de-be0b-4cfe-9834-930a7747804f req-9b3bbd6e-bcce-46e5-be32-f2d4b507de9f service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:36.608467 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-3c8ac0de-be0b-4cfe-9834-930a7747804f req-9b3bbd6e-bcce-46e5-be32-f2d4b507de9f service nova] Creating event network-changed:955d2115-bc55-4b69-ba83-ae7e50ba0eba for instance 2c7537d3-c816-4ce2-91c3-47b54921121b on hv-cinder-85127 Aug 04 05:19:36.615914 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-3c8ac0de-be0b-4cfe-9834-930a7747804f req-9b3bbd6e-bcce-46e5-be32-f2d4b507de9f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110888 Aug 04 05:19:36.616958 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1273/2546] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:19:37.198963 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-469cd5fa-1253-4d3d-a7e8-403176cf53e4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:37.199975 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-469cd5fa-1253-4d3d-a7e8-403176cf53e4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:37.209178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-469cd5fa-1253-4d3d-a7e8-403176cf53e4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:37.209936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-469cd5fa-1253-4d3d-a7e8-403176cf53e4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:37.210820 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-469cd5fa-1253-4d3d-a7e8-403176cf53e4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:37.211293 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-469cd5fa-1253-4d3d-a7e8-403176cf53e4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:37.382064 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-469cd5fa-1253-4d3d-a7e8-403176cf53e4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:37.390876 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-469cd5fa-1253-4d3d-a7e8-403176cf53e4 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1267 microversion: 2.1 time: 0.196140 Aug 04 05:19:37.392285 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1274/2547] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:37 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:19:38.417807 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-beca94bc-440c-4656-985a-4160b051b878 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:38.418561 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-beca94bc-440c-4656-985a-4160b051b878 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:38.427571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-beca94bc-440c-4656-985a-4160b051b878 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:38.428018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-beca94bc-440c-4656-985a-4160b051b878 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:38.428809 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-beca94bc-440c-4656-985a-4160b051b878 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:38.430086 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-beca94bc-440c-4656-985a-4160b051b878 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:38.624703 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-beca94bc-440c-4656-985a-4160b051b878 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:38.633290 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-beca94bc-440c-4656-985a-4160b051b878 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1267 microversion: 2.1 time: 0.221623 Aug 04 05:19:38.633920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1274/2548] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:38 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:39.657207 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-217d3c13-ebcd-4172-938f-31ab33ce36ec tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:39.659057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-217d3c13-ebcd-4172-938f-31ab33ce36ec tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:39.668102 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-217d3c13-ebcd-4172-938f-31ab33ce36ec tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:39.668560 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-217d3c13-ebcd-4172-938f-31ab33ce36ec tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:39.669341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-217d3c13-ebcd-4172-938f-31ab33ce36ec tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:39.669808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-217d3c13-ebcd-4172-938f-31ab33ce36ec tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:39.822967 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-217d3c13-ebcd-4172-938f-31ab33ce36ec tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:39.832341 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-217d3c13-ebcd-4172-938f-31ab33ce36ec tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1267 microversion: 2.1 time: 0.180834 Aug 04 05:19:39.833371 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1275/2549] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:39 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:40.855650 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-01300f3d-dec3-44aa-b690-ce0c3fe5cea1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:40.856316 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-01300f3d-dec3-44aa-b690-ce0c3fe5cea1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:40.863865 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-01300f3d-dec3-44aa-b690-ce0c3fe5cea1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:40.864318 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-01300f3d-dec3-44aa-b690-ce0c3fe5cea1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:40.865090 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-01300f3d-dec3-44aa-b690-ce0c3fe5cea1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:40.865533 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-01300f3d-dec3-44aa-b690-ce0c3fe5cea1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:41.013831 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-01300f3d-dec3-44aa-b690-ce0c3fe5cea1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:41.021527 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-01300f3d-dec3-44aa-b690-ce0c3fe5cea1 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1267 microversion: 2.1 time: 0.169752 Aug 04 05:19:41.022115 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1275/2550] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:40 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:42.044778 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d52f5c4f-a55e-4f92-ad37-c6334260ad1a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:42.045681 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d52f5c4f-a55e-4f92-ad37-c6334260ad1a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:42.052528 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d52f5c4f-a55e-4f92-ad37-c6334260ad1a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:42.052985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d52f5c4f-a55e-4f92-ad37-c6334260ad1a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:42.053807 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d52f5c4f-a55e-4f92-ad37-c6334260ad1a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:42.054255 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d52f5c4f-a55e-4f92-ad37-c6334260ad1a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:42.238631 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-d52f5c4f-a55e-4f92-ad37-c6334260ad1a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:42.246757 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d52f5c4f-a55e-4f92-ad37-c6334260ad1a tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1267 microversion: 2.1 time: 0.207043 Aug 04 05:19:42.247340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1276/2551] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:42 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:43.269018 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-5ecba9d3-c742-45ff-b5fe-b2a50e097e5f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:43.269899 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-5ecba9d3-c742-45ff-b5fe-b2a50e097e5f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:43.276538 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ecba9d3-c742-45ff-b5fe-b2a50e097e5f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:43.276998 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ecba9d3-c742-45ff-b5fe-b2a50e097e5f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:43.277811 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ecba9d3-c742-45ff-b5fe-b2a50e097e5f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:43.278297 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-5ecba9d3-c742-45ff-b5fe-b2a50e097e5f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:43.371365 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=2 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:43.404690 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell0:SELECT=6 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:43.446325 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-5ecba9d3-c742-45ff-b5fe-b2a50e097e5f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:43.455613 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-5ecba9d3-c742-45ff-b5fe-b2a50e097e5f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1267 microversion: 2.1 time: 0.190914 Aug 04 05:19:43.456268 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1276/2552] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:43 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:19:44.479533 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-18a912a9-0e6e-4b24-afb3-c83b9eef1421 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:44.480147 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-18a912a9-0e6e-4b24-afb3-c83b9eef1421 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:44.482435 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell0:SELECT=2 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:44.488543 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18a912a9-0e6e-4b24-afb3-c83b9eef1421 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:44.488993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18a912a9-0e6e-4b24-afb3-c83b9eef1421 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:44.489799 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18a912a9-0e6e-4b24-afb3-c83b9eef1421 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:44.490239 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-18a912a9-0e6e-4b24-afb3-c83b9eef1421 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:44.642380 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-18a912a9-0e6e-4b24-afb3-c83b9eef1421 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:44.650382 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-18a912a9-0e6e-4b24-afb3-c83b9eef1421 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1267 microversion: 2.1 time: 0.174639 Aug 04 05:19:44.650955 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1277/2553] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:44 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:45.672040 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-74f9b9c4-a831-4ef6-97a7-3e0c0fc44458 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:45.673514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-74f9b9c4-a831-4ef6-97a7-3e0c0fc44458 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:45.681447 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-74f9b9c4-a831-4ef6-97a7-3e0c0fc44458 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:45.681447 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-74f9b9c4-a831-4ef6-97a7-3e0c0fc44458 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:45.682370 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-74f9b9c4-a831-4ef6-97a7-3e0c0fc44458 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:45.682813 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-74f9b9c4-a831-4ef6-97a7-3e0c0fc44458 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:45.863571 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-74f9b9c4-a831-4ef6-97a7-3e0c0fc44458 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:45.875265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-74f9b9c4-a831-4ef6-97a7-3e0c0fc44458 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1267 microversion: 2.1 time: 0.205218 Aug 04 05:19:45.875265 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1277/2554] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:45 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:19:46.894814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-fc93a0c7-2239-4851-ab4d-d40ee59f0afb tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:46.895659 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-fc93a0c7-2239-4851-ab4d-d40ee59f0afb tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:46.902586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc93a0c7-2239-4851-ab4d-d40ee59f0afb tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:46.903050 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc93a0c7-2239-4851-ab4d-d40ee59f0afb tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:46.903859 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc93a0c7-2239-4851-ab4d-d40ee59f0afb tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:46.904300 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-fc93a0c7-2239-4851-ab4d-d40ee59f0afb tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:47.070565 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-fc93a0c7-2239-4851-ab4d-d40ee59f0afb tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:47.078930 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-fc93a0c7-2239-4851-ab4d-d40ee59f0afb tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1267 microversion: 2.1 time: 0.188296 Aug 04 05:19:47.079907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1278/2555] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:46 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:47.327842 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-ed8bf00e-e556-4204-ab4e-f1871091288c req-2c98adc1-0080-481a-8d94-6698174bfeb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7537d3-c816-4ce2-91c3-47b54921121b", "name": "network-vif-plugged", "status": "completed", "tag": "955d2115-bc55-4b69-ba83-ae7e50ba0eba"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:47.339956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-ed8bf00e-e556-4204-ab4e-f1871091288c req-2c98adc1-0080-481a-8d94-6698174bfeb5 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:47.340794 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-ed8bf00e-e556-4204-ab4e-f1871091288c req-2c98adc1-0080-481a-8d94-6698174bfeb5 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:47.357152 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-ed8bf00e-e556-4204-ab4e-f1871091288c req-2c98adc1-0080-481a-8d94-6698174bfeb5 service nova] Creating event network-vif-plugged:955d2115-bc55-4b69-ba83-ae7e50ba0eba for instance 2c7537d3-c816-4ce2-91c3-47b54921121b on hv-cinder-85127 Aug 04 05:19:47.362927 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-ed8bf00e-e556-4204-ab4e-f1871091288c req-2c98adc1-0080-481a-8d94-6698174bfeb5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039320 Aug 04 05:19:47.363704 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1278/2556] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:19:48.106194 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-b4ec33f1-44df-41d8-bec4-0885c314e87f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:48.107306 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-b4ec33f1-44df-41d8-bec4-0885c314e87f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:48.119346 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b4ec33f1-44df-41d8-bec4-0885c314e87f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:48.120031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b4ec33f1-44df-41d8-bec4-0885c314e87f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:48.121196 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b4ec33f1-44df-41d8-bec4-0885c314e87f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:48.121927 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-b4ec33f1-44df-41d8-bec4-0885c314e87f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:48.283920 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-b4ec33f1-44df-41d8-bec4-0885c314e87f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:48.291588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-b4ec33f1-44df-41d8-bec4-0885c314e87f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1267 microversion: 2.1 time: 0.192654 Aug 04 05:19:48.292148 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1279/2557] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:48 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:49.315085 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e41b8051-03a9-4d36-bd18-17496dd1e43d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:49.315782 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-e41b8051-03a9-4d36-bd18-17496dd1e43d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:49.322057 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e41b8051-03a9-4d36-bd18-17496dd1e43d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:49.322505 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e41b8051-03a9-4d36-bd18-17496dd1e43d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:49.323263 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e41b8051-03a9-4d36-bd18-17496dd1e43d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:49.324003 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-e41b8051-03a9-4d36-bd18-17496dd1e43d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:49.479127 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-e41b8051-03a9-4d36-bd18-17496dd1e43d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:49.494024 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e41b8051-03a9-4d36-bd18-17496dd1e43d tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1454 microversion: 2.1 time: 0.184123 Aug 04 05:19:49.495069 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1279/2558] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:49 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1454 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:49.522542 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-defd10af-6474-44b6-8288-2b4fdd929f9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:49.523149 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-defd10af-6474-44b6-8288-2b4fdd929f9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:49.530256 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-defd10af-6474-44b6-8288-2b4fdd929f9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:49.530729 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-defd10af-6474-44b6-8288-2b4fdd929f9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:49.531816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-defd10af-6474-44b6-8288-2b4fdd929f9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:49.532881 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-defd10af-6474-44b6-8288-2b4fdd929f9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:49.703594 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-defd10af-6474-44b6-8288-2b4fdd929f9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:49.715532 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-defd10af-6474-44b6-8288-2b4fdd929f9e tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1454 microversion: 2.1 time: 0.196632 Aug 04 05:19:49.716548 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1280/2559] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:19:49 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1454 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:19:51.567967 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-3f529774-108e-4ef8-bf50-04f8a1bcd77c req-2079cffc-bcf6-484b-88ea-a616690db9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7537d3-c816-4ce2-91c3-47b54921121b", "tag": "955d2115-bc55-4b69-ba83-ae7e50ba0eba"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:19:51.573853 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:51.581710 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-3f529774-108e-4ef8-bf50-04f8a1bcd77c req-2079cffc-bcf6-484b-88ea-a616690db9d8 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:51.582252 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-3f529774-108e-4ef8-bf50-04f8a1bcd77c req-2079cffc-bcf6-484b-88ea-a616690db9d8 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:51.598409 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-3f529774-108e-4ef8-bf50-04f8a1bcd77c req-2079cffc-bcf6-484b-88ea-a616690db9d8 service nova] Creating event network-changed:955d2115-bc55-4b69-ba83-ae7e50ba0eba for instance 2c7537d3-c816-4ce2-91c3-47b54921121b on hv-cinder-85127 Aug 04 05:19:51.604070 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-3f529774-108e-4ef8-bf50-04f8a1bcd77c req-2079cffc-bcf6-484b-88ea-a616690db9d8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040679 Aug 04 05:19:51.604872 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1280/2560] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:19:57.486998 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-d7f31beb-dd8d-4712-a3b9-ce1910fcdffc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:57.489486 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-d7f31beb-dd8d-4712-a3b9-ce1910fcdffc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:57.492071 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=22 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:19:57.497788 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7f31beb-dd8d-4712-a3b9-ce1910fcdffc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:57.498247 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7f31beb-dd8d-4712-a3b9-ce1910fcdffc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:57.499016 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7f31beb-dd8d-4712-a3b9-ce1910fcdffc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:57.499489 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-d7f31beb-dd8d-4712-a3b9-ce1910fcdffc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:57.549521 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-d7f31beb-dd8d-4712-a3b9-ce1910fcdffc tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066962 Aug 04 05:19:57.550222 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1281/2561] 10.222.0.47 () {60 vars in 1343 bytes} [Thu Aug 4 05:19:57 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 05:19:57.623729 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ca11db3e-79d5-4f09-ad02-6d665cbb2e9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:57.624306 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ca11db3e-79d5-4f09-ad02-6d665cbb2e9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:57.631920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca11db3e-79d5-4f09-ad02-6d665cbb2e9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:57.632692 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca11db3e-79d5-4f09-ad02-6d665cbb2e9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:57.633992 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca11db3e-79d5-4f09-ad02-6d665cbb2e9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:57.634463 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ca11db3e-79d5-4f09-ad02-6d665cbb2e9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:57.664735 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ca11db3e-79d5-4f09-ad02-6d665cbb2e9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Going to try to terminate instance {{(pid=134883) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:19:57.757894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ca11db3e-79d5-4f09-ad02-6d665cbb2e9d tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "DELETE /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 204 len: 0 microversion: 2.20 time: 0.138446 Aug 04 05:19:57.758835 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1281/2562] 10.222.0.47 () {60 vars in 1280 bytes} [Thu Aug 4 05:19:57 2022] DELETE /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 05:19:57.775010 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-66620232-cdec-47f0-b463-053c49e7fb6c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:57.776089 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-66620232-cdec-47f0-b463-053c49e7fb6c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:57.784029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66620232-cdec-47f0-b463-053c49e7fb6c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:57.784533 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66620232-cdec-47f0-b463-053c49e7fb6c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:57.785510 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66620232-cdec-47f0-b463-053c49e7fb6c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:57.786061 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-66620232-cdec-47f0-b463-053c49e7fb6c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:57.939934 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-66620232-cdec-47f0-b463-053c49e7fb6c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:57.950330 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-66620232-cdec-47f0-b463-053c49e7fb6c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:57.952538 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-66620232-cdec-47f0-b463-053c49e7fb6c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:57.955666 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-66620232-cdec-47f0-b463-053c49e7fb6c tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.189601 Aug 04 05:19:57.956647 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1282/2563] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:57 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:19:58.985050 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ea45740a-9692-4318-8f62-eada48ba5ed3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:19:58.985822 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ea45740a-9692-4318-8f62-eada48ba5ed3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:19:58.992486 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea45740a-9692-4318-8f62-eada48ba5ed3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:58.992941 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea45740a-9692-4318-8f62-eada48ba5ed3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:58.993747 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea45740a-9692-4318-8f62-eada48ba5ed3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:19:58.994194 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ea45740a-9692-4318-8f62-eada48ba5ed3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:19:59.159740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ea45740a-9692-4318-8f62-eada48ba5ed3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:59.168259 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ea45740a-9692-4318-8f62-eada48ba5ed3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:59.169792 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ea45740a-9692-4318-8f62-eada48ba5ed3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:19:59.170981 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ea45740a-9692-4318-8f62-eada48ba5ed3 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1726 microversion: 2.20 time: 0.190416 Aug 04 05:19:59.171560 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1282/2564] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:19:58 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 05:20:00.198507 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-480d2888-7aa6-4aba-ac05-d191e3fac47a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:00.199264 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-480d2888-7aa6-4aba-ac05-d191e3fac47a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:00.208389 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-480d2888-7aa6-4aba-ac05-d191e3fac47a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:00.208985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-480d2888-7aa6-4aba-ac05-d191e3fac47a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:00.210201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-480d2888-7aa6-4aba-ac05-d191e3fac47a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:00.210658 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-480d2888-7aa6-4aba-ac05-d191e3fac47a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:00.300162 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-480d2888-7aa6-4aba-ac05-d191e3fac47a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:00.315683 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-480d2888-7aa6-4aba-ac05-d191e3fac47a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:00.319432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-480d2888-7aa6-4aba-ac05-d191e3fac47a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28bf7f4d000248c9b40c1b4e596b5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27540203cac4353859078edecd89b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:00.321174 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-480d2888-7aa6-4aba-ac05-d191e3fac47a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 200 len: 1658 microversion: 2.20 time: 0.126719 Aug 04 05:20:00.322492 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1283/2565] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:20:00 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 1658 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 05:20:00.561417 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-e4d935b5-a859-4735-827e-b9eb6cacb05c req-c6e514b4-5736-4cd8-b9c6-774e10de2161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55a20351-3bba-4e9f-9291-141d8db265c0", "name": "network-vif-deleted", "tag": "c7d845bb-700b-4c12-9596-4c246d13b053"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:20:00.573740 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-e4d935b5-a859-4735-827e-b9eb6cacb05c req-c6e514b4-5736-4cd8-b9c6-774e10de2161 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:00.574574 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-e4d935b5-a859-4735-827e-b9eb6cacb05c req-c6e514b4-5736-4cd8-b9c6-774e10de2161 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:00.590345 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-e4d935b5-a859-4735-827e-b9eb6cacb05c req-c6e514b4-5736-4cd8-b9c6-774e10de2161 service nova] Creating event network-vif-deleted:c7d845bb-700b-4c12-9596-4c246d13b053 for instance 55a20351-3bba-4e9f-9291-141d8db265c0 on hv-cinder-85127 Aug 04 05:20:00.597321 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-e4d935b5-a859-4735-827e-b9eb6cacb05c req-c6e514b4-5736-4cd8-b9c6-774e10de2161 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041781 Aug 04 05:20:00.598243 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1283/2566] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:20:01.357189 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7639d85f-7fec-470e-8b1d-cd64ba2df5ab tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:01.358079 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-7639d85f-7fec-470e-8b1d-cd64ba2df5ab tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:01.367506 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7639d85f-7fec-470e-8b1d-cd64ba2df5ab tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:01.367957 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7639d85f-7fec-470e-8b1d-cd64ba2df5ab tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:01.368813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7639d85f-7fec-470e-8b1d-cd64ba2df5ab tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:01.369253 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-7639d85f-7fec-470e-8b1d-cd64ba2df5ab tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:01.387204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-7639d85f-7fec-470e-8b1d-cd64ba2df5ab tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] HTTP exception thrown: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7639d85f-7fec-470e-8b1d-cd64ba2df5ab tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Request method failure captured: Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 HTTP/1.1 Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi61W9anpa4fczbUpfvMTekzd0t9WtJLqri3o0w5k7oHbx7HNurEnNUvnlXhXOoStt4wdJWbdW1HBz3SWcizlrzZ-xdol9Fjvh0EHdFAm8qE_oWgknYbhB49HJndraj6NyRcJqZ0Buw4iYjEYBHb4ZoIrqGcn4_3KGuQY26prkT5lobVU Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: c27540203cac4353859078edecd89b4d Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:20:01.389581 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:20:01.392244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c27540203cac4353859078edecd89b4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c27540203cac4353859078edecd89b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c27540203cac4353859078edecd89b4d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c27540203cac4353859078edecd89b4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:20:01.392244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:01.392244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: c27540203cac4353859078edecd89b4d Aug 04 05:20:01.392244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:01.392244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeShelveTestJSON-1230091245-project Aug 04 05:20:01.392244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:20:01.392244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:20:01.392244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 28bf7f4d000248c9b40c1b4e596b5d3a Aug 04 05:20:01.392244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1230091245-project Aug 04 05:20:01.392244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:20:01.392244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:01.392244 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '55a20351-3bba-4e9f-9291-141d8db265c0'} Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:20:01.393798 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:01.396178 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:01.398262 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-7639d85f-7fec-470e-8b1d-cd64ba2df5ab tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Returning 404 to user: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:20:01.398262 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-7639d85f-7fec-470e-8b1d-cd64ba2df5ab tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 404 len: 111 microversion: 2.20 time: 0.042296 Aug 04 05:20:01.399597 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1284/2567] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:20:01 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:20:01.409756 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-12181c5e-c20a-411b-aef2-45953e79d862 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '.version_select at 0x7fc946a00b80>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:01.436273 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-12181c5e-c20a-411b-aef2-45953e79d862 tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1004555052" status: 204 len: 0 microversion: 2.20 time: 0.030918 Aug 04 05:20:01.436635 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1284/2568] 10.222.0.47 () {60 vars in 1262 bytes} [Thu Aug 4 05:20:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1004555052 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 05:20:03.032026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-8f660707-418c-4d8c-ba44-123bed40ff08 req-0be1153c-f037-4613-8167-9857967634b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd63e685-c924-4940-ba66-4128dead0a60", "tag": "753b26da-a0d7-412a-b173-7ac7d5ad56de"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:20:03.033607 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-9d917e1d-48c6-4c3f-949c-dad07a23f743 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:03.034728 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9d917e1d-48c6-4c3f-949c-dad07a23f743 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:03.044496 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9d917e1d-48c6-4c3f-949c-dad07a23f743 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:03.045321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9d917e1d-48c6-4c3f-949c-dad07a23f743 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:03.047441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9d917e1d-48c6-4c3f-949c-dad07a23f743 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:03.048411 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-9d917e1d-48c6-4c3f-949c-dad07a23f743 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:03.056266 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-8f660707-418c-4d8c-ba44-123bed40ff08 req-0be1153c-f037-4613-8167-9857967634b2 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:03.056734 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-8f660707-418c-4d8c-ba44-123bed40ff08 req-0be1153c-f037-4613-8167-9857967634b2 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:03.071216 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-8f660707-418c-4d8c-ba44-123bed40ff08 req-0be1153c-f037-4613-8167-9857967634b2 service nova] Creating event network-changed:753b26da-a0d7-412a-b173-7ac7d5ad56de for instance bd63e685-c924-4940-ba66-4128dead0a60 on hv-cinder-85127 Aug 04 05:20:03.076977 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-8f660707-418c-4d8c-ba44-123bed40ff08 req-0be1153c-f037-4613-8167-9857967634b2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052044 Aug 04 05:20:03.077864 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1285/2569] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:20:03.086993 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-9d917e1d-48c6-4c3f-949c-dad07a23f743 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Going to try to terminate instance {{(pid=134884) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:20:03.212258 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-9d917e1d-48c6-4c3f-949c-dad07a23f743 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 204 len: 0 microversion: 2.1 time: 0.189611 Aug 04 05:20:03.213031 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1285/2570] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 05:20:03 2022] DELETE /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:20:03.229621 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4db62996-da21-4e08-a67b-df29d69650b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:03.231209 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4db62996-da21-4e08-a67b-df29d69650b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:03.243447 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4db62996-da21-4e08-a67b-df29d69650b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:03.244560 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4db62996-da21-4e08-a67b-df29d69650b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:03.246211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4db62996-da21-4e08-a67b-df29d69650b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:03.247216 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4db62996-da21-4e08-a67b-df29d69650b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:03.282135 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:03.453737 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4db62996-da21-4e08-a67b-df29d69650b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:03.465732 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4db62996-da21-4e08-a67b-df29d69650b1 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1566 microversion: 2.1 time: 0.246997 Aug 04 05:20:03.466804 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1286/2571] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:03 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1566 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:03.899785 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c3969448-025b-4055-9707-6478ce79cc0a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:03.900167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c3969448-025b-4055-9707-6478ce79cc0a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:03.911743 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c3969448-025b-4055-9707-6478ce79cc0a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:03.912522 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c3969448-025b-4055-9707-6478ce79cc0a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:03.913924 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c3969448-025b-4055-9707-6478ce79cc0a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:03.914672 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c3969448-025b-4055-9707-6478ce79cc0a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:03.938647 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-c3969448-025b-4055-9707-6478ce79cc0a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] HTTP exception thrown: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c3969448-025b-4055-9707-6478ce79cc0a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Request method failure captured: Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: DELETE /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 HTTP/1.1 Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi61W9anpa4fczbUpfvMTekzd0t9WtJLqri3o0w5k7oHbx7HNurEnNUvnlXhXOoStt4wdJWbdW1HBz3SWcizlrzZ-xdol9Fjvh0EHdFAm8qE_oWgknYbhB49HJndraj6NyRcJqZ0Buw4iYjEYBHb4ZoIrqGcn4_3KGuQY26prkT5lobVU Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: c27540203cac4353859078edecd89b4d Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:20:03.940297 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:20:03.942626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c27540203cac4353859078edecd89b4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c27540203cac4353859078edecd89b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c27540203cac4353859078edecd89b4d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c27540203cac4353859078edecd89b4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:20:03.942626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:03.942626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: c27540203cac4353859078edecd89b4d Aug 04 05:20:03.942626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:03.942626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeShelveTestJSON-1230091245-project Aug 04 05:20:03.942626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:20:03.942626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:20:03.942626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 28bf7f4d000248c9b40c1b4e596b5d3a Aug 04 05:20:03.942626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1230091245-project Aug 04 05:20:03.942626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:20:03.942626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:03.942626 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '55a20351-3bba-4e9f-9291-141d8db265c0'} Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:20:03.944321 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:03.947033 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:03.949029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c3969448-025b-4055-9707-6478ce79cc0a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Returning 404 to user: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:20:03.949029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c3969448-025b-4055-9707-6478ce79cc0a tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "DELETE /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 404 len: 111 microversion: 2.20 time: 0.051345 Aug 04 05:20:03.949029 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1286/2572] 10.222.0.47 () {60 vars in 1280 bytes} [Thu Aug 4 05:20:03 2022] DELETE /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:20:03.955239 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-31bb4ea6-29e7-4f1d-816f-42dd130be1fa tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:03.956037 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-31bb4ea6-29e7-4f1d-816f-42dd130be1fa tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 55a20351-3bba-4e9f-9291-141d8db265c0] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:03.962938 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31bb4ea6-29e7-4f1d-816f-42dd130be1fa tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:03.963573 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31bb4ea6-29e7-4f1d-816f-42dd130be1fa tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:03.964468 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31bb4ea6-29e7-4f1d-816f-42dd130be1fa tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:03.964968 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-31bb4ea6-29e7-4f1d-816f-42dd130be1fa tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:03.981870 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-31bb4ea6-29e7-4f1d-816f-42dd130be1fa tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] HTTP exception thrown: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-31bb4ea6-29e7-4f1d-816f-42dd130be1fa tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Request method failure captured: Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 HTTP/1.1 Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi61W9anpa4fczbUpfvMTekzd0t9WtJLqri3o0w5k7oHbx7HNurEnNUvnlXhXOoStt4wdJWbdW1HBz3SWcizlrzZ-xdol9Fjvh0EHdFAm8qE_oWgknYbhB49HJndraj6NyRcJqZ0Buw4iYjEYBHb4ZoIrqGcn4_3KGuQY26prkT5lobVU Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: c27540203cac4353859078edecd89b4d Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:20:03.984228 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:20:03.986543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c27540203cac4353859078edecd89b4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c27540203cac4353859078edecd89b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c27540203cac4353859078edecd89b4d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c27540203cac4353859078edecd89b4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:20:03.986543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:03.986543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: c27540203cac4353859078edecd89b4d Aug 04 05:20:03.986543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:03.986543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-AttachVolumeShelveTestJSON-1230091245-project Aug 04 05:20:03.986543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:20:03.986543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:20:03.986543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 28bf7f4d000248c9b40c1b4e596b5d3a Aug 04 05:20:03.986543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1230091245-project Aug 04 05:20:03.986543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 05:20:03.986543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:03.986543 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': '55a20351-3bba-4e9f-9291-141d8db265c0'} Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:20:03.988235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. Aug 04 05:20:03.989514 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:03.992314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-31bb4ea6-29e7-4f1d-816f-42dd130be1fa tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Returning 404 to user: Instance 55a20351-3bba-4e9f-9291-141d8db265c0 could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:20:03.992314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-31bb4ea6-29e7-4f1d-816f-42dd130be1fa tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0" status: 404 len: 111 microversion: 2.20 time: 0.037835 Aug 04 05:20:03.992314 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1287/2573] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:20:03 2022] GET /compute/v2.1/servers/55a20351-3bba-4e9f-9291-141d8db265c0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 05:20:04.494331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-4e8bc702-96f9-4071-95aa-d00ce87e14cd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:04.495586 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-4e8bc702-96f9-4071-95aa-d00ce87e14cd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:04.503983 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e8bc702-96f9-4071-95aa-d00ce87e14cd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:04.504561 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e8bc702-96f9-4071-95aa-d00ce87e14cd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:04.507819 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e8bc702-96f9-4071-95aa-d00ce87e14cd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:04.508282 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-4e8bc702-96f9-4071-95aa-d00ce87e14cd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:04.695742 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-4e8bc702-96f9-4071-95aa-d00ce87e14cd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:04.704860 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-4e8bc702-96f9-4071-95aa-d00ce87e14cd tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1566 microversion: 2.1 time: 0.217932 Aug 04 05:20:04.705440 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1287/2574] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:04 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:05.184476 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d207cdc3-ad99-4e07-87b8-4d2eef8628ad tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:05.185220 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-d207cdc3-ad99-4e07-87b8-4d2eef8628ad tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:05.192232 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d207cdc3-ad99-4e07-87b8-4d2eef8628ad tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:05.192904 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d207cdc3-ad99-4e07-87b8-4d2eef8628ad tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:05.193923 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d207cdc3-ad99-4e07-87b8-4d2eef8628ad tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:05.194469 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-d207cdc3-ad99-4e07-87b8-4d2eef8628ad tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:05.209489 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-d207cdc3-ad99-4e07-87b8-4d2eef8628ad tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] HTTP exception thrown: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d207cdc3-ad99-4e07-87b8-4d2eef8628ad tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Request method failure captured: Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: DELETE /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 HTTP/1.1 Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi61W9anpa4fczbUpfvMTekzd0t9WtJLqri3o0w5k7oHbx7HNurEnNUvnlXhXOoStt4wdJWbdW1HBz3SWcizlrzZ-xdol9Fjvh0EHdFAm8qE_oWgknYbhB49HJndraj6NyRcJqZ0Buw4iYjEYBHb4ZoIrqGcn4_3KGuQY26prkT5lobVU Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: c27540203cac4353859078edecd89b4d Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:20:05.211165 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:20:05.212483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c27540203cac4353859078edecd89b4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c27540203cac4353859078edecd89b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c27540203cac4353859078edecd89b4d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c27540203cac4353859078edecd89b4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:20:05.212483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:05.212483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: c27540203cac4353859078edecd89b4d Aug 04 05:20:05.212483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:05.212483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-AttachVolumeShelveTestJSON-1230091245-project Aug 04 05:20:05.212483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:20:05.212483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:20:05.212483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 28bf7f4d000248c9b40c1b4e596b5d3a Aug 04 05:20:05.212483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1230091245-project Aug 04 05:20:05.212483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 05:20:05.212483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:20:05.212483 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': '226cfa69-f0ad-40f0-bbf2-65a99c5f9824'} Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:20:05.213454 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:20:05.215245 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:05.217787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-d207cdc3-ad99-4e07-87b8-4d2eef8628ad tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Returning 404 to user: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:20:05.217787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-d207cdc3-ad99-4e07-87b8-4d2eef8628ad tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "DELETE /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 404 len: 111 microversion: 2.20 time: 0.032011 Aug 04 05:20:05.217787 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1288/2575] 10.222.0.47 () {60 vars in 1280 bytes} [Thu Aug 4 05:20:05 2022] DELETE /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:20:05.227202 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1806eb82-e19e-4689-89ee-82952c2fc74b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:05.228319 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-1806eb82-e19e-4689-89ee-82952c2fc74b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] [instance: 226cfa69-f0ad-40f0-bbf2-65a99c5f9824] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:05.238289 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1806eb82-e19e-4689-89ee-82952c2fc74b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:05.238930 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1806eb82-e19e-4689-89ee-82952c2fc74b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:05.240167 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1806eb82-e19e-4689-89ee-82952c2fc74b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:05.240918 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-1806eb82-e19e-4689-89ee-82952c2fc74b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:05.260118 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-1806eb82-e19e-4689-89ee-82952c2fc74b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] HTTP exception thrown: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1806eb82-e19e-4689-89ee-82952c2fc74b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Request method failure captured: Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 HTTP/1.1 Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi61W9anpa4fczbUpfvMTekzd0t9WtJLqri3o0w5k7oHbx7HNurEnNUvnlXhXOoStt4wdJWbdW1HBz3SWcizlrzZ-xdol9Fjvh0EHdFAm8qE_oWgknYbhB49HJndraj6NyRcJqZ0Buw4iYjEYBHb4ZoIrqGcn4_3KGuQY26prkT5lobVU Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: c27540203cac4353859078edecd89b4d Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:20:05.262201 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:20:05.264678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c27540203cac4353859078edecd89b4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c27540203cac4353859078edecd89b4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c27540203cac4353859078edecd89b4d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c27540203cac4353859078edecd89b4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:20:05.264678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:05.264678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: c27540203cac4353859078edecd89b4d Aug 04 05:20:05.264678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1230091245 Aug 04 05:20:05.264678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-AttachVolumeShelveTestJSON-1230091245-project Aug 04 05:20:05.264678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:20:05.264678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:20:05.264678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 28bf7f4d000248c9b40c1b4e596b5d3a Aug 04 05:20:05.264678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1230091245-project Aug 04 05:20:05.264678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:20:05.264678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:20:05.264678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '226cfa69-f0ad-40f0-bbf2-65a99c5f9824'} Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:20:05.269639 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. Aug 04 05:20:05.270653 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:20:05.271585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1806eb82-e19e-4689-89ee-82952c2fc74b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] Returning 404 to user: Instance 226cfa69-f0ad-40f0-bbf2-65a99c5f9824 could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:20:05.271585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1806eb82-e19e-4689-89ee-82952c2fc74b tempest-AttachVolumeShelveTestJSON-1230091245 tempest-AttachVolumeShelveTestJSON-1230091245-project] 10.222.0.47 "GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824" status: 404 len: 111 microversion: 2.20 time: 0.044722 Aug 04 05:20:05.271585 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1288/2576] 10.222.0.47 () {60 vars in 1277 bytes} [Thu Aug 4 05:20:05 2022] GET /compute/v2.1/servers/226cfa69-f0ad-40f0-bbf2-65a99c5f9824 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 05:20:05.473592 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [req-6ac213b5-fa3d-4995-8bbe-294ea6ea0b28 req-04eecc2e-614f-49b9-9bca-4695d6b63979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd63e685-c924-4940-ba66-4128dead0a60", "name": "network-vif-deleted", "tag": "753b26da-a0d7-412a-b173-7ac7d5ad56de"}]} {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:20:05.487128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-6ac213b5-fa3d-4995-8bbe-294ea6ea0b28 req-04eecc2e-614f-49b9-9bca-4695d6b63979 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:05.487617 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [req-6ac213b5-fa3d-4995-8bbe-294ea6ea0b28 req-04eecc2e-614f-49b9-9bca-4695d6b63979 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:05.518012 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.compute.server_external_events [req-6ac213b5-fa3d-4995-8bbe-294ea6ea0b28 req-04eecc2e-614f-49b9-9bca-4695d6b63979 service nova] Creating event network-vif-deleted:753b26da-a0d7-412a-b173-7ac7d5ad56de for instance bd63e685-c924-4940-ba66-4128dead0a60 on hv-cinder-85127 Aug 04 05:20:05.519394 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [req-6ac213b5-fa3d-4995-8bbe-294ea6ea0b28 req-04eecc2e-614f-49b9-9bca-4695d6b63979 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160698 Aug 04 05:20:05.520959 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1289/2577] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:20:05.730091 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-68bc5091-27d8-4566-bfaf-40ab1643bc8a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:05.731432 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-68bc5091-27d8-4566-bfaf-40ab1643bc8a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:05.743171 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68bc5091-27d8-4566-bfaf-40ab1643bc8a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:05.743944 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68bc5091-27d8-4566-bfaf-40ab1643bc8a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:05.745791 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68bc5091-27d8-4566-bfaf-40ab1643bc8a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:05.746651 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-68bc5091-27d8-4566-bfaf-40ab1643bc8a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:05.851082 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-68bc5091-27d8-4566-bfaf-40ab1643bc8a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '932dfc6718754b04bb50d9e8444b05a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016110e9048a475f817a105e50f2cf6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:20:05.855949 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:20:05.865987 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-68bc5091-27d8-4566-bfaf-40ab1643bc8a tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 200 len: 1217 microversion: 2.1 time: 0.141404 Aug 04 05:20:05.867646 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1289/2578] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:05 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:20:06.893845 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0ca38f4d-4f8c-4ed8-8f88-bf2686e48582 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:06.896583 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0ca38f4d-4f8c-4ed8-8f88-bf2686e48582 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] [instance: bd63e685-c924-4940-ba66-4128dead0a60] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:20:06.904194 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ca38f4d-4f8c-4ed8-8f88-bf2686e48582 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:06.904676 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ca38f4d-4f8c-4ed8-8f88-bf2686e48582 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:06.905492 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ca38f4d-4f8c-4ed8-8f88-bf2686e48582 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:20:06.906207 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0ca38f4d-4f8c-4ed8-8f88-bf2686e48582 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:20:06.926623 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-0ca38f4d-4f8c-4ed8-8f88-bf2686e48582 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] HTTP exception thrown: Instance bd63e685-c924-4940-ba66-4128dead0a60 could not be found. Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0ca38f4d-4f8c-4ed8-8f88-bf2686e48582 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Request method failure captured: Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 HTTP/1.1 Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi61XyO61wnHDHkKD18KDvqkPnhkkWuJZ9S8bDT3SPKLBATo49PeiDn-MRkHnNbd6p8o5CBQIWhoBDdIzn56OaOwuKZ3ACP_4OtcX9TCbDZycbu_aaxZiVNqMfs8-nBxaCsXU4fXjdV3Y0XUHdqE1WvT9K6zCQ7N14wpamd1q_Z06GI0w Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 016110e9048a475f817a105e50f2cf6a Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-TestShelveInstance-197424722 Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:20:06.928462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:20:06.929848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/016110e9048a475f817a105e50f2cf6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/016110e9048a475f817a105e50f2cf6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_016110e9048a475f817a105e50f2cf6a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/016110e9048a475f817a105e50f2cf6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:20:06.929848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-TestShelveInstance-197424722 Aug 04 05:20:06.929848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 016110e9048a475f817a105e50f2cf6a Aug 04 05:20:06.929848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-TestShelveInstance-197424722 Aug 04 05:20:06.929848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-TestShelveInstance-197424722-project Aug 04 05:20:06.929848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:20:06.929848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:20:06.929848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 932dfc6718754b04bb50d9e8444b05a6 Aug 04 05:20:06.929848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-TestShelveInstance-197424722-project Aug 04 05:20:06.929848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 05:20:06.929848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance bd63e685-c924-4940-ba66-4128dead0a60 could not be found. Aug 04 05:20:06.929848 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': 'bd63e685-c924-4940-ba66-4128dead0a60'} Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd63e685-c924-4940-ba66-4128dead0a60 could not be found. Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:20:06.930673 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd63e685-c924-4940-ba66-4128dead0a60 could not be found. Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd63e685-c924-4940-ba66-4128dead0a60 could not be found. Aug 04 05:20:06.935128 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:20:06.936784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0ca38f4d-4f8c-4ed8-8f88-bf2686e48582 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Returning 404 to user: Instance bd63e685-c924-4940-ba66-4128dead0a60 could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:20:06.936784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0ca38f4d-4f8c-4ed8-8f88-bf2686e48582 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60" status: 404 len: 111 microversion: 2.1 time: 0.042117 Aug 04 05:20:06.936784 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1290/2579] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:20:06 2022] GET /compute/v2.1/servers/bd63e685-c924-4940-ba66-4128dead0a60 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:20:07.402026 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-1b3b6255-097a-4b7c-80ef-a74984c2ef48 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] Calling method '.version_select at 0x7fc9422a6550>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:20:07.446931 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-1b3b6255-097a-4b7c-80ef-a74984c2ef48 tempest-TestShelveInstance-197424722 tempest-TestShelveInstance-197424722-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-327351427" status: 202 len: 0 microversion: 2.1 time: 0.058439 Aug 04 05:20:07.448078 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1290/2580] 10.222.0.47 () {58 vars in 1251 bytes} [Thu Aug 4 05:20:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-327351427 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:21:23.782882 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:23.783911 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG dbcounter [-] [134883] Writing DB stats nova_cell1:SELECT=11 {{(pid=134883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:23.791465 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG dbcounter [-] [134884] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 05:21:23.799235 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-a8576963-47e5-4336-95e4-43f800380665 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:23.801456 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-582e27c2-2385-405a-97c0-14cc297cc6ff req-e951acd3-312d-448b-a226-77a3a451a939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7537d3-c816-4ce2-91c3-47b54921121b", "tag": "955d2115-bc55-4b69-ba83-ae7e50ba0eba"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:23.801696 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a8576963-47e5-4336-95e4-43f800380665 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:23.819988 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a8576963-47e5-4336-95e4-43f800380665 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:23.820616 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a8576963-47e5-4336-95e4-43f800380665 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:23.821936 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-582e27c2-2385-405a-97c0-14cc297cc6ff req-e951acd3-312d-448b-a226-77a3a451a939 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:23.822167 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a8576963-47e5-4336-95e4-43f800380665 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:23.822692 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-582e27c2-2385-405a-97c0-14cc297cc6ff req-e951acd3-312d-448b-a226-77a3a451a939 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:23.822876 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-a8576963-47e5-4336-95e4-43f800380665 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:23.848369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-582e27c2-2385-405a-97c0-14cc297cc6ff req-e951acd3-312d-448b-a226-77a3a451a939 service nova] Creating event network-changed:955d2115-bc55-4b69-ba83-ae7e50ba0eba for instance 2c7537d3-c816-4ce2-91c3-47b54921121b on hv-cinder-85127 Aug 04 05:21:23.854172 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-a8576963-47e5-4336-95e4-43f800380665 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Going to try to terminate instance {{(pid=134883) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:21:23.859279 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-582e27c2-2385-405a-97c0-14cc297cc6ff req-e951acd3-312d-448b-a226-77a3a451a939 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070900 Aug 04 05:21:23.860615 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1291/2581] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:21:23.975367 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-a8576963-47e5-4336-95e4-43f800380665 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 204 len: 0 microversion: 2.1 time: 0.194130 Aug 04 05:21:23.981562 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1291/2582] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 05:21:23 2022] DELETE /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:21:23.992086 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-77e5ff8a-bb23-42d5-b9d2-1a9bc09eca18 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:23.993588 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-77e5ff8a-bb23-42d5-b9d2-1a9bc09eca18 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:24.001358 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77e5ff8a-bb23-42d5-b9d2-1a9bc09eca18 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:24.002136 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77e5ff8a-bb23-42d5-b9d2-1a9bc09eca18 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:24.003200 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77e5ff8a-bb23-42d5-b9d2-1a9bc09eca18 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:24.003914 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-77e5ff8a-bb23-42d5-b9d2-1a9bc09eca18 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:24.252691 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-77e5ff8a-bb23-42d5-b9d2-1a9bc09eca18 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:24.268946 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-77e5ff8a-bb23-42d5-b9d2-1a9bc09eca18 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1579 microversion: 2.1 time: 0.284714 Aug 04 05:21:24.270028 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1292/2583] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:23 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1579 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:25.303792 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-bd3c8ce1-1910-4507-b383-810b4f9e1a1b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:25.304644 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-bd3c8ce1-1910-4507-b383-810b4f9e1a1b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:25.312819 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bd3c8ce1-1910-4507-b383-810b4f9e1a1b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:25.313339 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bd3c8ce1-1910-4507-b383-810b4f9e1a1b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:25.314213 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bd3c8ce1-1910-4507-b383-810b4f9e1a1b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:25.314668 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-bd3c8ce1-1910-4507-b383-810b4f9e1a1b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:25.563577 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-bd3c8ce1-1910-4507-b383-810b4f9e1a1b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:25.577304 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-bd3c8ce1-1910-4507-b383-810b4f9e1a1b tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1579 microversion: 2.1 time: 0.277755 Aug 04 05:21:25.587646 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1292/2584] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:25 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1579 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:26.159361 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-bba0a1bf-2094-4504-8ad1-d5e111d1d30d req-b1a78be7-912e-44a9-b968-c4c895faa1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7537d3-c816-4ce2-91c3-47b54921121b", "name": "network-vif-deleted", "tag": "955d2115-bc55-4b69-ba83-ae7e50ba0eba"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:26.178049 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-bba0a1bf-2094-4504-8ad1-d5e111d1d30d req-b1a78be7-912e-44a9-b968-c4c895faa1de service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:26.178832 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-bba0a1bf-2094-4504-8ad1-d5e111d1d30d req-b1a78be7-912e-44a9-b968-c4c895faa1de service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:26.197906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-bba0a1bf-2094-4504-8ad1-d5e111d1d30d req-b1a78be7-912e-44a9-b968-c4c895faa1de service nova] Creating event network-vif-deleted:955d2115-bc55-4b69-ba83-ae7e50ba0eba for instance 2c7537d3-c816-4ce2-91c3-47b54921121b on hv-cinder-85127 Aug 04 05:21:26.205700 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-bba0a1bf-2094-4504-8ad1-d5e111d1d30d req-b1a78be7-912e-44a9-b968-c4c895faa1de service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051713 Aug 04 05:21:26.206550 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1293/2585] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:21:26.604214 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-4070aec1-4664-4a62-a823-056102650a25 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:26.605974 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-4070aec1-4664-4a62-a823-056102650a25 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:26.626303 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4070aec1-4664-4a62-a823-056102650a25 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:26.627111 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4070aec1-4664-4a62-a823-056102650a25 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:26.628470 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4070aec1-4664-4a62-a823-056102650a25 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:26.629288 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4070aec1-4664-4a62-a823-056102650a25 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:26.688710 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4070aec1-4664-4a62-a823-056102650a25 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:26.689366 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-4070aec1-4664-4a62-a823-056102650a25 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:26.690432 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-4070aec1-4664-4a62-a823-056102650a25 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lazy-loading 'fault' on Instance uuid 2c7537d3-c816-4ce2-91c3-47b54921121b {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:21:26.760462 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-4070aec1-4664-4a62-a823-056102650a25 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:26.770242 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-4070aec1-4664-4a62-a823-056102650a25 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 200 len: 1231 microversion: 2.1 time: 0.173251 Aug 04 05:21:26.770932 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1293/2586] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:26 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 1231 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:27.794894 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c650cde4-a871-4012-b819-b19582608935 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:27.795999 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-c650cde4-a871-4012-b819-b19582608935 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 2c7537d3-c816-4ce2-91c3-47b54921121b] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:27.803850 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c650cde4-a871-4012-b819-b19582608935 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:27.804443 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c650cde4-a871-4012-b819-b19582608935 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:27.805323 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c650cde4-a871-4012-b819-b19582608935 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:27.805895 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-c650cde4-a871-4012-b819-b19582608935 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:27.821755 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-c650cde4-a871-4012-b819-b19582608935 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] HTTP exception thrown: Instance 2c7537d3-c816-4ce2-91c3-47b54921121b could not be found. Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c650cde4-a871-4012-b819-b19582608935 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Request method failure captured: Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b HTTP/1.1 Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi61WsLPOTQu-M3Dbssy7s6eRo314qI3D_BmYaqNCeAhG2qCzyvrjGR6JVVpTRbSFFgMKYQDv--X8QFUuLfOxuohH4jspMA1IslNCQhX4Pq9tLPI7erkE8xXkocHnqbkEVPuTm40ReuTwSUMQzpDwsGgRjOJF6AuJsKS6KQSYaYIpf8eo Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 731637c0b96a4f1f8d9edb1af69e98cb Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:21:27.823442 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:21:27.826340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_731637c0b96a4f1f8d9edb1af69e98cb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:21:27.826340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:21:27.826340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 731637c0b96a4f1f8d9edb1af69e98cb Aug 04 05:21:27.826340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:21:27.826340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-TestVolumeBootPattern-1698193638-project Aug 04 05:21:27.826340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:21:27.826340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:21:27.826340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 30c0ff27c5a84ebd8615fb4608fc3882 Aug 04 05:21:27.826340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-TestVolumeBootPattern-1698193638-project Aug 04 05:21:27.826340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:21:27.826340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 2c7537d3-c816-4ce2-91c3-47b54921121b could not be found. Aug 04 05:21:27.826340 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '2c7537d3-c816-4ce2-91c3-47b54921121b'} Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7537d3-c816-4ce2-91c3-47b54921121b could not be found. Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:21:27.828458 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7537d3-c816-4ce2-91c3-47b54921121b could not be found. Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7537d3-c816-4ce2-91c3-47b54921121b could not be found. Aug 04 05:21:27.831393 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:27.834064 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-c650cde4-a871-4012-b819-b19582608935 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Returning 404 to user: Instance 2c7537d3-c816-4ce2-91c3-47b54921121b could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:21:27.834064 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-c650cde4-a871-4012-b819-b19582608935 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b" status: 404 len: 111 microversion: 2.1 time: 0.035406 Aug 04 05:21:27.834064 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1294/2587] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:27 2022] GET /compute/v2.1/servers/2c7537d3-c816-4ce2-91c3-47b54921121b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 05:21:31.149894 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0704e7c0-dd0e-4e01-9375-70ceda7ff6c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:31.150896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0704e7c0-dd0e-4e01-9375-70ceda7ff6c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:31.157035 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-0475f7b3-9ae0-44b0-91e2-b900182f3adc req-487d571b-583e-45a0-8b35-d17d5e0c2da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc11b935-45b3-44f8-9ae7-2337626e4bfe", "tag": "7e816285-de19-41d3-9d24-e689ba4e635b"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:31.162446 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0704e7c0-dd0e-4e01-9375-70ceda7ff6c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:31.163225 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0704e7c0-dd0e-4e01-9375-70ceda7ff6c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:31.164579 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0704e7c0-dd0e-4e01-9375-70ceda7ff6c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:31.165267 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0704e7c0-dd0e-4e01-9375-70ceda7ff6c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:31.176958 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-0475f7b3-9ae0-44b0-91e2-b900182f3adc req-487d571b-583e-45a0-8b35-d17d5e0c2da7 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:31.177985 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-0475f7b3-9ae0-44b0-91e2-b900182f3adc req-487d571b-583e-45a0-8b35-d17d5e0c2da7 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:31.198026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0704e7c0-dd0e-4e01-9375-70ceda7ff6c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Going to try to terminate instance {{(pid=134883) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 05:21:31.205523 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-0475f7b3-9ae0-44b0-91e2-b900182f3adc req-487d571b-583e-45a0-8b35-d17d5e0c2da7 service nova] Creating event network-changed:7e816285-de19-41d3-9d24-e689ba4e635b for instance dc11b935-45b3-44f8-9ae7-2337626e4bfe on hv-cinder-85127 Aug 04 05:21:31.216509 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-0475f7b3-9ae0-44b0-91e2-b900182f3adc req-487d571b-583e-45a0-8b35-d17d5e0c2da7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066643 Aug 04 05:21:31.225750 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1295/2588] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 05:21:31.344051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0704e7c0-dd0e-4e01-9375-70ceda7ff6c2 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 204 len: 0 microversion: 2.1 time: 0.200402 Aug 04 05:21:31.344051 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1294/2589] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 05:21:31 2022] DELETE /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 05:21:31.355243 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-671b8b07-8bc0-4f19-ad7e-00b95a12e411 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:31.356331 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-671b8b07-8bc0-4f19-ad7e-00b95a12e411 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:31.363857 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-671b8b07-8bc0-4f19-ad7e-00b95a12e411 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:31.364313 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-671b8b07-8bc0-4f19-ad7e-00b95a12e411 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:31.365080 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-671b8b07-8bc0-4f19-ad7e-00b95a12e411 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:31.365508 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-671b8b07-8bc0-4f19-ad7e-00b95a12e411 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:31.564601 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.policy [None req-671b8b07-8bc0-4f19-ad7e-00b95a12e411 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:31.575578 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-671b8b07-8bc0-4f19-ad7e-00b95a12e411 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1577 microversion: 2.1 time: 0.226569 Aug 04 05:21:31.576512 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1296/2590] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:31 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:32.615633 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-ef43a18f-f60c-4aaf-b4ef-00c5eb94f07f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:32.616920 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-ef43a18f-f60c-4aaf-b4ef-00c5eb94f07f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:32.627951 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ef43a18f-f60c-4aaf-b4ef-00c5eb94f07f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:32.628830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ef43a18f-f60c-4aaf-b4ef-00c5eb94f07f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:32.630108 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ef43a18f-f60c-4aaf-b4ef-00c5eb94f07f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:32.630808 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-ef43a18f-f60c-4aaf-b4ef-00c5eb94f07f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:32.851729 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-ef43a18f-f60c-4aaf-b4ef-00c5eb94f07f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:32.870246 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-ef43a18f-f60c-4aaf-b4ef-00c5eb94f07f tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1577 microversion: 2.1 time: 0.262133 Aug 04 05:21:32.871830 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1295/2591] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:32 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1577 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:33.382816 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [req-8c6aa55c-ca59-4315-9d7a-ee33c2c1a2b0 req-b46333cb-98d7-475b-9ae0-72d453ca4513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc11b935-45b3-44f8-9ae7-2337626e4bfe", "name": "network-vif-deleted", "tag": "7e816285-de19-41d3-9d24-e689ba4e635b"}]} {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 05:21:33.398122 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-8c6aa55c-ca59-4315-9d7a-ee33c2c1a2b0 req-b46333cb-98d7-475b-9ae0-72d453ca4513 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:33.398618 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [req-8c6aa55c-ca59-4315-9d7a-ee33c2c1a2b0 req-b46333cb-98d7-475b-9ae0-72d453ca4513 service nova] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:33.412950 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.compute.server_external_events [req-8c6aa55c-ca59-4315-9d7a-ee33c2c1a2b0 req-b46333cb-98d7-475b-9ae0-72d453ca4513 service nova] Creating event network-vif-deleted:7e816285-de19-41d3-9d24-e689ba4e635b for instance dc11b935-45b3-44f8-9ae7-2337626e4bfe on hv-cinder-85127 Aug 04 05:21:33.422223 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [req-8c6aa55c-ca59-4315-9d7a-ee33c2c1a2b0 req-b46333cb-98d7-475b-9ae0-72d453ca4513 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050017 Aug 04 05:21:33.422906 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1297/2592] 10.222.0.47 () {64 vars in 1317 bytes} [Thu Aug 4 05:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 05:21:33.898022 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-c3822b5e-ab57-4671-88fd-5fcc9c1c9533 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:33.899080 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-c3822b5e-ab57-4671-88fd-5fcc9c1c9533 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:33.909956 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3822b5e-ab57-4671-88fd-5fcc9c1c9533 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:33.910664 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3822b5e-ab57-4671-88fd-5fcc9c1c9533 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:33.911874 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3822b5e-ab57-4671-88fd-5fcc9c1c9533 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:33.912690 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3822b5e-ab57-4671-88fd-5fcc9c1c9533 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:33.957529 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3822b5e-ab57-4671-88fd-5fcc9c1c9533 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:33.958026 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-c3822b5e-ab57-4671-88fd-5fcc9c1c9533 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:33.958474 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.objects.instance [None req-c3822b5e-ab57-4671-88fd-5fcc9c1c9533 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lazy-loading 'fault' on Instance uuid dc11b935-45b3-44f8-9ae7-2337626e4bfe {{(pid=134883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 05:21:34.023184 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.policy [None req-c3822b5e-ab57-4671-88fd-5fcc9c1c9533 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c0ff27c5a84ebd8615fb4608fc3882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731637c0b96a4f1f8d9edb1af69e98cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 05:21:34.034300 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-c3822b5e-ab57-4671-88fd-5fcc9c1c9533 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 200 len: 1230 microversion: 2.1 time: 0.142526 Aug 04 05:21:34.034893 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1296/2593] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:33 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 1230 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 05:21:35.075678 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-678d114f-a7ca-4d42-9a7e-aa3f39facfc6 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:35.076930 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-678d114f-a7ca-4d42-9a7e-aa3f39facfc6 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: dc11b935-45b3-44f8-9ae7-2337626e4bfe] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:35.087698 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-678d114f-a7ca-4d42-9a7e-aa3f39facfc6 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:35.088150 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-678d114f-a7ca-4d42-9a7e-aa3f39facfc6 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:35.089252 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-678d114f-a7ca-4d42-9a7e-aa3f39facfc6 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:35.089995 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-678d114f-a7ca-4d42-9a7e-aa3f39facfc6 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:35.112654 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-678d114f-a7ca-4d42-9a7e-aa3f39facfc6 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] HTTP exception thrown: Instance dc11b935-45b3-44f8-9ae7-2337626e4bfe could not be found. Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-678d114f-a7ca-4d42-9a7e-aa3f39facfc6 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Request method failure captured: Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe HTTP/1.1 Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi61WsLPOTQu-M3Dbssy7s6eRo314qI3D_BmYaqNCeAhG2qCzyvrjGR6JVVpTRbSFFgMKYQDv--X8QFUuLfOxuohH4jspMA1IslNCQhX4Pq9tLPI7erkE8xXkocHnqbkEVPuTm40ReuTwSUMQzpDwsGgRjOJF6AuJsKS6KQSYaYIpf8eo Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 731637c0b96a4f1f8d9edb1af69e98cb Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:21:35.114369 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:21:35.115761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_731637c0b96a4f1f8d9edb1af69e98cb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:21:35.115761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:21:35.115761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 731637c0b96a4f1f8d9edb1af69e98cb Aug 04 05:21:35.115761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:21:35.115761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-TestVolumeBootPattern-1698193638-project Aug 04 05:21:35.115761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:21:35.115761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:21:35.115761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 30c0ff27c5a84ebd8615fb4608fc3882 Aug 04 05:21:35.115761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-TestVolumeBootPattern-1698193638-project Aug 04 05:21:35.115761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:21:35.115761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance dc11b935-45b3-44f8-9ae7-2337626e4bfe could not be found. Aug 04 05:21:35.115761 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': 'dc11b935-45b3-44f8-9ae7-2337626e4bfe'} Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc11b935-45b3-44f8-9ae7-2337626e4bfe could not be found. Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:21:35.116422 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc11b935-45b3-44f8-9ae7-2337626e4bfe could not be found. Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc11b935-45b3-44f8-9ae7-2337626e4bfe could not be found. Aug 04 05:21:35.117814 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.120441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-678d114f-a7ca-4d42-9a7e-aa3f39facfc6 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Returning 404 to user: Instance dc11b935-45b3-44f8-9ae7-2337626e4bfe could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:21:35.120441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-678d114f-a7ca-4d42-9a7e-aa3f39facfc6 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe" status: 404 len: 111 microversion: 2.1 time: 0.049068 Aug 04 05:21:35.120441 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1298/2594] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:35 2022] GET /compute/v2.1/servers/dc11b935-45b3-44f8-9ae7-2337626e4bfe => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:21:35.642931 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0d2a48e1-c918-4fba-80a6-887f4eb3a305 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:35.643530 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.compute.api [None req-0d2a48e1-c918-4fba-80a6-887f4eb3a305 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134883) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:35.651253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d2a48e1-c918-4fba-80a6-887f4eb3a305 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:35.651253 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d2a48e1-c918-4fba-80a6-887f4eb3a305 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:35.653596 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d2a48e1-c918-4fba-80a6-887f4eb3a305 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:35.654055 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG oslo_concurrency.lockutils [None req-0d2a48e1-c918-4fba-80a6-887f4eb3a305 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:35.680155 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.wsgi [None req-0d2a48e1-c918-4fba-80a6-887f4eb3a305 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] HTTP exception thrown: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0d2a48e1-c918-4fba-80a6-887f4eb3a305 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Request method failure captured: Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: request: DELETE /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e HTTP/1.1 Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept: application/json Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Accept-Encoding: identity Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Connection: close Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Length: 0 Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Content-Type: application/json Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Host: 10.222.0.47 Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Openstack-System-Scope: None Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: User-Agent: python-urllib3/1.26.11 Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Auth-Token: gAAAAABi61WsLPOTQu-M3Dbssy7s6eRo314qI3D_BmYaqNCeAhG2qCzyvrjGR6JVVpTRbSFFgMKYQDv--X8QFUuLfOxuohH4jspMA1IslNCQhX4Pq9tLPI7erkE8xXkocHnqbkEVPuTm40ReuTwSUMQzpDwsGgRjOJF6AuJsKS6KQSYaYIpf8eo Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Id: None Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Domain-Name: None Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Identity-Status: Confirmed Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Is-Admin-Project: True Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Id: default Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Domain-Name: Default Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Id: 731637c0b96a4f1f8d9edb1af69e98cb Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Project-Name: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Role: member,reader Aug 04 05:21:35.682521 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Roles: member,reader Aug 04 05:21:35.684134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_731637c0b96a4f1f8d9edb1af69e98cb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:21:35.684134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:21:35.684134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Id: 731637c0b96a4f1f8d9edb1af69e98cb Aug 04 05:21:35.684134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-Tenant-Name: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:21:35.684134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User: tempest-TestVolumeBootPattern-1698193638-project Aug 04 05:21:35.684134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Id: default Aug 04 05:21:35.684134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Domain-Name: Default Aug 04 05:21:35.684134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Id: 30c0ff27c5a84ebd8615fb4608fc3882 Aug 04 05:21:35.684134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: X-User-Name: tempest-TestVolumeBootPattern-1698193638-project Aug 04 05:21:35.684134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: method: > Aug 04 05:21:35.684134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: exception: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:21:35.684134 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: action_args: {'id': '8bd146ac-9a7e-4703-bb98-74e43843451e'} Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:21:35.684896 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:21:35.686269 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.688078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-0d2a48e1-c918-4fba-80a6-887f4eb3a305 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Returning 404 to user: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. {{(pid=134883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:21:35.688078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-0d2a48e1-c918-4fba-80a6-887f4eb3a305 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 404 len: 111 microversion: 2.1 time: 0.047462 Aug 04 05:21:35.688078 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1297/2595] 10.222.0.47 () {58 vars in 1239 bytes} [Thu Aug 4 05:21:35 2022] DELETE /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:21:35.696813 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6130e098-b7f1-4231-a58e-f658baf1c4f0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '>' {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:35.697436 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.compute.api [None req-6130e098-b7f1-4231-a58e-f658baf1c4f0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] [instance: 8bd146ac-9a7e-4703-bb98-74e43843451e] Fetching instance by UUID {{(pid=134884) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 05:21:35.704426 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6130e098-b7f1-4231-a58e-f658baf1c4f0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:35.704904 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6130e098-b7f1-4231-a58e-f658baf1c4f0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:35.705733 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6130e098-b7f1-4231-a58e-f658baf1c4f0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 05:21:35.706173 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG oslo_concurrency.lockutils [None req-6130e098-b7f1-4231-a58e-f658baf1c4f0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Lock "dc17ecad-4eac-4f3a-b656-dcc6b9ec830f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 05:21:35.721434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.wsgi [None req-6130e098-b7f1-4231-a58e-f658baf1c4f0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] HTTP exception thrown: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6130e098-b7f1-4231-a58e-f658baf1c4f0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Request method failure captured: Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: request: GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e HTTP/1.1 Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept: application/json Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Accept-Encoding: identity Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Connection: close Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Length: 0 Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Content-Type: application/json Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Host: 10.222.0.47 Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Openstack-System-Scope: None Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: User-Agent: python-urllib3/1.26.11 Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Auth-Token: gAAAAABi61WsLPOTQu-M3Dbssy7s6eRo314qI3D_BmYaqNCeAhG2qCzyvrjGR6JVVpTRbSFFgMKYQDv--X8QFUuLfOxuohH4jspMA1IslNCQhX4Pq9tLPI7erkE8xXkocHnqbkEVPuTm40ReuTwSUMQzpDwsGgRjOJF6AuJsKS6KQSYaYIpf8eo Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Id: None Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Domain-Name: None Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Identity-Status: Confirmed Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Is-Admin-Project: True Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Id: default Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Domain-Name: Default Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Id: 731637c0b96a4f1f8d9edb1af69e98cb Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Project-Name: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Role: member,reader Aug 04 05:21:35.723015 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Roles: member,reader Aug 04 05:21:35.724420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_731637c0b96a4f1f8d9edb1af69e98cb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/731637c0b96a4f1f8d9edb1af69e98cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Aug 04 05:21:35.724420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:21:35.724420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Id: 731637c0b96a4f1f8d9edb1af69e98cb Aug 04 05:21:35.724420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1698193638 Aug 04 05:21:35.724420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User: tempest-TestVolumeBootPattern-1698193638-project Aug 04 05:21:35.724420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Id: default Aug 04 05:21:35.724420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Domain-Name: Default Aug 04 05:21:35.724420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Id: 30c0ff27c5a84ebd8615fb4608fc3882 Aug 04 05:21:35.724420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: X-User-Name: tempest-TestVolumeBootPattern-1698193638-project Aug 04 05:21:35.724420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: method: > Aug 04 05:21:35.724420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: exception: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:21:35.724420 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: action_args: {'id': '8bd146ac-9a7e-4703-bb98-74e43843451e'} Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: {{(pid=134884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 05:21:35.725808 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. Aug 04 05:21:35.728056 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: ERROR nova.api.openstack.wsgi Aug 04 05:21:35.729907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: DEBUG nova.api.openstack.wsgi [None req-6130e098-b7f1-4231-a58e-f658baf1c4f0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Returning 404 to user: Instance 8bd146ac-9a7e-4703-bb98-74e43843451e could not be found. {{(pid=134884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 05:21:35.729907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO nova.api.openstack.requestlog [None req-6130e098-b7f1-4231-a58e-f658baf1c4f0 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e" status: 404 len: 111 microversion: 2.1 time: 0.032599 Aug 04 05:21:35.729907 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: [pid: 134884|app: 0|req: 1299/2596] 10.222.0.47 () {58 vars in 1236 bytes} [Thu Aug 4 05:21:35 2022] GET /compute/v2.1/servers/8bd146ac-9a7e-4703-bb98-74e43843451e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 05:21:37.120413 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: DEBUG nova.api.openstack.wsgi [None req-e371ceda-912a-4890-9335-10e27bb018d7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] Calling method '.version_select at 0x7fc946a99f70>' {{(pid=134883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 05:21:37.150520 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO nova.api.openstack.requestlog [None req-e371ceda-912a-4890-9335-10e27bb018d7 tempest-TestVolumeBootPattern-1698193638 tempest-TestVolumeBootPattern-1698193638-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1187330075" status: 202 len: 0 microversion: 2.1 time: 0.038139 Aug 04 05:21:37.151470 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: [pid: 134883|app: 0|req: 1298/2597] 10.222.0.47 () {58 vars in 1263 bytes} [Thu Aug 4 05:21:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1187330075 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 05:22:19.854954 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 04 05:22:19.856110 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:22:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:22:28.290857 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:22:28.291672 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:22:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:24:18.624204 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:24:18.624951 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:24:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:24:20.320745 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:24:20.321373 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:24:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:24:33.092434 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:24:33.093057 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:24:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:25:39.863590 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:25:39.864211 dv-cinder-851279-5-iscsi devstack@n-api.service[134883]: Thu Aug 4 05:25:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 05:25:48.307473 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 05:25:48.308093 dv-cinder-851279-5-iscsi devstack@n-api.service[134884]: Thu Aug 4 05:25:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!